Sebastian Raschka has dropped a 3-hour workshop on building LLMs from the Ground Up! This resource comes with great timing as LLMs continue to grow in popularity, covering the foundations across input data preparation, model architecture coding, pretraining, and fine-tuning. This is quite comprehensive as it dives into practical coding examples using PyTorch and LitGPT, building the core fundamentals from scratch and training simplified LLM versions like GPT-2. Video and summary: https://lnkd.in/eJJV5ttS -- If you liked this article you can join 60,000 practitioners for weekly tutorials, resources, OSS frameworks, and MLOps events across the machine learning ecosystem: https://lnkd.in/eRBQzVcA #ML #MachineLearning #ArtificialIntelligence #AI #MLOps #AIOps #DataOps #augmentedintelligence #deeplearning #privacy #kubernetes #datascience #python #bigdata
This workshop by Sebastian Raschka appears to offer valuable insights into building LLMs. Engaging with practical examples boosts understanding significantly in this evolving field.
will watch it - thanks for sharing Alejandro Saucedo
ML Engineering Manager @ Zalando / Central ML Ops
1moHis youtube channel is also a gold mine of deep learning and generative model resources. Can highly recommend! https://www.youtube.com/watch?v=1nqCZqDYPp0&list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51