- In today's Generative AI lecture, we primarily discuss scaling laws and the key factors that go into building large-scale foundation models. Slides: www.cs.cmu.edu/~mgormley/co... Full course info: bsky.app/profile/anay...
- We also discuss data quality & amount (where you get great performance with a smaller model trained on lots of tokens), how to get good data depending on your application, and Moravec's paradox for robotics foundation models.Oct 23, 2025 13:44
- Finally, we briefly discuss Querying Transformers for text-image alignment, as a hold-over from last lecture on multimodal foundation models!
