Now that "scale is all we need" has predictably faltered...
1. Small AI models often perform better in context.
2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture.
Me +
@gaelvaroquaux.bsky.social @sashamtl.bsky.social
arxiv.org/abs/2409.14160
Hype, Sustainability, and the Price of the Bigger-is-Better Paradigm in AI
With the growing attention and investment in recent AI approaches such as large language models, the narrative that the larger the AI system the more valuable, powerful and interesting it is is increa...
