- "we didn't actually have a good idea, we had the freedom to actually spend time and go and work on it, and even more importantly, we didn't have any pressure that was coming down from management, No pressure to work on any particular project, publish a number of papers to push a certain metric up."
- Llion Jones, co-author of the 2017 paper that launched the transformer era, says he’s ‘absolutely sick’ of transformers — and believes the field’s over-fixation on one architecture may be stifling the next breakthrough. venturebeat.com/ai/sakana-ai...