Sakana AI's CTO says he's 'absolutely sick' of transformers, the tech that powers every major AI model

Llion Jones co-authored the seminal 2017 paper "Attention Is All You Need" He says the field has calcified around a single architectural approach. The culprit, he argued, is the "immense amount of pressure" from investors.