A Requiem for the Transformer?
Will be the transformer the model leading us to artificial general intelligence? Or will be replaced? — The transformer has dominated the world of artificial intelligence for six years, achieving state-of-the-art in all subdomains of artificial intelligence. From natural language processing (NLP) to computer vision to sound and graphs, there are dedicated transformers with excellent performance. How much longer will this domain last?