Attention is All You Need

This paper introduces the Transformer, a novel neural network architecture based solely on the attention mechanism, dispensing with recurrence and convolutions entirely. It demonstrates that attention mechanisms can be used to model dependencies without regard to their distance in the input or output sequences. The Transformer achieves state-of-the-art results in machine translation tasks, showcasing its potential for various sequence transduction tasks.