Attention is All You Need

This paper introduces the Transformer, a novel neural network architecture based solely on attention mechanisms, dispensing with recurrence and convolutions entirely. It demonstrates that this architecture can be trained more efficiently and achieve state-of-the-art results in machine translation tasks, suggesting its potential for various sequence-to-sequence tasks by modeling dependencies without regard to their distance in the input or output sequences.