Google Museum Ler em português

Research paper · AI and research

Attention Is All You Need, the Transformer paper (2017)

The paper by Ashish Vaswani and seven co-authors proposed the Transformer, a neural network architecture based solely on attention mechanisms, without recurrence or convolutions. In English-to-German translation it beat the best results of the time by more than 2 BLEU points; in English-to-French it reached 41.8 BLEU after 3.5 days of training on eight GPUs.

Self-attention diagram: the word it links to animal in one sentence and to street in the other
Diagram from the Google Research blog post on the Transformer. Google, August 31, 2017 · Source: Transformer: A Novel Neural Network Architecture for Language Understanding · Image by Google, displayed from the original server; not covered by the museum’s CC BY 4.0 license.

June 12, 2017

Attention Is All You Need

Research paper · AI and research · Active

sources · timeline 2015–2019

Interpretive reconstruction · Material Design Material Design conventions (2014–2019): shadowed cards on a light grey ground, bold flat colors and a round floating button. Does not reproduce any Google page.

Dates

  • June 12, 2017 Publication · exact date [1]

What the sources say

ClaimRecordConfidenceSources
Authors Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser and Polosukhin 2 · Single primary source [1] primary
English–French result 41.8 BLEU, with 3.5 days of training on eight GPUs
Statement		 2 · Single primary source [1] primary

What the confidence levels mean

Names

  • Attention Is All You Need — official name
  • Transformer — period nickname

Historical captures

No archived capture has been located for this record yet.

Sources

  1. Attention Is All You Need — Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin — arXiv, June 12, 2017. Source primary · accessed November 2, 2026 · look for a copy on the Internet Archive

What still needs documenting

  • Presentation at NeurIPS 2017
  • Source for the Transformer's influence on later models

On GD

GD has followed Google since 2006. Search GD for “Attention Is All You Need” (in Portuguese)

How to cite

"Attention Is All You Need, the Transformer paper (2017)", Google Museum (GD), https://gd.eurisko.com.br/museu/en/collection/attention-is-all-you-need-2017/, CC BY 4.0. Reviewed on November 2, 2026.

ID: attention-is-all-you-need-2017 · Reviewed on November 2, 2026