La robotique humanoïde et l'IA incarnée s'apprête à changer le monde
Il est alors possible de simuler les actions du robot à des vitesses des millions de fois supérieur à la réalité dans un monde digital, et de ...
Attention is all you need
C’est alors qu’en 2018, des chercheurs de Google publièrent un article de recherche qui allait tout changer : <anchor>Attention is all you need</anchor>. Cet article présente une nouvelle architecture d’IA appelée le Transformer, qui présente de nombreux atouts face aux modèles existants, dont une haute capacité de parallélisation. Ce modèle est tellement efficace qu’il est a l’origine de tous les outils d’IA générative que l’on connait aujourd’hui, dont GPT4, pour Generative Pre-trained Transformer v4.
[1706.03762] Attention Is All You Need
arXiv Accessibility Forum 2024

This week: the arXiv Accessibility Forum

We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate

All fieldsTitleAuthorAbstractCommentsJournal referenceACM classificationMSC classificationReport numberarXiv identifierDOIORCIDarXiv author IDHelp pagesFull text

Search

open search

GO

open navigation menu

## quick links

# Computer Science > Computation and Language

arXiv:1706.03762 (cs)

[Submitted on 12 Jun 2017 ( v1), last revised 2 Aug 2023 (this version, v7)]

# Title:Attention Is All You Need

View a PDF of the paper titled Attention Is All You Need, by Ashish Vaswani and 7 other authors

Focus to learn more

arXiv-issued DOI via DataCite

## Submission history

[v1]
Mon, 12 Jun 2017 17:57:34 UTC (1,102 KB)

[v2]
Mon, 19 Jun 2017 16:49:45 UTC (1,125 KB)

[v3]
Tue, 20 Jun 2017 05:20:02 UTC (1,125 KB)

[v4]
Fri, 30 Jun 2017 17:29:30 UTC (1,124 KB)

[v5]
Wed, 6 Dec 2017 03:30:32 UTC (1,124 KB)

[v6]
Mon, 24 Jul 2023 00:48:54 UTC (1,124 KB)

[v7]
Wed, 2 Aug 2023 00:41:18 UTC (1,124 KB)

Full-text links:

## Access Paper:

View a PDF of the paper titled Attention Is All You Need, by Ashish Vaswani and 7 other authors

Current browse context:

cs.CL

Change to browse by:

### References & Citations

### 119 blog links

### DBLP - CS Bibliography

…

a export BibTeX citationLoading...

## BibTeX formatted citation

×

Data provided by:

### Bookmark

[BibSonomy logo](http://www.bibsonomy.org/BibtexHandler?requTask=upload&url=https://arxiv.org/abs/1706.03762&description=Attention Is All You Need "Bookmark on BibSonomy") [Reddit logo](https://reddit.com/submit?url=https://arxiv.org/abs/1706.03762&title=Attention Is All You Need "Bookmark on Reddit")

Bibliographic Tools

# Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Litmaps Toggle

scite.ai Toggle

Code, Data, Media

# Code, Data and Media Associated with this Article

Links to Code Toggle

DagsHub Toggle

GotitPub Toggle

Links to Code Toggle

ScienceCast Toggle

Demos

# Demos

Replicate Toggle

Spaces Toggle

Spaces Toggle

Related Papers

# Recommenders and Search Tools

Link to Influence Flower

Connected Papers Toggle

Core recommender toggle

- Author
- Venue
- Institution
- Topic

About arXivLabs

# arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Get status notifications via
email
or slack