Transformer softmax natural language processing ChatGPT GPT-4 BERT computer vision matrix language processing
The modern Transformer was introduced by Ashish Vaswani et. al. in their 2017 paper "Attention Is All You Need." 
It combines this with a softmax operator and a projection matrix.
Transformers have increasingly become the model of choice for natural language processing. Many modern large language models such as ChatGPT, GPT-4, and BERT use it. Transformers are also increasingly being used in computer vision.
