Pampiri ea "Tlhokomelo ke sohle seo u se hlokang" e ile ea etsa tlhahiso ea mohlala oa Transformer ka lekhetlo la pele, e neng e e-na le tšusumetso e matla ho LLM e latelang. Ka kōpo fana ka khopolo ea mantlha konokono ea Transformer hlalositsoeng pampiring ena
Context:Transformer ke mohlala o tebileng oa ho ithuta o sebelisang mokhoa oa ho itlhokomela, o arola bohlokoa ba karolo ka 'ngoe ea data ea ho kenya. E sebelisoa haholo-holo masimong a ho sebetsana le puo ea tlhaho (NLP) le pono ea k'homphieutha (CV).  Joalo ka marang-rang a neural a iphetang (RNNs), li-transformer li etselitsoe ho sebetsana le lintlha tse kenang ka tatellano, joalo ka puo ea tlhaho, ka lits'ebetso tse lebisang mesebetsing e kang phetolelo le kakaretso ea mongolo. Leha ho le joalo, ho fapana le li-RNN, li-transformer li sebetsana le boitsebiso bohle ka nako e le 'ngoe. Mokhoa oa ho ela hloko o fana ka moelelo oa taba bakeng sa boemo leha e le bofe tatellanong ea boitsebiso bo kenngoang. Ka mohlala, haeba boitsebiso bo kenngoeng e le polelo ea puo ea tlhaho, mochine o fetisang ha o hloke ho sebetsana le lentsoe le le leng ka nako. Sena se nolofalletsa ho bapisa lintho ka tsela e tšoanang ho feta li-RNN'me ka hona se fokotsa nako ea koetliso.  Li-transformer li ile tsa hlahisoa ka 2017 ke sehlopha sa Google Brain'me li ntse li fetoha mohlala oa khetho bakeng sa mathata a NLP, ho nkela mekhoa ea RNN sebaka joalo ka mohopolo oa nako e khuts'oane (LSTM). Koetliso e eketsehileng ea ho bapisa e lumella koetliso ho li-data tse kholoanyane. Sena se ile sa lebisa ho nts'etsopele ea litsamaiso tse koetlisitsoeng pele joalo ka BERT (Bidirectional Encoder Representations from Transformers) le GPT (Generative Pre-trained Transformer), tse koetlisitsoeng ka lipuo tse kholo tsa data, joalo ka Wikipedia Corpus le Common Crawl, mme li ka hlophisoa hantle bakeng sa mesebetsi e ikhethileng.
Pampiri ena e ngotsoe ke Vaswani, Ashish & Shazeer, Noam & Parmar, Niki & Uszkoreit, Jakob & Jones, Llion & Gomez, Aidan & Kaiser, Lukasz & Polosukhin, Illia.'me e phatlalalitsoe ka 2017. E thehile motheo bakeng sa letoto la lihlooho tse latelang tsa GPT le letoto la lihlooho tsa BERT. Mohlala oa GPT o sebelisa karolo ea decoder ea Transfomer, ha mohlala oa BERT o sebelisa karolo ea encoder ea Transfomer. Moralo o ka sehloohong oa Transformer o kenyelletsa: Self-Attention Mechanism, Positional Encoding, Encoder-Decoder Architecture, Multi-Head Attension. Transformer e rarolla ka katleho bothata bo thata bo tšoanang ba mofuta oa RNN / LSTM o fetileng ka ho sebelisa mochine oa tlhokomelo. Ho sebelisa ho Itlhokomela ho rarolla bothata ba boitsebiso bo fokolang bo ngotsoeng ho NLP. Boitsebiso bo latellanang ba mongolo o kenngoeng bo bolokoa ka ho kenya khoutu ea boemo. ' Me Multi-Head Attention e lumella Transformer ho ithuta mekhoa e fapaneng ea boitsebiso ba koetliso bo tšoanang le khopolo ea Channel ka mohlala oa CNN.