Ngokwalokhu okulandelayo, iyini inqubo yezinqumo zikaMarkov?
Context:Ezemathematics, inqubo yezinqumo zikaMarkov (i-MDP) inqubo yokulawula i-discrete-time stochastic. Inikeza uhlaka lwezibalo lokwenza izinqumo ezimweni lapho imiphumela iyingqayizivele ngokwengxenye futhi ngokwengxenye ingaphansi kokulawulwa ngumenzi wezinqumo. Ama-MDP awusizo ekutadisheni izinkinga zokwenza kahle ezixazululwa ngokuhlela okusheshayo. Ama-MDP ayaziwa okungenani ekuqaleni kwawo-1950; ingxenye enkulu yocwaningo ngezinqubo zokuthatha izinqumo zikaMarkov yavela encwadini kaRonald Howard yango-1960, iDynamic Programming and Markov Processes. Zisetshenziswa emikhakheni eminingi, kuhlanganise amarobhothi, ukulawula okuzenzakalelayo, ezomnotho kanye nokukhiqiza. Igama lama-MDP livela kusisazi sezibalo saseRussia u-Andrey Markov njengoba kungukwandiswa kwamaketanga kaMarkov.
Inqubo yesinqumo sikaMarkov (i-MDP) iyisisekelo sezibalo sokumodela ukuthatha izinqumo ezimweni lapho imiphumela ingekho ngokuphelele ngaphansi kokulawulwa ngabenzi bezinqumo. Ama-MDP asetshenziswa emikhakheni ehlukahlukene, njengamarobhothi nezomnotho.