Yiziphi izingxenye eziyinhloko ze-Apache Spark ezisekelwe esigabeni?
Context:I-Apache Spark idinga umphathi we-cluster kanye nesistimu yokugcina eyisisekelo. Ukuphathwa kwe-cluster, i-Spark isekela i-standalone (i-Spark cluster yendabuko, lapho ungaqala khona i-cluster ngesandla noma usebenzise imibhalo yokuqalisa enikezwe yiphakethe lokufaka. Kungenzeka futhi ukusebenzisa lezi daemons emshinini owodwa wokuhlola), iHadoop YARN, i-Apache Mesos noma iKubernetes. Ukuze isitoreji esabiwe, Spark kungaba interface ezihlukahlukene, kuhlanganise Alluxio, Hadoop Distributed File System (HDFS), MapR File System (MapR-FS), Cassandra, OpenStack Swift, Amazon S3, Kudu, Lustre uhlelo lwefayela, noma isixazululo ngokwezifiso kungenziwa lwenteke. I-Spark iphinde isekele imodi yasendaweni esatshalaliswa, evame ukusetshenziselwa kuphela izinjongo zokuthuthukisa noma zokuhlola, lapho isitoreji esatshalalisiwe singadingeki khona futhi uhlelo lwefayela lendawo lungasetshenziswa esikhundleni salokho; esimweni esinjalo, i-Spark isebenza kumshini owodwa one-executor eyodwa nge-CPU core ngayinye.
Ngokusekelwe esigabeni, umphathi we-cluster kanye nesitoreji esabelwe yizingxenye ezimbili eziyinhloko ze-Apache Spark. Njengomphathi we-cluster, iSpark isekela i-cluster ezimele, noma i-Hadoop YARN, i-Apache Mesos, noma i-Kubernetes. Mayelana nokugcinwa, iSpark isekela izinhlelo zamafayela endawo zokuthuthukiswa nokuhlolwa, kanye neHadoop File System, iCassandra, kanye nokugcinwa kwamafu