Improving Late Scheduler and Result Analysis in Heterogeneous Environment
The word Heterogeneity signifies diversity and Heterogeneity of Hadoop cluster exists as nodes have different configuration and they are distributed in various geographical sites. In distributed environments, homogeneity and local access of data are not full filled. Therefore, performance reduction will happen in default Hadoop schedulers where the cluster nodes are heterogeneous. Because of highly robust nature of LATE Scheduler, it can be used to improve response time in heterogeneous environment by varying the number of Mappers and Reducers for each node. In this paper we have used variable number of Reducers and Mappers to improve the performance of Hadoop heterogeneous cluster. Keywords speculative execution; improved LATE; variable Mappers; variable Reducers, heterogeneous.