Multi Source and Heterogeneous Data Integration Model for Big Data Analytics in Power DCS
It is the vital significance for the strong and smart grid that big data analytics technologies apply in the power system. The multi source and heterogeneous data integration technology based on big data platform is one of the indispensable content. As there are the problems of data heterogeneity and data islands in the dispatching and control system, a multi source and heterogeneous data integration model is proposed for big data analytics. This model exists the data integration layer in the platform of big data analytics. The model can improve the Extract Transform Load (ETL) process in the big data platform according to the extracting rules and transform rules, which are made by uniform data model in the panoramic dispatching and control system. Research shows that the integrating model developed here is efficient to establish panoramic data and can adapt to various data sources by building uniform data model in the power dispatching and control system. With the development of big data technology, it is expected that the data integration model will be improved and used in more electric power applications.
2016 International Conference on Cyber Enabled Distributed Computing and Knowledge Discovery (CyberC)