For a large enterprise group with multiple sub-organizations, different application systems are built in different stages. There are great differences among the different units in time of construction, technical platform, data structure and function design. The key data needed by the headquarters are mainly input manually and submitted in report forms. The timeliness, accuracy and authenticity of the data are facing great challenges and cannot meet the demands of the group operation, intensive operation and fine management of modern enterprises. The data acquisition and exchange system focuses on acquiring data for the grass-roots units and headquarters and automatically and timely transmitting the data to the data center of the headquarters. It is an important part of the integrated information platform.
The data acquisition and exchange system can implement fast and reliable large data volume exchange, monitor and acquire updated data in real time, and synchronize the data at the target end. It is a supportive technology platform to implement the “horizontal integration and longitudinal connection”. It is mainly used to acquire data for the complete information systems at all the levels and exchange the data between the systems. It can integrate other tools and support various secondary development to meet the demands for multi-scenario integration. When the data is exchanged and shared, all the data providers and data consumers need to comply with the data structure, data specification, format rules, etc. of the intermediate database.
The main functions include:
1. Make configurable and automatic the data acquisition from the business system databases of the grass-roots units;
2. Upload the acquired data to the data center buffer of the headquarters according to the specified strategy (timing, timely) so as to provide stable and high-quality data sources for the follow-up processing;
3. Provide standard and normative horizontal exchange services and format specifications between application systems of headquarters.
Overall Construction Framework
The data acquisition and exchange system can acquire data in the following three ways: online acquisition, offline acquisition and filling in forms. The three ways are respectively suitable for the three existing forms of data: data form supported by a system, data in electronic files and no data source available. The way in which data are acquired can be dynamically adjusted. The online acquisition can be conducted by using one of the following three techniques: direct acquisition, pushing and ETL. Direct acquisition acquires updated data in real time through the data acquisition and exchange platform and provides platform support for data sharing between systems. It is applicable to the business scenario demanding high timeliness. Pushing is where the system pushes data to the target end according to a specified standard and certain business logics. It is applicable to system with high security level. ETL sets the time through ETL tools or scans the system and reads data based on tasks. It is applicable to the scenario with strong periodicity, large volumes of data and complex processing logic. It is often used to process and handle the internal large volumes of data of a data center. Usually, it is not used between longitudinal data. Offline data acquisition is applicable to the data source in structured files, such as Excel files and text files. Filling in forms is used to submit data that is not supported by a system or any integrated conditions. The data is directly input into a group database through system.
The data acquisition and exchange platform is deployed at three levels (or according to the levels of the organization): the group level, the subsidiary or branch level and the grass-roots unit level. The preposition database deployed at each level is the data hub which is used to temporarily store the process data, control data and business data for acquisition and exchange. As for the primary data automatically acquired, the platform processes it and turns it into standardized data according to the requirements of data planning, encoding specification, etc. The platform provides multiple methods such as self-synchronizing, views, messages to synchronize the data to the preset target end. The platform is responsible for data acquisition, integration and sharing of corporate internal systems at all levels and implements bidirectional data exchange between the superior and subordinate enterprises.
To ensure stable operation of the platform, it provides overall full-process monitoring, including the process monitoring, status monitoring, performance monitoring and data quality monitoring.
Data acquisition and exchange system supports different data sources through flexible configuration. It acquires data in real time or regularly and converts and shares the data according to the IEC CIM model. It integrates data processes and reviews at different levels to meet the data analysis requirements of all levels. The data quality is ensured through the full-process data monitoring.
Data acquisition and exchange system implements horizontal integration among internal systems of enterprises, data submission and longitudinal connection among the organizations. It builds an overall full-process multi-layer support platform for data acquisition, transmission, integration, sharing, exchange and monitoring, which covers the “horizontal integration and longitudinal connection” of data acquisition and sharing of the whole group. The core capacity includes the following five aspects:
1. Creating a supporting platform for unified and standardized data submission and online acquisition
Based on the index data planning, it uniformly designs and constructs the data acquisition and exchange system, provides multiple acquisition modes such as filling in forms, direct acquisition, pushing and ETL extraction, offers automatic switch between different acquisition modes to meet the requirements of multi-scenario, multi-mode and multi-technology acquisition and supports direct acquisition and exchange of data to establish a unified and standardized data acquisition and exchange support platform.
2. Building safe and reliable transmission channels;
The platform provides a bidirectional, reliable and safe high-speed information channel, which can not only upload local system data to the upper level, but also receive generic data or corporate exclusive data distributed by the upper level. The data is automatically synchronized to corresponding local business system to realize cross-region and cross-organization system fusion and data connection.
3. Forming unified, normative and standard data;
According to relevant regulations and requirements of the enterprise, and by referring to relevant IEC CIM standards, it establishes a unified and normative organizational system, electric resource system, resource parameter system, resource measurement system and index system and builds the standardized system for data storage, encoding, sharing and exchange.
4. Providing complete data exchange technology capacity;
According to the sharing demands and business agreements and based on standardized data, the platform provides a complete near-real-time automatic data exchange mechanism, which synchronizes the data to the target end. The platform provides multiple technical means such as synchronous pushing, views and basic services to meet the demands of the complex business scenarios.
5. Providing comprehensive, smart and visual monitoring;
Centering on the stable platform operation while ensuring data quality, the platform monitors the status and operation parameters of relevant objects such as the information system, networks, channels, databases and subscription sets in real time. It checks the integrity, timeliness and effectiveness of data and captures possible exceptions. It reveals the exceptions through visual interfaces and gives alarms. Meanwhile, it notifies relevant persons in charge by means of emails, text messages, etc., to quickly locate and help solve the problems.
The data acquisition and exchange system is the basic platform to build an enterprise-level data center. The system can bring customers the following things:
First, unified data standards and specifications: it realizes horizontal integration and longitudinal data connection for group enterprises, provides unified and consistent standard data for business application and lays the foundation for enterprise-level data center construction.
Second, unified data exchange and sharing: it integrates information silos through unified platform framework and implements unified data exchange and sharing in the entire group.
Third, unified data sources: it realizes the “same data sources, unified specifications and overall connection”, reduces or avoids the problems such as “reports in different forms and data in different formats” and organically unifies the business flow, data stream and information flow within enterprises.
Fourth, reducing the filling-in-form workload of grass-roots enterprises: it directly acquires data from business system through the platform and reduces the workload of grass-roots employees in manual tabulation and filling in forms.
(2010-2012) The data acquisition and exchange system project of China Guodian Corporation
(2011-2012) The integrated platform project of Shandong Electric Power Co., Ltd. of China Guodian Corporation
(2012-2013) The data acquisition and exchange system project of Qinghai Electric Power Co., Ltd. of China Guodian Corporation
(2012-2014) Daduhe Integration Platform Project of China Guodian Corporation
(2013-2014) The data acquisition and exchange system project of Chongqing Corporation of China Guodian Corporation
(2013-2014) The data acquisition and exchange system project of Anhui Corporation of China Guodian Corporation
(2014-2015) The data acquisition and exchange platform project of Hainan Corporation of China Guodian Corporation
(2014-2015) The data acquisition and exchange platform project of Sichuan Corporation of China Guodian Corporation
(2015-2016) The data acquisition and exchange system project of Northeast Corporation of China Guodian Corporation
(2015-2016) The data acquisition and exchange system project of Inner Mongolia Corporation of China Guodian Corporation
(2015-2016) The data acquisition and exchange system project of Changyuan Electric Power Corporation of China Guodian Corporation
(2015-2016) The data acquisition and exchange system project of Hebei New Energy Corporation of China Guodian Corporation