A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> Different driving forces push the electricity production towards decentralization. As a result, the current electricity infrastructure is expected to evolve into a network of networks, in which all system parts communicate with each other and influence each other. Multi-agent systems and electronic markets form an appropriate technology needed for control and coordination tasks in the future electricity network. We present the PowerMatcher, a market-based control concept for supply and demand matching (SDM) in electricity networks. In a presented simulation study is shown that the simultaneousness of electricity production and consumption can be raised substantially using this concept. Further, we present a field test with medium-sized electricity producing and consuming installations controlled via this concept, currently in preparation. <s> BIB001 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> This is the first part of a two-part paper that has arisen from the work of the IEEE Power Engineering Society's Multi-Agent Systems (MAS) Working Group. Part I of this paper examines the potential value of MAS technology to the power industry. In terms of contribution, it describes fundamental concepts and approaches within the field of multi-agent systems that are appropriate to power engineering applications. As well as presenting a comprehensive review of the meaningful power engineering applications for which MAS are being investigated, it also defines the technical issues which must be addressed in order to accelerate and facilitate the uptake of the technology within the power and energy sector. Part II of this paper explores the decisions inherent in engineering multi-agent systems for applications in the power and energy sector and offers guidance and recommendations on how MAS can be designed and implemented. <s> BIB002 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> The transition of traditional power systems into the flexible smart grids is under way. This paper presents a new interesting concept where Microgrids and other production or consumption units form a Virtual Power Plant. The main goal is to present the advantages of using agents for Virtual Power Plant control. More specifically this paper through examples and case studies presents how the local intelligence and the social ability of the agents may provide solutions in the optimal and effective control of a Virtual Power Plant. <s> BIB003 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> The European project INTEGRAL aims to build and demonstrate an industry-quality reference solution for DER aggregation-level control and coordination, based on commonly available ICT components, standards, and platforms. To achieve this, the Integrated ICT-platform based Distributed Control (IIDC) is introduced. The project includes also three field test site installations in the Netherlands, Spain and France, covering normal, critical and emergency grid conditions. <s> BIB004 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> The high heterogeneity in smart house infrastructures as well as in the smart grid poses several challenges when it comes into developing approaches for energy efficiency. Consequently, several monitoring and control approaches are underway, and although they share the common goal of optimizing energy usage, they are fundamentally different at design and operational level. Therefore, we consider of high importance to investigate if they can be integrated and, more importantly, we provide common services to emerging enterprise applications that seek to hide the existing heterogeneity. We present here our motivation and efforts in bringing together the PowerMatcher, BEMI and the Magic system. <s> BIB005 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> This paper presents a decentralized architecture for the islanding operation of distribution grids with large volume of distributed generation. This architecture involves the definition of network blocks which share the responsibility of frequency control. The control block abstraction was particularly designed to support the transition from regular grids to smart grids. In addition, the control schemes were developed using an agent-based paradigm. Hence, an agent-based simulation platform was implemented using libraries from the Java Agent Development Framework (JADE). The control schemes were evaluated using a test system with different sorts of distributed energy resources and modeled in the EUROSTAG environment. Simulation results show the effectiveness of the control architecture when different failure events are applied to the test system. <s> BIB006 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> This paper proposes standards' based software and communication platform for implementation of distributed grid intelligence in FREEDM system. This enables system level design for distributed application and consistent mapping to the interfacing hardware. The system becomes scalable, reconfigurable and easily maintainable. Applying IEC 61499 standard for distributed and embedded applications and IEC 61850 standard for communication in substation, multi-agent design can be systematically introduced to power system automation. With this approach distributed grid intelligence nodes become intelligent, independent and interactive agents, with vendor independent software and unified communication. This concept is illustrated on an example of distributed intelligent fault management system, and verified through simulation. <s> BIB007 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> Universal, intelligent, and multifunctional devices controlling power distribution and measurement will become the enabling technology of the Smart Grid ICT. In this paper, we report on a novel automation architecture which supports distributed multiagent intelligence, interoperability, and configurability and enables efficient simulation of distributed automation systems. The solution is based on the combination of IEC 61850 object-based modeling and interoperable communication with IEC 61499 function block executable specification. Using the developed simulation environment, we demonstrate the possibility of multiagent control to achieve self-healing grid through collaborative fault location and power restoration. <s> BIB008 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> This paper proposes solutions for distributed protection applications, to improve current and design of future protection schemes. This solution utilises advantages of fast and reliable peer-to-peer communication of IEC 61850 and interoperability and configurability of IEC 61499. The integration of the two standards improves protection schemes by decreasing fault clearing times and minimizes the effect of short circuit faults on sensitive loads. Additional advantages include the reductions of the number of hard-wired connections, especially in a large substation where all protection IEDs has a significant number of binary inputs and relay outputs. IEC 61499 is an open standard for designing distributed control systems to promote portability, interoperability and configurability, i.e. vendor independent, flexible and robust solutions. IEC 61499 can be used to represent programmable logic of power system devices, in a standard form and in a vendor independent way. The proposed distributed protection system is implemented and simulated using the developed co-simulation environment. <s> BIB009 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> Industrial agents technology leverages the benefits of multiagent systems, distributed computing, artificial intelligence techniques and semantics in the field of production, services and infrastructure sectors, providing a new way to design and engineer control solutions based on the decentralization of control over distributed structures. The key drivers for this application are the benefits of agent-based industrial systems, namely in terms of robustness, scalability, reconfigurability and productivity, all of which translate to a greater competitive advantage. This manuscript monitors the chronology of research and development of the industrial applications of multiagent and holonic systems. It provides the comprehensive overview of methodologies, architectures and applications of agents in industrial domain from early nineties up to present. It also gives an outlook of the current trends as well as challenges and possible future application domains of industrial agents. <s> BIB010 </s> A Review of Architectures and Concepts for Intelligence in Future Electric Energy Systems <s> B. Agent-Based Solutions <s> The paper proposes a novel computer-aided model-based system engineering process for Smart Gird applications. The process is supported by the SysGrid tool that plays the roles of system configurator and device configurator. The design process starts with single line diagrams which are automatically transformed to executable function block specifications. The process is based on the Smart Grid control architecture that is a heterogeneous network of controllers communicating in a peer to peer manner. This “artificial nervous system” of the Smart Grid will be capable of self-healing and dynamic adaptation to renewable generation and ever-changing loads. The tool supports system-level design of automation logic in the form of function block networks with compliancy to IEC 61499. The capabilities of SysGrid are demonstrated through the process of designing a distributed protection application. <s> BIB011
To master the high complexity of future electric energy systems, where the intelligence is distributed over autonomously acting and interacting components, it is necessary to explore architectures and programming techniques based on distributed AI. One of the most relevant technologies seems to be multiagent systems (MAS). They have already proved its capabilities for developing robust, flexible, and adaptive industrial automation systems, with application domains, including manufacturing control, dynamic product routing, production planning and scheduling, logistics, aerospace, air traffic control, and many others BIB010 . In the effort to employ active elements in power grids with the local intelligence and coordination capabilities, it is apparent that the MAS approach receives a significant popularity also for developing smart grids BIB002 , as shown in Fig. 6 . Using MAS principles, each component, device, or actor is monitored and controlled by an autonomous agent. Each agent has a set of specific capabilities (such as controlling household appliances) and local objectives (for example, minimization of energy cost while preserving the end-user comfort). The agents interact via messages to coordinate their behaviors in order to achieve an equilibrium between the local and system-wide goals (such as demand-supply balancing). MAS technology has been employed for developing the distributed ICT infrastructure within various projects such as the FREEDM initiative and the CRISP project. A concept of grid cells was developed to divide the network into independently managed subnetworks. The agent assigned to each grid cell is responsible for managing the current and future production/consumption and handling the reconfiguration tasks in case of fault detection [97] . A very similar approach considering microgrids as small-scale electricity grids operating in low-voltage networks is presented in  . Each house in the microgrid is equipped with the intelligent load controller (ILC), which can communicate with house devices over the power line in order to intelligently control their load. The agent embedded in the ILC communicates with the microgrid central controller agent, whose task is to balance production and consumption within the microgrid. The MAS approach has been also exploited in designing the concept of virtual power plants (VPPs). A VPP is comparable with a microgrid-it is an aggregation of generation units, such as PV systems, combined heat and power units, or wind turbines together with controllable loads. They are represented by agents grouped into an MAS, which is represented by a management agent as a single entity on the energy market BIB003 . To allow the smaller entities to trade the electricity locally in order to achieve the demand-supply balancing, a concept of electronic power markets was introduced. The PowerMatcher tool is an MAS in which electricity generation and/or consumers are represented as agents trying to sell and buy energy. The process of price negotiation is managed by an auctioneer agent that finds the equilibrium price considering the bids collected from device agents BIB001 . The PowerMatcher tool has been used also in other projects such as INTEGRAL, which is aimed at the distributed control and coordination of aggregated DERs BIB004 , SmartHouse/Smart-Grid focused on integration of smart houses into the smart grid BIB005 , and EcoGrid targets the large-scale demonstration of the smart grid solution with 2000 residential consumers on the Danish island Bornholm  . An agent-based architecture for smart grids is also presented in BIB008 . The architecture is based on industrial standards IEC 61850  and IEC 61499  to facilitate the migration of agent technology into the industrial practice. The agents are so-called intelligent logical nodes (iLNs), capturing data from IEC 61850 LN. The idea is that the power system automation can be decomposed into LNs, capturing functional requirements of the desired system. Then, LNs can be enhanced with the desired algorithm. Each iLN is implemented with an IEC 61499 function block. The iLN architecture enables automatic generation of automation software and plant models given customer requirements captured with IEC 61850 means. SysGrid is a tool supporting such automatic transformation, which is proposed in BIB011 . A number of projects were implemented using iLN architecture BIB007 , BIB008 , BIB009 . The fault prevention and self-healing techniques for smart grids based on MAS are also widely discussed. One technique presented in BIB006 is based on calculation of optimal network configuration achieved by opening or closing the switching elements to isolate the fault. Another similar technique considers partitioning the grid into multiple islands that disconnect from the main grid in case of a failure. The agents responsible for those islands cooperatively prepare plans of action to isolate the faulty parts from the power grid BIB006 .