Development and application of a gradient method for solving differential games
A technique for solving n-dimensional games is developed and applied to two pursuit-evasion games. The first is a two-dimensional game similar to the homicidal chauffeur but modified to resemble an airplane-helicopter engagement. The second is a five-dimensional game of two airplanes at constant altitude and with thrust and turning controls. The performance function to be optimized by the pursuer and evader was the distance between the evader and a given target point in front of the pursuer. The analytic solution to the first game reveals that both unique and nonunique solutions exist. A comparison between the gradient results and the analytic solution shows a dependence on the nominal controls in regions where nonunique solutions exist. In the unique solution region, the results from the two methods agree closely. The results for the five-dimensional two-airplane game are also shown to be dependent on the nominal controls selected and indicate that initial conditions are in a region of nonunique solutions.
Numerical solution methods for differential game problems
Differential game theory provides a potential means for the parametric analysis of combat engagement scenarios. To determine its viability for this type of analysis, three frameworks for solving differential game problems are evaluated. Each method solves zero-sum, pursuit-evasion games in which two players have opposing goals. A solution to the saddle-point equilibrium problem is sought in which one player minimizes the value of the game while the other player maximizes it. The boundary value method is an indirect method that makes use of the analytical necessary conditions of optimality and is solved using a conventional optimal control framework. This method provides a high accuracy solution but has a limited convergence space that requires a good initial guess for both the state and less intuitive costate. The decomposition method in which optimal trajectories for each player are iteratively calculated is a direct method that bypasses the need for costate information. Because a linearized cost gradient is used to update the evader's strategy the initial conditions can heavily influence the convergence of the problem. The new method of neural networks involves the use of neural networks to govern the control policy for each player. An optimization tool adjusts the weights and biases of the network to form the control policy that results in the best final value of the game. An automatic differentiation engine provides gradient information for the sensitivity of each weight to the final cost. The final weights define the control policy's response to a range of initial conditions dependent upon the breadth of the state-space used to train each neural network. The neural nets are initialized with a normal distribution of weights so that no information regarding the state, costate, or switching structure of the controller is required. In its current form this method often converges to a suboptimal solution. Also, creative techniques are required when dealing with boundary conditions and free end-time problems. Thesis Supervisor: Steven R. Hall, Ph.D. Title: Professor of Aeronautics and Astronautics Thesis Supervisor: Russell Smith, Ph.D. Title: Principal Member of Technical Staff, C. S. Draper Laboratory, Inc.
Numerical tools applied to power reactor noise analysis
In order to be able to calculate the space- and frequency-dependent neutron noise in real inhomogeneous systems in two-group theory, a code was developed for the calculation of the Green's function (dynamic transfer function) of such systems. This paper reports on the development as well as the test and application of the numerical tools employed. The code that was developed yields the space-dependence of the fluctuations of the neutron flux induced by fluctuating properties of the medium in the two-group diffusion approximation and in a two-dimensional representation of heterogeneous systems, for both critical systems and non-critical systems with an external source. Some applications of these tools to power reactor noise analysis are then described, including the unfolding of the parameters of the noise source from the induced neutron noise, measured at a few discrete locations throughout the core. Other concrete applications concern the study of the space-dependence of the Decay Ratio in Boiling Water Reactors, the noise-based estimation of the Moderator Temperature Coefficient of reactivity in Pressurized Water Reactors, the modeling of the beam- and shell-mode core-barrel vibrations in Pressurized Water Reactors, and the investigation of the validity of the point-kinetic approximation in subcritical systems driven by an external source. In most of these applications, calculations performed using the code are compared with at-power plant measurements. Power reactor noise analysis applications of the above type, i.e. core monitoring without disturbing plant operation, is of particular interest in the framework of the extensive program of power uprates worldwide.