In task-based inverse dynamics control, reference accelerations used to follow a desired plan can be broken down into feedforward and feedback trajectories. The feedback term accounts for tracking errors that are caused from inaccurate dynamic models or external disturbances. On underactuated, free-floating robots, such as humanoids, good tracking accuracy often necessitates high feedback gains, which leads to undesirable stiff behaviors. The magnitude of these gains is anyways often strongly limited by the control bandwidth. In this paper, we show how to reduce the required contribution of the feedback controller by incorporating learned task-space reference accelerations. Thus, we i) improve the execution of the given specific task, and ii) offer the means to reduce feedback gains, providing for greater compliance of the system. In contrast to learning task-specific joint-torques, which might produce a similar effect but can lead to poor generalization, our approach directly learns the task-space dynamics of the center of mass of a humanoid robot. Simulated and real-world results on the lower part of the Sarcos Hermes humanoid robot demonstrate the applicability of the approach.
The framework of dynamic movement primitives (DMPs) contains many favorable properties for the execution of robotic trajectories, such as indirect dependence on time, response to perturbations, and the ability to easily modulate the given trajectories, but the framework in its original form remains constrained to the kinematic aspect of the movement. In this paper, we bridge the gap to dynamic behavior by extending the framework with force torque feedback. We propose and evaluate a modulation approach that allows interaction with objects and the environment. Through the proposed coupling of originally independent robotic trajectories, the approach also enables the execution of bimanual and tightly coupled cooperative tasks. We apply an iterative learning control algorithm to learn a coupling term, which is applied to the original trajectory in a feed-forward fashion and, thus, modifies the trajectory in accordance to the desired positions or external forces. A stability analysis and results of simulated and real-world experiments using two KUKA LWR arms for bimanual tasks and interaction with the environment are presented. By expanding on the framework of DMPs, we keep all the favorable properties, which is demonstrated with temporal modulation and in a two-agent obstacle avoidance task. In many industrial robot applications it is a fact that the robot is programmed to do the same task repeatedly. By observing the control error in the different iterations of the same task it becomes clear that it is actually highly repetitive. Iterative Learning Control (ILC) allows to iteratively compensate for and, hence, remove this repetitive error.In the thesis different aspects of iterative learning control are covered. Although stability is the most important in practice the design aspect is also highlighted. Several design schemes for iterative learning control methods are presented, including first order as well as second order iterative learning control. An adaptive approach to iterative learning control is also discussed. Many of the suggested design methods are also given with stability and robustness results.The application, industrial robot control, that has been used as a testbed throughout the thesis is described. The description includes a general discussion on robot modeling and control as well as a specific discussion on the implementation of the functions needed in the commercial robot control software in order to make it possible to apply iterative learning control.The suggested iterative learning control design methods are all tested on the robot. Some practical aspects on the path following problem for industrial robots using iterative learning control are discussed. A potential solution to the path tracking problem using additional sensors is given, although it is not yet implemented on the robot. In supervised motor learning, where the desired movement pattern is given in task-oriented coordinates, one of the most essential and difficult problems is how to convert the error signal calculated in the task space into that of the motor command space. We proposed the feedback-error-learning approach where the feedback motor command is used as an error signal to train a neural network which then generates a feedforward motor command. We successfully applied this approach to learning control in joint space of PUMA, an industrial manipulator, trajectory control in visual coordinates even when PUMA was given an extra degree of freedom, and Softarm with muscle-like actuators (manufactured by Bridgestone Co.). I mathematically show that the feedback-error-learning approach can be considered a Newton-like method in functional space. Mathematical proof of the convergence of the feedback-error-learning control scheme is provided both for trajectory stability and learning stability. The feedback-error-learning neural network was originally proposed as a model for the lateral cerebellum and the parvocellular part of the red nucleus. It will be shown that functions of other parts of the cerebellum, such as the vermis or the flocculus, can also be understood from the feedback-error-learning scheme. Nonlinear dynamical systems have been used in many disciplines to model complex behaviors, including biological motor control, robotics, perception, economics, traffic prediction, and neuroscience. While often the unexpected emergent behavior of nonlinear systems is the focus of investigations, it is of equal importance to create goal-directed behavior e.g., stable locomotion from a system of coupled oscillators under perceptual guidance. Modeling goal-directed behavior with nonlinear systems is, however, rather difficult due to the parameter sensitivity of these systems, their complex phase transitions in response to subtle parameter changes, and the difficulty of analyzing and predicting their long-term behavior; intuition and time-consuming parameter tuning play a major role. This letter presents and reviews dynamical movement primitives, a line of research for modeling attractor behaviors of autonomous nonlinear dynamical systems with the help of statistical learning techniques. The essence of our approach is to start with a simple dynamical system, such as a set of linear differential equations, and transform those into a weakly nonlinear system with prescribed attractor dynamics by means of a learnable autonomous forcing term. Both point attractors and limit cycle attractors of almost arbitrary complexity can be generated. We explain the design principle of our approach and evaluate its properties in several example applications in motor control and robotics. Movement primitives as basis of movement planning and control have become a popular topic in recent years. The key idea of movement primitives is that a rather small set of stereotypical movements should suffice to create a large set of complex manipulation skills. An interesting side effect of stereotypical movement is that it also creates stereotypical sensory events, e.g., in terms of kinesthetic variables, haptic variables, or, if processed appropriately, visual variables. Thus, a movement primitive executed towards a particular object in the environment will associate a large number of sensory variables that are typical for this manipulation skill. These association can be used to increase robustness towards perturbations, and they also allow failure detection and switching towards other behaviors. We call such movement primitives augmented with sensory associations Associative Skill Memories (ASM). This paper addresses how ASMs can be acquired by imitation learning and how they can create robust manipulation skill by determining subsequent ASMs online to achieve a particular manipulation goal. Evaluation for grasping and manipulation with a Barrett WAM Hand illustrate our approach. This article surveyed the major results in iterative learning control (ILC) analysis and design over the past two decades. Problems in stability, performance, learning transient behavior, and robustness were discussed along with four design techniques that have emerged as among the most popular. The content of this survey was selected to provide the reader with a broad perspective of the important ideas, potential, and limitations of ILC. Indeed, the maturing field of ILC includes many results and learning algorithms beyond the scope of this survey. Though beginning its third decade of active research, the field of ILC shows no sign of slowing down.