Human teams can be exceptionally efficient at adapting and collaborating during manipulation tasks using shared mental models. However, the same shared mental models that can be used by humans to perform robust low-level force and motion control during collaborative manipulation tasks are non-existent for robots. For robots to perform collaborative tasks with people naturally and efficiently, understanding and predicting human intent is necessary. However, humans are difficult to predict and model. We have completed an exploratory study recording motion and force for 20 human dyads moving an object in tandem in order to better understand how they move and how their movement can be predicted. In this paper, we show how past motion data can be used to predict human intent. In order to predict human intent, which we equate with the human team's velocity for a short time horizon, we used a neural network. Using the previous 150 time steps at a rate of 200 Hz, human intent can be predicted for the next 50 time steps with a mean squared error of 0.02 (m s)^2. We also show that human intent can be estimated in a human-robot dyad. This work is an important first step in enabling future work of integrating human intent estimation on a robot controller to execute a short-term collaborative trajectory.
The minimum jerk model is one example of an invariant model, where by finding a model for a task, the dynamics can be simplified. Many models for a controller for cooperative manipulation only have a few changing parameters that include initial and final time and position. They may also include a maximum velocity or other parameter. With just a few parameters, the entire trajectory can be described. One approach to determining these models has been programming by demonstration @cite_8 .
@cite_8
2157719307
Model based control schemes use the inverse dynamics of the robot arm to produce the main torque component necessary for trajectory tracking. For model-based controller one is required to know the model parameters accurately. This is a very difficult task especially if the manipulator is flexible. So a reduced model based controller has been developed, which requires only the information of space robot base velocity and link parameters. The flexible link is modeled as Euler Bernoulli beam. To simplify the analysis we have considered Jacobian of rigid manipulator. Bond graph modeling is used to model the dynamics of the system and to devise the control strategy. The scheme has been verified using simulation for two links flexible space manipulator. We discuss the problem of minimum cost trajectory planning for robotic manipulators. It consists of linking two points in the operational space while minimizing a cost function, taking into account dynamic equations of motion as well as bounds on joint positions, velocities, jerks and torques. This generic optimal control problem is transformed, via a clamped cubic spline model of joint temporal evolutions, into a non-linear constrained optimization problem which is treated then by the Sequential Quadratic Programming (SQP) method. Applications involving grasping mobile object or obstacle avoidance are shown to illustrate the efficiency of the proposed planner. Human-robot collaboration seeks to have humans and robots closely interacting in everyday situations. For some tasks, physical contact between the user and the robot may occur, originating significant challenges at safety, cognition, perception and control levels, among others. This paper focuses on robot motion adaptation to parameters of a collaborative task, extraction of the desired robot behavior, and variable impedance control for human-safe interaction. We propose to teach a robot cooperative behaviors from demonstrations, which are probabilistically encoded by a task-parametrized formulation of a Gaussian mixture model. Such encoding is later used for specifying both the desired state of the robot, and an optimal feedback control law that exploits the variability in position, velocity and force spaces observed during the demonstrations. The whole framework allows the robot to modify its movements as a function of parameters of the task, while showing different impedance behaviors. Tests were successfully carried out in a scenario where a 7 DOF backdrivable manipulator learns to cooperate with a human to transport an object. The determination of the minimum set of inertial parameters of robots contributes to the reduction of the computational cost of the dynamic models and simplifies the identification of the inertial parameters. These parameters can be obtained from the classical inertial parameters by eliminating those that have no effect on the dynamic model and by regrouping some others. A direct method is presented for determining the minimum set of inertial parameters of serial robots. The method permits determination of most of the regrouped parameters by means of closed-form relations. > This paper discusses experimental robot identification based on a statistical framework. It presents a new approach toward the design of optimal robot excitation trajectories, and formulates the maximum-likelihood estimation of dynamic robot model parameters. The differences between the new design approach and the existing approaches lie in the parameterization of the excitation trajectory and in the optimization criterion. The excitation trajectory for each joint is a finite Fourier series. This approach guarantees periodic excitation which is advantageous because it allows: 1) time-domain data averaging; 2) estimation of the characteristics of the measurement noise, which is valuable in the case of maximum-likelihood parameter estimation. In addition, the use of finite Fourier series allows calculation of the joint velocities and acceleration in an analytic way from the measured position response, and allows specification of the bandwidth of the excitation trajectories. The optimization criterion is the uncertainty on the estimated parameters or a lower bound for it, instead of the often used condition of the parameter estimation problem. Simulations show that this criterion yields parameter estimates with smaller uncertainty bounds than trajectories optimized according to the classical criterion. Experiments on an industrial robot show that the presented trajectory design and maximum-likelihood parameter estimation approaches complement each other to make a practicable robot identification technique which yields accurate robot models. Control of robot locomotion profits from the use of pre-planned trajectories. This paper presents a way to generalize globally optimal and dynamically consistent trajectories for cyclic bipedal walking. A small task-space consisting of stride-length and step time is mapped to spline parameters which fully define the optimal joint space motion. The paper presents the impact of different machine learning algorithms for velocity and torque optimal trajectories with respect to optimality and feasibility. To demonstrate the usefulness of the trajectories, a control approach is presented that allows general walking including transitions between points in the task-space. We present a global controller for tracking nominal trajectories with a flying wing tailsitter vehicle. The control strategy is based on a first-principles model of the vehicle dynamics that captures all relevant aerodynamic effects, and we apply an onboard parameter learning scheme in order to estimate unknown aerodynamic parameters. A cascaded control architecture is used: Based on position and velocity errors an outer control loop computes a desired attitude keeping the vehicle in coordinated flight, while an inner control loop tracks the desired attitude using a lookup table with precomputed optimal attitude trajectories. The proposed algorithms can be implemented on a typical microcontroller and the performance is demonstrated in various experiments. Dynamic Parameter Identification is a useful tool for developing and evaluating robot control strategies. However, a multi degree of freedom robot arm has many parameters, and the process of determining them is challenging. Much research has been done in this area and experimental methods have been applied on several robot arms. To our knowledge, there is currently no set of inertial parameters, either by modelling or by estimation, available for the CRS A460 A465 arm, a popular laboratory table top robot. In this paper we review and compare a number of methods for dynamic parameter identification and for generating trajectories suitable for estimating the identifiable dynamic parameters of a given robot. We then present a step by step process for dynamic parameter identification of a serial manipulator, and demonstrate this process by experimentally identifying the dynamic parameters of the CRS A460 robot. Optimization is often difficult to apply to robots due to the presence of errors in model parameters, which can cause constraints to be violated during execution on the robot. This paper presents a method to optimize trajectories with large modeling errors using a combination of robust optimization and parameter learning. In particular it considers the context of contact modeling, which is highly susceptible to errors due to uncertain friction estimates, contact point estimates, and sensitivity to noise in actuator effort. A robust time-scaling method is presented that computes a dynamically-feasible, minimum-cost trajectory along a fixed path under frictional contact. The robust optimization model accepts confidence intervals on uncertain parameters, and uses a convex parameterization that computes dynamically-feasible motions in seconds. Optimization is combined with an iterative learning method that uses feedback from execution to learn confidence bounds on modeling parameters. It is applicable to general problems with multiple uncertain parameters that satisfy a monotonicity condition that requires parameters to have conservative and optimistic settings. The method is applied to manipulator performing a “waiter” task, on which an object is moved on a carried tray as quickly as possible, and to a simulated humanoid locomotion task. Experiments demonstrate this method can compensate for large modeling errors within a handful of iterations. This paper presents a minimum-time trajectory planning method and a tracking control scheme for robot manipulators. In the first step, we find the minimum-time trajectories by optimizing cubic polynomial joint trajectories using the evolution strategy. In the second step, by the use of the evolution strategy we tune the sliding mode controller parameters for the robot manipulator to track precisely the trajectories that were found in the previous step. Experimental results show that the proposed method is very useful. Autonomous learning of object manipulation skills can enable robots to acquire rich behavioral repertoires that scale to the variety of objects found in the real world. However, current motion skill learning methods typically restrict the behavior to a compact, low-dimensional representation, limiting its expressiveness and generality. In this paper, we extend a recently developed policy search method [1] and use it to learn a range of dynamic manipulation behaviors with highly general policy representations, without using known models or example demonstrations. Our approach learns a set of trajectories for the desired motion skill by using iteratively refitted time-varying linear models, and then unifies these trajectories into a single control policy that can generalize to new situations. To enable this method to run on a real robot, we introduce several improvements that reduce the sample count and automate parameter selection. We show that our method can acquire fast, fluent behaviors after only minutes of interaction time, and can learn robust controllers for complex tasks, including putting together a toy airplane, stacking tight-fitting lego blocks, placing wooden rings onto tight-fitting pegs, inserting a shoe tree into a shoe, and screwing bottle caps onto bottles. Hyper-redundant manipulators have large number of kinematic degrees of freedom, thus possessing some unconventional features such as the ability to enter a narrow space while avoiding obstacles. To control these hyper-redundant manipulators accurately, the manipulator dynamics must be included into consideration. This is however time-expensive and makes implementation of the real-time control difficult. In this paper, we propose a dynamic control scheme for hyper-redundant manipulators, which is based on analysis in the defined posture space where three parameters were used to determine the manipulator posture. The manipulator dynamics is modeled in the parameterized form with the parameter of the posture space path and the posture space path-tracking feedforward controller is formulated on the basis of the parameterized dynamic equation. Computer simulation was executed to show the validity of the proposed technique, where a hyper-redundant manipulator traces the posture space path well by the proposed feedforward controller. As a result, it is proven that the hyper-redundant manipulator can track the workspace path accurately. A formulation for online trajectory generation for two robots cooperating to perform an assembly task is derived. The two robots are treated as a single redundant system. A Jacobian is formulated that relates the joint rates of the entire system to the relative motion of one of the hands with respect to the other. The minimum norm solution of this relative Jacobian equation results in a set of joint rates which perform the cooperative task. In addition to the cooperative task, secondary goals, which include obstacle and joint limit avoidance, are specified using velocities in the null space of the relative Jacobian. This formulation also allows the robots to be controlled in parallel on independent tasks Autonomous learning of object manipulation skills can enable robots to acquire rich behavioral repertoires that scale to the variety of objects found in the real world. However, current motion skill learning methods typically restrict the behavior to a compact, low-dimensional representation, limiting its expressiveness and generality. In this paper, we extend a recently developed policy search method la-lnnpg-14 and use it to learn a range of dynamic manipulation behaviors with highly general policy representations, without using known models or example demonstrations. Our approach learns a set of trajectories for the desired motion skill by using iteratively refitted time-varying linear models, and then unifies these trajectories into a single control policy that can generalize to new situations. To enable this method to run on a real robot, we introduce several improvements that reduce the sample count and automate parameter selection. We show that our method can acquire fast, fluent behaviors after only minutes of interaction time, and can learn robust controllers for complex tasks, including putting together a toy airplane, stacking tight-fitting lego blocks, placing wooden rings onto tight-fitting pegs, inserting a shoe tree into a shoe, and screwing bottle caps onto bottles. The approach of inferring user's intended task and optimizing low-level robot motions has promise for making robot teleoperation interfaces more intuitive and responsive. But most existing methods assume a finite set of candidate tasks, which limits a robot's functionality. This paper proposes the notion of freeform tasks that encode an infinite number of possible goals (e.g., desired target positions) within a finite set of types (e.g., reach, orient, pick up). It also presents two technical contributions to help make freeform UIs possible. First, an intent predictor estimates the user's desired task, and accepts freeform tasks that include both discrete types and continuous parameters. Second, a cooperative motion planner continuously updates the robot's trajectories to achieve the inferred tasks by repeatedly solving optimal control problems. The planner is designed to respond interactively to changes in the indicated task, avoid collisions in cluttered environments, handle time-varying objective functions, and achieve high-quality motions using a hybrid of numerical and sampling-based techniques. The system is applied to the problem of controlling a 6D robot manipulator using 2D mouse input in the context of two tasks: static target reaching and dynamic trajectory tracking. Simulations suggest that it enables the robot to reach intended targets faster and to track intended trajectories more closely than comparable techniques. We present a new method of learning control policies that successfully operate under unknown dynamic models. We create such policies by leveraging a large number of training examples that are generated using a physical simulator. Our system is made of two components: a Universal Policy (UP) and a function for Online System Identification (OSI). We describe our control policy as universal because it is trained over a wide array of dynamic models. These variations in the dynamic model may include differences in mass and inertia of the robots' components, variable friction coefficients, or unknown mass of an object to be manipulated. By training the Universal Policy with this variation, the control policy is prepared for a wider array of possible conditions when executed in an unknown environment. The second part of our system uses the recent state and action history of the system to predict the dynamics model parameters mu. The value of mu from the Online System Identification is then provided as input to the control policy (along with the system state). Together, UP-OSI is a robust control policy that can be used across a wide range of dynamic models, and that is also responsive to sudden changes in the environment. We have evaluated the performance of this system on a variety of tasks, including the problem of cart-pole swing-up, the double inverted pendulum, locomotion of a hopper, and block-throwing of a manipulator. UP-OSI is effective at these tasks across a wide range of dynamic models. Moreover, when tested with dynamic models outside of the training range, UP-OSI outperforms the Universal Policy alone, even when UP is given the actual value of the model dynamics. In addition to the benefits of creating more robust controllers, UP-OSI also holds out promise of narrowing the Reality Gap between simulated and real physical systems. Many tasks in human environments require performing a sequence of complex navigation and manipulation tasks. In unstructured human environments, the locations and conguration of the objects can change in unpredictable ways. This requires a high-level planning strategy that is robust and exible in an uncertain environment. We propose a novel dynamic planning strategy, which can be trained from a set of example activities. High level activities are expressed as a sequence of primitive actions or controllers (with appropriate parameters). Our planning model synthesizes a universal strategy, where the a suitable next action is selected based on the current state of the environment. By expressing the environment using sets of attributes, the approach generalizes well to unseen scenarios. By unfolding our planning strategy into a Markov Random Field approximation, we can eectively train parameters using a maximum margin learning strategy. We provide a detailed empirical validation of our overall framework demonstrating successful plan strategies for a variety of tasks. Abstract In this paper, the dynamic parameters, both inertial and frictional, of a 3-DOF RPS parallel manipulator are identified considering two important issues: the physical feasibility of the identified inertial parameters and the use of nonlinear friction models in the identification process in order to model the friction phenomenon at robot joints. The dynamic model of the parallel manipulator is obtained starting from the Gibbs–Appell equations of motion along with the Gauss principle of Least Action, and these equations of motion are rewritten in a their linear form with respect to the inertial parameters of the mechanical system. At this point, in accordance with the friction model considered, either linear or nonlinear, two types of dynamic models are dealt with: the totally and the partially linear with respect to the parameters to be identified. In order to solve the identification problem when nonlinear friction models are included, a nonlinear constrained optimization problem will be formulated and solved, instead of the Least Square Method, which is valid only for linear identification problems. It must be mentioned that the above-mentioned optimization problem will include the physical feasibility of the identified parameters in its formulation. The proposed procedure will be verified against a virtual parallel manipulator and finally, experimental identification processes are carried out over an actual parallel manipulator and a comparison is made between the LSM and the optimization process in the case of linear friction models, and between the linear and nonlinear friction models in the optimization process. The minimum-lap-time optimal control problem for a Formula One race car is solved using direct transcription and nonlinear programming. Features of this work include significantly reduced full-lap solution times and the simultaneous optimisation of the driven line, the driver controls and multiple car set-up parameters. It is shown that significant reductions in the driven lap time can be obtained from track-specific set-up parameter optimisation. Reduced computing times are achieved using a combination of a track description based on curvilinear coordinates, analytical derivatives and model non-dimensionalisation. The curvature of the track centre line is found by solving an auxiliary optimal control problem that negates the difficulties associated with integration drift and trajectory closure. The minimum-time manipulator control problem is solved for the case when the path is specified and the actuator torque limitations are known. The optimal open-loop torques are found, and a method is given for implementing these torques with a conventional linear feedback control system. The algorithm allows bounds on the torques that may be arbitrary functions of the joint angles and angular velocities. This method is valid for any path and orientation of the end- effector that is specified. The algorithm can be used for any manipulator that has rigid links, known dynamic equations of motion, and joint angles that can be determined at a given position on the path.