In this paper, we propose a contact-implicit trajectory optimization (CITO) method based on a variable smooth contact model (VSCM) and successive convexification (SCvx). The VSCM facilitates the convergence of gradient-based optimization without compromising physical fidelity. On the other hand, the proposed SCvx-based approach combines the advantages of direct and shooting methods for CITO. For evaluations, we consider non-prehensile manipulation tasks. The proposed method is compared to a version based on iterative linear quadratic regulator (iLQR) on a planar example. The results demonstrate that both methods can find physically-consistent motions that complete the tasks without a meaningful initial guess owing to the VSCM. The proposed SCvx-based method outperforms the iLQR-based method in terms of convergence, computation time, and the quality of motions found. Finally, the proposed SCvx-based method is tested on a standard robot platform and shown to perform efficiently for a real-world application.
In order to combine the advantages of the shooting and direct methods, @cite_29 proposed a multiple shooting version of the iLQR for trajectory optimization. They also consider a CITO problem to generate trotting on a quadruped with a trivial initial guess (i.e., the robot stands still). The results indicate that the single-shooting and the proposed multiple-shooting iLQR methods converge linearly yet the hybrid method converges in fewer iterations. However, this method is limited to unconstrained problems.
@cite_29
2771208017 1495441213 2031397756 2072752020
This paper introduces a family of iterative algorithms for unconstrained nonlinear optimal control. We generalize the well-known iLQR algorithm to different multiple-shooting variants, combining advantages like straight-forward initialization and a closed-loop forward integration. All algorithms have similar computational complexity, i.e. linear complexity in the time horizon, and can be derived in the same computational framework. We compare the full-step variants of our algorithms and present several simulation examples, including a high-dimensional underactuated robot subject to contact switches. Simulation results show that our multiple-shooting algorithms can achieve faster convergence, better local contraction rates and much shorter runtimes than classical iLQR, which makes them a superior choice for nonlinear model predictive control applications. Minimum time and minimum energy point-to-point trajectories for an industrial robot of the type Manutec r3 are computed subject to state constraints on the angular velocities. The numerical solutions of these optimal control problems are obtained in an efficient way by a combination of a direct collocation and an indirect multiple shooting method. This combination links the benefits of both approaches: A large domain of convergence and a highly accurate solution. The numerical results show that the constraints on the angular velocities become active during large parts of the time optimal motion. But the resulting stress on the links can be significantly reduced by a minimum energy trajectory that is only about ten percent slower than the minimum time trajectory. As a by-product, the reliability of the direct collocation method in estimating adjoint variables and the efficiency of the combination of direct collocation and multiple shooting is demonstrated. The highly accurate solutions reported in this paper may also serve as benchmark problems for other methods. This paper examines techniques for finding falsifying trajectories of hybrid systems using an approach that we call trajectory splicing. Many formal verification techniques for hybrid systems, including flowpipe construction, can identify plausible abstract counterexamples for property violations. However, there is often a gap between the reported abstract counterexamples and the concrete system trajectories. Our approach starts with a candidate sequence of disconnected trajectory segments, each segment lying inside a discrete mode. However, such disconnected segments do not form concrete violations due to the gaps that exist between the ending state of one segment and the starting state of the subsequent segment. Therefore, trajectory splicing uses local optimization to minimize the gap between these segments, effectively splicing them together to form a concrete trajectory. We demonstrate the use of our approach for falsifying safety properties of hybrid systems using standard optimization techniques. As such, our approach is not restricted to linear systems. We compare our approach with other falsification approaches including uniform random sampling and a robustness guided falsification approach used in the tool S-Taliro. Our preliminary evaluation clearly shows the potential of our approach to search for candidate trajectory segments and use them to find concrete property violations. Learning motion control as a unified process of designing the reference trajectory and the controller is one of the most challenging problems in robotics. The complexity of the problem prevents most of the existing optimization algorithms from giving satisfactory results. While model-based algorithms like iterative linear-quadratic-Gaussian (iLQG) can be used to design a suitable controller for the motion control, their performance is strongly limited by the model accuracy. An inaccurate model may lead to degraded performance of the controller on the physical system. Although using machine learning approaches to learn the motion control on real systems have been proven to be effective, their performance depends on good initialization. To address these issues, this paper introduces a two-step algorithm which combines the proven performance of a model-based controller with a model-free method for compensating for model inaccuracy. The first step optimizes the problem using iLQG. Then, in the second step this controller is used to initialize the policy for our PI2-01 reinforcement learning algorithm. This algorithm is a derivation of the PI2 algorithm enabling more stable and faster convergence. The performance of this method is demonstrated both in simulation and experimental results.