Although deep reinforcement learning (deep RL) methods have lots of strengths that are favorable if applied to autonomous driving, real deep RL applications in autonomous driving have been slowed down by the modeling gap between the source (training) domain and the target (deployment) domain. Unlike current policy transfer approaches, which generally limit to the usage of uninterpretable neural network representations as the transferred features, we propose to transfer concrete kinematic quantities in autonomous driving. The proposed robust-control-based (RC) generic transfer architecture, which we call RL-RC, incorporates a transferable hierarchical RL trajectory planner and a robust tracking controller based on disturbance observer (DOB). The deep RL policies trained with known nominal dynamics model are transfered directly to the target domain, DOB-based robust tracking control is applied to tackle the modeling gap including the vehicle dynamics errors and the external disturbances such as side forces. We provide simulations validating the capability of the proposed method to achieve zero-shot transfer across multiple driving scenarios such as lane keeping, lane changing and obstacle avoidance.
A method developed on a similar idea to the one in this paper is in @cite_1 , in which a MPC controller is designed to stabilize the target system around the nominal trajectory generated by consecutively applying the policy in the source system. Theorems on tube-based MPC ensure that the states are bounded under certain modeling error. However, the bound cannot be explicitly found and no asymptotic stability can be guaranteed. Moreover, solving on-line optimization problem is computationally expensive, while robust controllers are usually easier and faster for the trajectory tracking problem of automated vehicles.
@cite_1
1983526786 2887531520 2112930335 1968651586
This paper focuses on the design of a tube-based Model Predictive Control law for the control of constrained mobile robots in off-road conditions with longitudinal slip while ensuring robustness and stability. A time-varying trajectory tracking error model is used, where uncertainties are assumed to be bounded and additive. The robust tube-based MPC is compared with other motion control techniques through simulation and physical experiments. These tests show the satisfactory behavior of the presented control strategy. In this paper, we present a novel constraint tightening approach for nonlinear robust model predictive control (MPC). This approach uses a simple constructive constraint tightening based on growing tubes. Contrary to other approaches, we require no complex offline computations to obtain a stabilizing control law. Instead, we consider the notion of incremental stabilizability and design tubes based on an estimate of the achievable exponential decay rate. In addition, we show how this tightening can be used as an ad-hoc modification to improve the robustness of MPC without terminal constraints. We study the system theoretic properties of the resulting closed-loop system, including bounds on the region of attraction and the minimal robust positively invariant (RPI) set. Within an MPC framework without terminal constraints, the proposed constraint tightening leads to a nonlinear robust controller without complex design procedures, which makes it appealing for practical applications. In this paper, a model predictive control (MPC) approach for controlling an active front steering system in an autonomous vehicle is presented. At each time step, a trajectory is assumed to be known over a finite horizon, and an MPC controller computes the front steering angle in order to follow the trajectory on slippery roads at the highest possible entry speed. We present two approaches with different computational complexities. In the first approach, we formulate the MPC problem by using a nonlinear vehicle model. The second approach is based on successive online linearization of the vehicle model. Discussions on computational complexity and performance of the two schemes are presented. The effectiveness of the proposed MPC formulation is demonstrated by simulation and experimental tests up to 21 m s on icy roads In this paper a novel approach to autonomous steering systems is presented. A model predictive control (MPC) scheme is designed in order to stabilize a vehicle along a desired path while fulfilling its physical constraints. Simulation results show the benefits of the systematic control methodology used. In particular we show how very effective steering manoeuvres are obtained as a result of the MPC feedback policy. Moreover, we highlight the trade off between the vehicle speed and the required preview on the desired path in order to stabilize the vehicle. The paper concludes with highlights on future research and on the necessary steps for experimental validation of the approach.