We explore the probabilistic foundations of shared control in complex dynamic environments. In order to do this, we formulate shared control as a random process and describe the joint distribution that governs its behavior. For tractability, we model the relationships between the operator, autonomy, and crowd as an undirected graphical model. Further, we introduce an interaction function between the operator and the robot, that we call "agreeability"; in combination with the methods developed in trautman-ijrr-2015 , we extend a cooperative collision avoidance autonomy to shared control. We therefore quantify the notion of simultaneously optimizing over agreeability (between the operator and autonomy), and safety and efficiency in crowded environments. We show that for a particular form of interaction function between the autonomy and the operator, linear blending is recovered exactly. Additionally, to recover linear blending, unimodal restrictions must be placed on the models describing the operator and the autonomy. In turn, these restrictions raise questions about the flexibility and applicability of the linear blending framework. Additionally, we present an extension of linear blending called "operator biased linear trajectory blending" (which formalizes some recent approaches in linear blending such as dragan-ijrr-2013 ) and show that not only is this also a restrictive special case of our probabilistic approach, but more importantly, is statistically unsound, and thus, mathematically, unsuitable for implementation. Instead, we suggest a statistically principled approach that guarantees data is used in a consistent manner, and show how this alternative approach converges to the full probabilistic framework. We conclude by proving that, in general, linear blending is suboptimal with respect to the joint metric of agreeability, safety, and efficiency.
Powered wheelchair users often struggle to drive safely and effectively and, in more critical cases, can only get around when accompanied by an assistant. To address these issues, we propose a collaborative control mechanism that assists users as and when they require help. The system uses a multiple-hypothesis method to predict the driver's intentions and, if necessary, adjusts the control signals to achieve the desired goal safely. The main emphasis of this paper is on a comprehensive evaluation, where we not only look at the system performance but also, perhaps more importantly, characterize the user performance in an experiment that combines eye tracking with a secondary task. Without assistance, participants experienced multiple collisions while driving around the predefined route. Conversely, when they were assisted by the collaborative controller, not only did they drive more safely but also they were able to pay less attention to their driving, resulting in a reduced cognitive workload. We discuss the importance of these results and their implications for other applications of shared control, such as brain-machine interfaces, where it could be used to compensate for both the low frequency and the low resolution of the user input.  The control system for a personal aid for mobility and health monitoring (PAMM) for the elderly is presented. PAMM is intended to assist the elderly living independently or in senior assisted living facilities. It provides physical support and guidance, as well as monitoring basic vital signs for users that may have both limited physical and cognitive capabilities. This paper presents the design of a bi-level control system for PAMM. The first level is an admittance-based mobility controller that provides a natural and intuitive human machine interface. The second level is an adaptive shared controller that allocates control between the user and the computer based on metrics of the user's performance. Field trials at an eldercare facility show the effectiveness of the design.  In todays aging society, many people require mobility assistance, that can be provided by robotized assistive wheelchairs with a certain degree of autonomy when manual control is unfeasible due to disability. Robot wheelchairs, though, are not supposed to be completely in control because lack of human intervention may lead to loss of residual capabilities and frustration. Most of these systems rely on shared control, which typically consists of swapping control from human to robot when needed. However, this means that persons never deal with situations they find difficult. We propose a new shared control approach to allow constant cooperation between humans and robots, so that assistance may be adapted to the user's skills. Our proposal is based on the reactive navigation paradigm, where robot and human commands become different goals in a Potential Field. Our main novelty is that human and robot attractors are weighted by their respective local efficiencies at each time instant. This produces an emergent behavior that combines both inputs in an efficient, safe and smooth way and is dynamically adapted to the user's needs. The proposed control scheme has been successfully tested at hospital Fondazione Santa Lucia (FSL) in Rome with several volunteers presenting different disabilities.  Abstract Internet telerobotics has emerged in recent decade with direct control and supervisory control as the main teleoperation paradigms. Both paradigms, however, are difficult to use on applications operating in the unknown and dynamic real world, while they do not provide adequate feeling of interaction or a human-friendly control interface to human operator. This paper proposes a novel interactive control (i.e., active supervisory control) paradigm: telecommanding, which is used for Internet-based wheeled robot teleoperation. Telecommanding involves two parts: basic telecommanding using joystick commands, and advanced telecommanding using linguistic commands. Each joystick or linguistic command is designed to perform an independent task and is defined with multiple events (non-time action references), and the corresponding response functions. This event-driven mechanism enables the robot to deliberately respond to expected events while to reactively respond to unexpected events. Assisted by up-to-date media streaming technologies, telecommanding can help a novice operator to easily control an Internet robot navigating in an unknown and dynamic real world. Experiments, including an Internet-based teleoperation test over 1500 km from Beijing to Hong Kong, demonstrate the promising performance.  This paper presents a new adaptive servo-level shared control scheme for a mobile assistive robot that aims at assisting senior and disabled people to transport heavy objects in a complex environment with obstacles. Several technical problems and challenges related to the assistive robotic system and the shared controller are addressed. Specifically, a nonlinear tracking controller is developed for the robot to follow the user. An obstacle avoidance controller is developed based on the deformable virtual zone principle for the robot to avoid obstacles. The adaptive servo-level shared controller utilizes the tracking controller and the obstacle avoidance controller’s outputs to generate a new shared control output to command the robot. Experiments show that the user can guide the movement of the robot safely and smoothly in the complex environment with the developed controllers.  In shared control teleoperation, the robot assists the user in accomplishing the desired task, making teleoperation easier and more seamless. Rather than simply executing the user's input, which is hindered by the inadequacies of the interface, the robot attempts to predict the user's intent, and assists in accomplishing it. In this work, we are interested in the scientific underpinnings of assistance: we propose an intuitive formalism that captures assistance as policy blending, illustrate how some of the existing techniques for shared control instantiate it, and provide a principled analysis of its main components: prediction of user intent and its arbitration with the user input. We define the prediction problem, with foundations in inverse reinforcement learning, discuss simplifying assumptions that make it tractable, and test these on data from users teleoperating a robotic manipulator. We define the arbitration problem from a control-theoretic perspective, and turn our attention to what users consider good arbitration. We conduct a user study that analyzes the effect of different factors on the performance of assistance, indicating that arbitration should be contextual: it should depend on the robot's confidence in itself and in the user, and even the particulars of the user. Based on the study, we discuss challenges and opportunities that a robot sharing the control with the user might face: adaptation to the context and the user, legibility of behavior, and the closed loop between prediction and user behavior. 