Teleoperation of heavy machinery in industry often requires operators to be in close proximity to the plant and issue commands on a per-actuator level using joystick input devices. However, this is non-intuitive and makes achieving desired job properties a challenging task requiring operators to complete extensive and costly training. Despite this, operator fatigue is common with implications for personal safety, project timeliness, cost, and quality. While full automation is not yet achievable due to unpredictability and the dynamic nature of the environment and task, shared control paradigms allow operators to issue high-level commands in an intuitive, task-informed control space while having the robot optimize for achieving desired job properties. In this paper, we compare a number of modes of teleoperation, exploring both the number of dimensions of the control input as well as the most intuitive control spaces. Our experimental evaluations of the performance metrics were based on quantifying the difficulty of tasks based on the well known Fitts' law as well as a measure of how well constraints affecting the task performance were met. Our experiments show that higher performance is achieved when humans submit commands in low-dimensional task spaces as opposed to joint space manipulations.
From the concrete spraying literature, a task space control framework was developed by Honegger and Codourey @cite_18 based on the inverse-kinematics method. The system allows the operator to control the end-effector of the concrete spraying unit using a 6-DoF space mouse. Later work by Girmscheid and Moser @cite_12 developed a sliding autonomy approach for a high-DoF concrete spraying unit. They define three levels of autonomy: (1) A manual mode, consisting of no autonomy and implementing common joint-level control, (2) A semi-automated mode that, using a pre-collected laser scan of a tunnel cavity and computed geometry, allows the operator to command only the position on the wall to spray whilst the system accounts for motion constraints, and (3) An automated mode that plans and executes an entire trajectory. The latter mode, they note, is only in development for tunnel-boring machine projects where the excavated tunnel surface is regular and very smooth. Modes of teleoperation compared in this work are inspired by these control techniques developed for concrete spraying applications.
@cite_18 @cite_12
2023197039 2103435288 2313752765 2170942374 2070708339 2103120971 2104906962 2086550339 1985690111 2610901891 2072150826 2736374714 2170674250 2161271108 2031397756 569732077 2145451962 2773226774 1894373409 1479682106
Optimized shotcrete application techniques are required in particular tunneling projects. Today, any spraying can be done by hand or by manipulator. With the development in the material technologies, the range of possible operation was enlarged. With automation of the application, an important contribution to improve performance and quality and to reduce rebound may be achieved. At the Swiss Federal Institute of Technology, Zurich, systematic research is done to develop the fully automated process control, focusing on the wet shotcrete method. With the development of the fully automated shotcrete robot, the user will have a very effective tool at his or her disposal to spray concrete shells (fully automated). With the new robot, the user may choose from three different modes: manual, semiautomated, and fully automated spraying. Especially the fully automated mode facilitates higher performance with less danger to the worker's health. Quality control is inherent in the application process in regard to layer thickness, compaction, and homogeneity. In tunneling and mining construction work, heavy and large manipulators are used to spray liquid concrete on the walls. These manipulators are usually operated manually with simple units allowing control of all actuators independently. In cooperation between industry and university, a novel control system has been developed for the redundant heavy manipulator Robojet(R) that supports the operator by calculating the inverse kinematic model and controlling all actuators automatically. The paper presents the solution of the redundant inverse kinematics of the Robojet using the null-space method and its implementation in a control system. We present an approach to control a 6-degree-of-freedom (DOF) manipulator using an uncalibrated visual servoing (VS) approach that addresses the challenges of choosing proper image features for target objects and designing a VS controller to enhance the tracking performance. The main contribution of this paper is the definition of a new virtual visual space (image space). A novel stereo camera model employing virtual orthogonal cameras is used to map 6-D poses from Cartesian space to this virtual visual space . Each component of the 6-D pose vector defined in this virtual visual space is linearly independent, leading to a full-rank @math image Jacobian matrix , which allows avoiding classical problems, such as image space singularities and local minima. Furthermore, the control for rotational and translational motion of robot is decoupled due to the diagonal image Jacobian. Finally, simulation results with an eye-to-hand robotic system confirm the improvement in controller stability and motion performance with respect to conventional VS approaches. Experimental results on a 6-DOF industrial robot are provided to illustrate the effectiveness of the proposed method and the feasibility of using this method in practical scenarios. This article describes the use of predictive control for the decentralized cooperative control of unmanned aerial vehicles in an unfamiliar three-dimensional environment. It is assumed that each vehicle is equipped with an autopilot and a trajectory control unit. The autopilot insures the stability of the vehicle. The setpoints of the autopilot are calculated by the trajectory control unit, thus forming a cascade control structure. The trajectory control unit relies on a predictive control algorithm to calculate the optimal commands (autopilot setpoints) such that the vehicle will reach fixed targets at known positions while avoiding static obstacles that are detected en route. The advantage in using predictive control is that it offers great flexibility in the objective function to optimize while respecting constraints such as command limits, limits on the displacement that a vehicle can carry out, and the constraints that allow obstacle avoidance. The principle proposed in order to avoid static obstacles (that are assumed ellipsoid) is to verify that the predicted vehicle trajectory does not intersect these obstacles. With the objective to increase performance, cooperation between vehicles must also be privileged. Thus, if some vehicles are within the communication range, they can share the position and shape of the obstacles they have detected. Simulations illustrate the method and higlight the benefits of cooperation. In order to support driver assistance systems in unconstrained environments, we propose to extend local appearance-based road classification with a spatial feature generation and classification. Therefore, a hierarchical approach consisting of multiple low level base classifiers, the novel spatial feature generation, as well as a final road terrain classification, is used. The system perceives a variety of local properties of the environment by means of base classifiers operating on patches extracted from monocular camera images, each represented in a metric confidence map. The core of the proposed approach is the computation of spatial ray features (SPRAY) from these confidence maps. With this, the road-terrain classifier can decide based on local visual properties and their spatial layout in the scene. In order to show the feasibility of the approach, the extraction and evaluation of the metric ego-lane driving corridor on an inner city stream is demonstrated. This is a challenging task because on a local appearance level, ego-lane is not distinguishable from other asphalt parts on the road. However, by incorporating the proposed SPRAY features the distinction is possible without requiring an explicit lane model. Due to the parallel structure of this bottom-up approach, the implemented system operates in real-time with approximately 25 Hz on a GPU. This paper presents a unique real-time obstacle avoidance approach for manipulators and mobile robots based on the artificial potential field concept. Collision avoidance, tradi tionally considered a high level planning problem, can be effectively distributed between different levels of control, al lowing real-time robot operations in a complex environment. This method has been extended to moving obstacles by using a time-varying artificial patential field. We have applied this obstacle avoidance scheme to robot arm mechanisms and have used a new approach to the general problem of real-time manipulator control. We reformulated the manipulator con trol problem as direct control of manipulator motion in oper ational space—the space in which the task is originally described—rather than as control of the task's corresponding joint space motion obtained only after geometric and kine matic transformation. Outside the obstacles' regions of influ ence, we caused the end effector to move in a straight line with an... This paper presents an alternative to the Potential Field Method of computing local collision-free motions for general manipulators. The main distinction is that we separate the description of the task from constraints of anti-collision. This enables to control accurately all relevant measures of the problem. A task is expressed by the minimization of a function plus eventually some geometric constraints, whereas anti-collision is translated into very simple linear constraints through the methods of the velocity dampers and the tangent separating planes. This approach is applied to the control of manipulators with a high number of degrees of freedom, using hierarchical descriptions of the environment and the robots. This is illustrated by two realizations, path planning for a ten link manipulator in the cluttered environment of a nuclear plant reactor, and cooperative tasks between two six degree of freedom robots. In the end we discuss how to incorporate the action of a global planner in this general framework. In this paper, we investigate the problem of scheduling a 6 DOF robotic arm to carry out a sequence of spray painting tasks. The duration of any given painting task is process dependent and fixed, but the duration of an ''intertask'', corresponding to the process of relocating and reorienting the robot arm from one painting task to the next one, is influenced by the order of tasks and must be minimized by the scheduler. There are multiple solutions for reaching any given painting task and tasks can be performed in either of two different directions. Further complicating the problem are characteristics of the painting process application itself. Unlike spot-welding, painting tasks require movement of the entire robot arm. In addition to minimizing intertask duration, the scheduler must strive to maximize painting quality and the problem is formulated as a multi-objective optimization problem. The scheduling model is implemented as a stand-alone module using constraint programming, and integrated with a larger automatic system. The results of a number of simulation experiments with simple parts are reported, both to characterize the functionality of the scheduler and to illustrate the operation of the entire software system for automatic generation of robot programs for painting. This article presents a new kind of navigation system for agricultural machines. The focus is on trajectory control where a Nonlinear Model Predictive path tracking for tractor and trailer system is presented. The experiments of the proposed method are carried out by using real agricultural machines in real environments. The agricultural objective is to drive so that swaths are exactly side-by-side, without overlapping or gaps. Hence, the objective of this research was to control the lateral position of the towed implement and to keep it close to the adjacent driving line. The adjacent driving line was recognized locally by using a 2D laser scanner. The local measurement and global position information was merged with the help of an Extended Kalman Filter (EKF). The measurement of the heading by GPS was improved by using an inertial measurement unit and a separate EKF filter. The position of the implement was controlled by steering the tractor and by the use of a hydraulically controlled joint. Because there were two actuators which affected the position of the implement, the problem was a multivariable control problem. Nonlinear Model Predictive Control (NMPC) was used to accomplish the navigation task. The goal was to build a system, which is able to have at least the same accuracy as a human driver. The sufficient accuracy requirement was at most 10cm lateral error at a speed of 12km h. The results presented in the article show that the goal was met and NMPC is a feasible method for accurate path tracking. Further investigation is, however, needed to adapt the method to other kinds of agricultural machines. This paper presents three feedback controllers that achieve an asymptotically stable, periodic, and fast walking gait for a 3-D bipedal robot consisting of a torso, revolute knees, and passive (unactuated) point feet. The walking surface is assumed to be rigid and flat; the contact between the robot and the walking surface is assumed to inhibit yaw rotation. The studied robot has 8 DOF in the single support phase and six actuators. In addition to the reduced number of actuators, the interest of studying robots with point feet is that the feedback control solution must explicitly account for the robot's natural dynamics in order to achieve balance while walking. We use an extension of the method of virtual constraints and hybrid zero dynamics (HZD), a very successful method for planar bipeds, in order to simultaneously compute a periodic orbit and an autonomous feedback controller that realizes the orbit, for a 3-D (spatial) bipedal walking robot. This method allows the computations for the controller design and the periodic orbit to be carried out on a 2-DOF subsystem of the 8-DOF robot model. The stability of the walking gait under closed-loop control is evaluated with the linearization of the restricted Poincare map of the HZD. Most periodic walking gaits for this robot are unstable when the controlled outputs are selected to be the actuated coordinates. Three strategies are explored to produce stable walking. The first strategy consists of imposing a stability condition during the search of a periodic gait by optimization. The second strategy uses an event-based controller to modify the eigenvalues of the (linearized) Poincare map. In the third approach, the effect of output selection on the zero dynamics is discussed and a pertinent choice of outputs is proposed, leading to stabilization without the use of a supplemental event-based controller. The main contribution of this paper is in the development of vision-based estimation and control system for robotic fruit harvesting and rigorous stability analysis to guarantee performance of the closed-loop system. The presented cooperative visual servo controller benefits from the large field-of-view of a fixed camera and the accuracy of a camera-in-hand (CiH). Computationally inexpensive perspective transformation-based range estimation method obtains 3D fruit position using a monocular camera to enable real-time manipulator control. A rotation controller is developed to orient the robot such that the target fruit selected by the fixed camera can be viewed by the CiH attached to the end-effector. Subsequently, the end-effector can be servoed to the target fruit location using the presented pursuit guidance based hybrid translation controller. Lyapunov-based stability analysis guarantees global exponential regulation of the end-effector. Numerical simulations verify the feasibility of the developed controller while the performance is evaluated on a seven degrees-of-freedom kinematically redundant manipulator using an artificial citrus tree. The position of the fruit was randomly selected, and the closed-loop visual servo control experiment was performed 21 times to analyze the repeatability and accuracy of the developed controller. With 95 confidence level the expected position of the robot end-effector is observed to lie within the confidence ellipsoid. The accuracy of the controller was observed to be about 15mm, thus making the system suitable for harvesting medium and large varieties of citrus fruit but may limit operation for small varieties such as page and blood oranges. In this paper we propose a method for motion planning and feedback control of hybrid, dynamic, and non-prehensile manipulation tasks. We outline five subproblems to address this: determining a set of manipulation primitives, choosing a sequence of tasks, picking transition states, motion planning for each individual primitive, and stabilizing each mode using feedback control. We apply the framework to plan a sequence of motions for manipulating a block with a planar 3R manipulator. We demonstrate preliminary experimental results for a block resting on the manipulator with a desired goal state on a ledge outside of the robot's workspace. The planned primitives reorient the block using a series of fixed, rolling, and sliding contact modes, and throw it to the goal state. Shared compliant control has been incorporated into an advanced six-degree-of-freedom force-reflecting telemanipulation system. With this system the authors have investigated the effect of time delay on human telemanipulation task performance. Time delays of between 2 and 4096 ms were introduced between master and slave arms, and high-precision peg-in-hole tasks were performed by six test operators with two modes of control: kinesthetic force feedback (KFF) and shared compliant control (SCC). Task performance was quantified in terms of the completion time (CT) and the sum of square forces (SOSF). The experimental results demonstrate the superiority of SCC over KFF for time-delayed telemanipulation. SCC has significantly lower rates of increase than KFF in both CT and SOSF with time delay. Only SCC enabled task performance at delays above 1 s. Constant force maintenance tasks were also performed to investigate the effect of time delay on the stability of force reflection. SCC also has beneficial effects on telemanipulation without time delay. > A novel concept for a decentralized adaptive traffic signal control in urban networks using in future available vehicle to infratructure (V2I) communication data is presented. The phase-based strategy takes advantage of the improved detection data and optimizes each time interval of 5 seconds the phase sequence in order to reduce the total queue length within a forecast horizon of 20 seconds. For optimization the methods of dynamic programming and complete enumeration are used. The methods are embedded in the simulation environment of the microscopic traffic simulator AIMSUN NG. The market penetration level is the critical factor that impacts the quality of the new signal control. Hence, various penetration levels are modelled. For reference TRANSYT-7F is used. This paper examines techniques for finding falsifying trajectories of hybrid systems using an approach that we call trajectory splicing. Many formal verification techniques for hybrid systems, including flowpipe construction, can identify plausible abstract counterexamples for property violations. However, there is often a gap between the reported abstract counterexamples and the concrete system trajectories. Our approach starts with a candidate sequence of disconnected trajectory segments, each segment lying inside a discrete mode. However, such disconnected segments do not form concrete violations due to the gaps that exist between the ending state of one segment and the starting state of the subsequent segment. Therefore, trajectory splicing uses local optimization to minimize the gap between these segments, effectively splicing them together to form a concrete trajectory. We demonstrate the use of our approach for falsifying safety properties of hybrid systems using standard optimization techniques. As such, our approach is not restricted to linear systems. We compare our approach with other falsification approaches including uniform random sampling and a robustness guided falsification approach used in the tool S-Taliro. Our preliminary evaluation clearly shows the potential of our approach to search for candidate trajectory segments and use them to find concrete property violations. Abstract This paper concerns the position-based visual servo control of autonomous robotic manipulators in space. It focuses on the development of a real-time vision-based pose and motion estimation algorithm of a non-cooperative target by photogrammetry and extended Kalman filter for robotic manipulators to perform autonomous capture. Optical flow algorithm is adopted to track the target features in order to improve the image processing efficiency. Then, a close-loop position-based visual servo control strategy is devised to determine the desired pose of the end-effector at the rendezvous point based on the estimated pose and motion of the target. The corresponding desired joint angles of the robotic manipulator in the joint space are derived by the inverse kinematics of the robotic manipulator. The developed algorithm and position-based visual servo control strategy are validated experimentally by a custom built robotic manipulator with an eye-in-hand configuration. The experimental results demonstrate the proposed estimation algorithm and control scheme are feasible and effective. Mining operations have great potential for automation, from a worker safety viewpoint as well as productivity and efficiency. Among the operations that can be automated are loading, guiding, and unloading of LHD loaders. This paper concerns automatic loading of these units, based on modeling a loader as a robot manipulator. For this purpose, analysis of the forces concerned in the process of scooping, and information about the kinematics of motion become essential. This work is about the trajectory of motion during scooping. Based an the results of a preliminary study on the nature of the forces involved, and bearing in mind the preference for simplicity in the control action, an easy to follow trajectory is determined for the cutting edge of the bucket of a loader, which is regarded as the end-effector in a robot manipulator. The way to find a minimum energy consuming trajectory for each individual bucket and for a particular material to be loaded is discussed. Since following this trajectory is more efficient it can be used for faster execution of bucket loading, if desired. > High-end vehicles are already equipped with safety systems, such as assistive braking and automatic lane following, enhancing vehicle safety. Yet, these current solutions can only help in low-complexity driving situations. In this paper, we introduce a parallel autonomy , or shared control, framework that computes safe trajectories for an automated vehicle, based on human inputs. We minimize the deviation from the human inputs while ensuring safety via a set of collision avoidance constraints. Our method achieves safe motion even in complex driving scenarios, such as those commonly encountered in an urban setting. We introduce a receding horizon planner formulated as nonlinear model predictive control (NMPC), which includes the analytic descriptions of road boundaries and the configuration and future uncertainties of other road participants. The NMPC operates over both steering and acceleration simultaneously. We introduce a nonslip model suitable for handling complex environments with dynamic obstacles, and a nonlinear combined slip vehicle model including normal load transfer capable of handling static environments. We validate the proposed approach in two complex driving scenarios. First, in an urban environment that includes a left-turn across traffic and passing on a busy street. And second, under snow conditions on a race track with sharp turns and under complex dynamic constraints. We evaluate the performance of the method with various human driving styles. We consequently observe that the method successfully avoids collisions and generates motions with minimal intervention for parallel autonomy. We note that the method can also be applied to generate safe motion for fully autonomous vehicles. In this paper we propose and evaluate a control system to (1) learn and (2) adapt robot motion for continuous non-rigid contact with the environment. We present the approach in the context of wiping surfaces with robots. Our approach is based on learning by demonstration. First an initial periodic motion, covering the essence of the wiping task, is transferred from a human to a robot. The system extracts and learns one period of motion. Once the user demonstrator is content with the motion, the robot seeks and establishes contact with a given surface, maintaining a predefined force of contact through force feedback. The shape of the surface is encoded for the complete period of motion, but the robot can adapt to a different surface, perturbations or obstacles. The novelty stems from the fact that the feedforward component is learned and encoded in a dynamic movement primitive. By using the feedforward component, the feedback component is greatly reduced if not completely canceled. Finally, if the user is not satisfied with the periodic pattern, he she can change parts of motion through predefined gestures or through physical contact in a manner of a tutor or a coach.The complete system thus allows not only a transfer of motion, but a transfer of motion with matching correspondences, i.e. wiping motion is constrained to maintain physical contact with the surface to be wiped. The interface for both learning and adaptation is simple and intuitive and allows for fast and reliable knowledge transfer to the robot.Simulated and real world results in the application domain of wiping a surface are presented on three different robotic platforms. Results of the three robotic platforms, namely a 7 degree-of-freedom Kuka LWR-4 robot, the ARMAR-IIIa humanoid platform and the Sarcos CB-i humanoid robot, depict different methods of adaptation to the environment and coaching. An intuitive and user friendly system for transferring of skills from a person to a robot.It allows online learning and adaptation of motion trajectories.It allows adaptation of trajectories through human coaching, from either force or visual feedback.It is based on the dynamic motion primitives framework.Surface wiping use-case through non-rigid contact is demonstrated and evaluated. The excavation of foundations, general earthworks and earth removal tasks are activities which involve the machine operator in a series of repetitive operations, suggesting opportunities for the automation through the introduction of robotic technologies with subsequent improvements in machine utilisation and throughput. The automation of the earth removal process is also likely to provide a number of other benefits such as a reduced dependence on operator skills and a lower operator work load, both of which might be expected to contribute to improvements in quality and, in particular, the removal of the need for a local operator when working in hazardous environments. The Lancaster University Computerised Intelligent Excavator or LUCIE has demonstrated the achievement of automated and robotic excavation through the implementation of an integrated, real-time, artificial intelligence based control system utilising a novel form of motion control strategy for movement of the excavator bucket through ground. Having its origins in the systematic observation of a range of machine operators of differing levels of expertise, the control strategy as evolved enables the autonomous excavation of a high quality rectangular trench in a wide variety of types and conditions of ground and the autonomous removal of obstacles such as boulders along the line of that trench. The paper considers the development of the LUCIE programme since its inception and sets out in terms of the machine kinematics the evolution and development of the real-time control strategy from an implementation on a one-fifth scale model of a back-hoe arm to a full working system on a JCB801 360° tracked excavator.