Pedestrians and vehicles often share the road in complex inner city traffic. This leads to interactions between the vehicle and pedestrians, with each affecting the other's motion. In order to create robust methods to reason about pedestrian behavior and to design interfaces of communication between self-driving cars and pedestrians we need to better understand such interactions. In this paper, we present a data-driven approach to implicitly model pedestrians' interactions with vehicles, to better predict pedestrian behavior. We propose a LSTM model that takes as input the past trajectories of the pedestrian and ego-vehicle, and pedestrian head orientation, and predicts the future positions of the pedestrian. Our experiments based on a real-world, inner city dataset captured with vehicle mounted cameras, show that the usage of such cues improve pedestrian prediction when compared to a baseline that purely uses the past trajectory of the pedestrian.
Interactions among traffic agents have been explored in prior work by means of explicit communication between pedestrians and drivers @cite_41 , pedestrians and cars @cite_28 @cite_26 @cite_31 , implicit communication @cite_13 , crosswalks scenarios @cite_24 @cite_4 , through the usage of gestures @cite_42 , and by analyzing interactions with objects that may interfere with pedestrian awareness of the environment @cite_22 . Recent work presented by Rasouli and Tsotsos @cite_34 summarized pedestrian behavior studies, discussing interactions between pedestrians and autonomous vehicles, and also presented factors that pedestrians take into consideration when crossing streets. @cite_9 used VR to insert pedestrians in virtual environments. The focus of the study was to estimate the pedestrians' acceptance of autonomous cars. Rothenb " u @cite_28 used a Wizard of Oz approach to analyze the interactions between pedestrians and autonomous cars, where the driver camouflaged themselves to blend in with the seat, simulating the appearance of autonomous vehicles.
@cite_26 @cite_4 @cite_22 @cite_41 @cite_28 @cite_9 @cite_42 @cite_24 @cite_31 @cite_34 @cite_13
2806813616 2734962429 2561106390 2903870308 2551641937 2552330834 2507800322 2757876960 2963001155 2756874185
In urban environments traffic safety is primarily determined by the successful interaction between road users. In order to define behavioral requirements for future autonomous vehicles, an understanding of these interactions is needed. Therefore this paper analyzes the interaction between drivers and pedestrians at crosswalks from both the driver's and the pedestrian's perspective. A study with driving experiments in real-life traffic was conducted. The study not only investigates how drivers respond to pedestrians who intend to use the crosswalk, but also their response to pedestrians who waive their right-of-way. An analysis of recorded driving and video data identified typical behavior patterns of drivers approaching a crosswalk, as well as of pedestrians crossing on it. Supplemented by questionnaires filled in by drivers and pedestrians, we determined factors which have a relevant impact on successful driver-pedestrian interaction. We confirmed that with higher initial speeds, drivers tend to exhibit more anticipatory driving behavior. Contrary to previous studies, the presented results show a significant influence of the vehicle's speed on the pedestrian's decision process. The gained insights into the driver-pedestrian interaction process provide an opportunity to develop autonomous driving functions with a cooperative driving behavior that conforms to the expectations of both pedestrians and vehicle occupants. How will pedestrians and bicyclists interact with autonomous vehicles when there is no human driver? In this paper, we outline a novel method for performing observational field experiments to investigate interactions with driverless cars. We provide a proof-of-concept study (N=67), conducted at a crosswalk and a traffic circle, which applies this method. In the study, participants encountered a vehicle that appeared to have no driver, but which in fact was driven by a human confederate hidden inside. We constructed a car seat costume to conceal the driver, who was specially trained to emulate an autonomous system. Data included video recordings and participant responses to post-interaction questionnaires. Pedestrians who encountered the car reported that they saw no driver, yet they managed interactions smoothly, except when the car misbehaved by moving into the crosswalk just as they were about to cross. This method is the first of its kind, and we believe that it contributes a valuable technique for safely acquiring empirical data and insights about driverless vehicle interactions. These insights can then be used to design vehicle behaviors well in advance of the broad deployment of autonomous technology. Cooperative interaction in traffic is vital for resolving a wide range of ambiguities arising from road users' actions. Autonomous vehicles are no exception and require the ability to understand the intention of road users and communicate with them in order to ensure their safety and maintain traffic flow. In this paper, we address the problem of traffic interaction by analyzing a large sample of pedestrians communicating with drivers. We highlight the ways pedestrians communicate and use a logistic regression model to identify what factors influence communication patterns of pedestrians and how. We also discuss practical challenges regarding the recognizing and understanding of pedestrians' intention and how our theoretical findings can help to solve them. Our analysis suggests that pedestrians predominantly rely on implicit communication cues such as stepping onto the road to transmit their intention of crossing. In addition, we found that the presence of traffic signal, street width, and pedestrian group size can influence the frequency and type of pedestrian communication, while factors such as pedestrians' age and gender did not show any significant impact. Self-driving technologies have been increasingly developed and tested in recent years (e.g., Volvo's and Google's self-driving cars). However, only a limited number of investigations have so far been conducted into communication between self-driving cars and pedestrians. For example, when a pedestrian is about to cross a street, that pedestrian needs to know the intension of the approaching self-driving car. In the present study, we designed a novel interface known as "Eyes on a Car" to address this problem. We added eyes onto a car so as to establish eye contact communication between that car and pedestrians. The car looks at the pedestrian in order to indicate its intention to stop. This novel interface design was evaluated via a virtual reality (VR) simulated environment featuring a street-crossing scenario. The evaluation results show that pedestrians can make the correct street-crossing decision more quickly if the approaching car has the novel interface "eyes" than in the case of normal cars. In addition, the results show that pedestrians feel safer with regard to crossing a street if the approaching car has eyes and if the eyes look at them. A citing sentence is one that appears in a scientific article and cites previous work. Citing sentences have been studied and used in many applications. For example, they have been used in scientific paper summarization, automatic survey generation, paraphrase identification, and citation function classification. Citing sentences that cite multiple papers are common in scientific writing. This observation should be taken into consideration when using citing sentences in applications. For instance, when a citing sentence is used in a summary of a scientific paper, only the fragments of the sentence that are relevant to the summarized paper should be included in the summary. In this paper, we present and compare three different approaches for identifying the fragments of a citing sentence that are related to a given target reference. Our methods are: word classification, sequence labeling, and segment classification. Our experiments show that segment classification achieves the best results. We present an active pedestrian protection system that performs an autonomous lane-keeping evasive maneuver in urban traffic scenarios when collision avoidance by braking is no longer possible. The system focuses on pedestrians standing at the curb and intending to cross the street despite an approaching car. It is demonstrated that the evasive maneuver of the car can be initiated before the pedestrian's foot hits the lane, by means of video-based motion contour histograms of oriented gradients and stationary detection. Using clothoid-based real-time trajectory planning and a lateral control of the car, combining feedforward and feedback control, the difference between the driven and the calculated trajectories is kept below 10 cm at maximum lateral accelerations of 4 ms-2 and -5 ms-2. We present the technical realization of the system and its precision with respect to intention recognition and driven trajectories. A case study showed that the system reacted faster than human drivers in five out of 11 cases, with an average time gain of 214 ms, even though the drivers were able to pay the utmost attention to the behavior of the crossing pedestrian. The higher social attention and negotiation among road users while crossing the road is as much a challenge for self-driving cars as it is for pedestrians. Self-driving cars in their current state are not able to understand cues from other road users and are rather reactive to pedestrian behavior, which may result overall in a slower traffic flow. In this paper, a vehiclepedestrian negotiation model is proposed describing the processing and exchange of negotiation cues from both parties in order to speed up the traffic flow. The motion strategy for the vehicle approaching the pedestrian is formulated in order to negotiate its best chance to pass first, a process that closely mimics the common scenarios of everyday negotiation on roads. Simulation results show an improvement in the overall travel time of the vehicles as compared with the current best practice behavior (always stop) of autonomous vehicles. The cost-benefit analysis of negotiation among both parties is also discussed in this paper. With the rapid development of the techniques for autonomous driving and ADAS in the last decade, more advanced methods to understand pedestrian behavior are required. Crosswalks at intersections are the one of most hazardous where many accidents between turning-vehicles and pedestrians occur. In this paper, we present a method for estimating the pedestrians intention to cross a signalized crosswalk or stop in front of it. The intention is crucial to not only the collision avoidance but also smooth traffic in the context of autonomous driving by reducing unnecessary risk margins. Regarding the behavioral flow of pedestrian: assessment, decision-making and physical movement, as a stochastic process, we construct a probabilistic model with the Dynamic Bayesian Network. It takes account of not only pedestrian physical states but also contextual information and integrates the relationship among them. By employing the particle filter as a Bayesian filtering framework, the model estimates the pedestrian state from signal information and pedestrian position measurements. Evaluation using experimental data collected in real traffic scene shows that the proposed model has an ability to detect the pedestrian intention to cross a crosswalk even when he she is far from it. Active safety systems which assess highly dynamic traffic situations including pedestrians are required with growing demands in autonomous driving and ADAS. In this paper, we focus on one of the most hazardous traffic situations: the possible collision between a pedestrian and a turning vehicle at intersections. This paper presents a probabilistic model of pedestrian behavior to signalized crosswalks. For this purpose, we take not only pedestrian physical states but also contextual information into account. We propose a model based on the Dynamic Bayesian Network (DBN) which integrates relations among the intersection context information and the pedestrian behavior in the same way as human. Afterwards, the model jointly estimates their states by the particle filter. Experimental evaluation using real traffic data shows that this model is able to recognize the pedestrian crossing decision in advance from the traffic signal and pedestrian position information. We develop predictive models of pedestrian dynamics by encoding the coupled nature of multi-pedestrian interaction using game theory and deep learning-based visual analysis to estimate person-specific behavior parameters. We focus on predictive models since they are important for developing interactive autonomous systems (e.g., autonomous cars, home robots, smart homes) that can understand different human behavior and pre-emptively respond to future human actions. Building predictive models for multi-pedestrian interactions however, is very challenging due to two reasons: (1) the dynamics of interaction are complex interdependent processes, where the decision of one person can affect others, and (2) dynamics are variable, where each person may behave differently (e.g., an older person may walk slowly while the younger person may walk faster). To address these challenges, we utilize concepts from game theory to model the intertwined decision making process of multiple pedestrians and use visual classifiers to learn a mapping from pedestrian appearance to behavior parameters. We evaluate our proposed model on several public multiple pedestrian interaction video datasets. Results show that our strategic planning model predicts and explains human interactions 25 better when compared to a state-of-the-art activity forecasting method. This paper presents a study that aimed to identify the importance of eye contact and gestures between pedestrians and drivers. A video-based observation and coding was undertaken to categorize the road-crossing and communication behavior of pedestrians and drivers in busy traffic situations where efficient negotiation is necessary. The evidence in the study suggests that eye contact does not play a major role in manual driving, that explicit communication is rare to non-existent, and that motion patterns and behaviors of vehicles play a more significant role for pedestrians in efficient traffic negotiations.