TECHNICAL FIELD

The present disclosure relates to a vehicle user interface apparatus for a vehicle, and a vehicle.

BACKGROUND

A vehicle is an apparatus configured to move a user in the user's desired direction. A representative example of a vehicle may be an automobile.

Various types of sensors and electronic devices may be provided in the vehicle to enhance user convenience. For example, a Head Up Display (HUD) may be provided to display a graphic object using Augmented Reality (AR) technology. In addition, Advanced Driver Assistance System (ADAS) is being actively developed for enhancing the user's driving convenience and safety. Further, autonomous vehicles are being actively developed.

SUMMARY

In one aspect, a user interface apparatus for a vehicle includes: an interface unit; a display unit configured to project an augmented reality (AR) graphic object onto a screen; at least one processor; and a computer-readable medium coupled to the at least one processor having stored thereon instructions which, when executed by the at least one processor, causes the at least one processor to perform operations including: acquiring, through the interface unit, front view image information and vehicle motion information; based on the front view image information, generating the AR graphic object; and based on the vehicle motion information, warping the AR graphic object.

Implementations may include one or more of the following features. For example, acquiring the front view image information and the vehicle motion information includes: receiving, from a first camera of the vehicle, the front view image information, and the operations further include: based on the front view image information, generating first motion information associated with a first motion of the vehicle, the first motion information being defined with respect to a first coordinate system.

In some implementations, the operations include: receiving, through the interface unit, vehicle motion sensing information from an Inertial Measurement Unit (IMU) of the vehicle; and based on the vehicle motion sensing information, generating second motion information associated with a second motion of the vehicle, the second motion information being defined with respect to a second coordinate system different from the first coordinate system.

In some implementations, warping the AR graphic object includes: transforming the second motion information to be defined with respect to the first coordinate system; and compensating the first motion information based on the transformed second motion information.

In some implementations, compensating the first motion information based on the transformed second motion information includes: counteracting the second motion of the vehicle in the first motion information.

In some implementations, warping the AR graphic object includes: changing, through the display unit, a location of the AR graphic object projected onto the screen based on the compensated first motion information.

In some implementations, changing the location of the AR graphic object projected onto the screen based on the compensated first motion information includes: based on the compensated first motion information, determining a first motion direction of the vehicle; and changing the location of the AR graphic object in a direction opposite to the first motion direction of the vehicle.

In some implementations, changing the location of the AR graphic object projected onto the screen based on the compensated first motion information includes: based on the compensated first motion information, determining a first displacement magnitude of the vehicle; and changing the location of the AR graphic object in correspondence to the first displacement magnitude of the vehicle.

In some implementations, the operations include: based on the vehicle motion information, determining a change in a motion of the vehicle; and based on the determination of the change in the motion of the vehicle, adding a graphical effect to the AR graphic objects.

In some implementations, the graphical effect includes one or more of fade-out effect or blur effect.

In some implementations, the operations include: acquiring, through the interface unit, vehicle pitch information associated with a change in a pitch of the vehicle; and warping the AR graphic object based on the vehicle pitch information.

In some implementations, the operations include: acquiring, through the interface unit, vehicle yaw information associated with a change in yaw of the vehicle which is generated when a steering wheel is rotated; and warping the AR graphic object based on the vehicle yaw information.

In some implementations, the user interface apparatus further includes a second camera configured to capture images of eyes of a user of the vehicle, and the operations include: based on the captured images, detecting the eyes of the user; tracking a change in a location of the eyes of the user in response to a motion of the vehicle; and warping the AR graphic object based on the tracked change in the location of the eyes of the user.

In some implementations, the operations include: based on the front view image information, generating frontal object information associated with an object located forward of the vehicle; determining a first time corresponding to an estimated time of arrival of the vehicle at the object; and changing, through the display unit, a location of the AR graphic object projected onto the screen based on the first time.

In some implementations, the operations include: determining that the object is a bump; based on the determination that the object is a bump, acquiring height information of the bump; and based on the height information, generating, within the first time, a first anticipated motion information associated with a first anticipated motion of the vehicle at the bump.

In some implementations, the operations include: receiving, through the interface unit, vehicle motion sensing information associated with the bump from an Inertial Measurement Unit (IMU); based on the vehicle motion sensing information, generating second motion information associated with the bump; and compensating the first anticipated motion information based on the second motion information.

In some implementations, the operations include: determining that the object is a curved section; based on the determination that the object is a curved section, acquiring curvature information of the curved section; and based on the curvature information, generating, within the first time, a second anticipated motion information associated with a second anticipated motion of the vehicle at the curved section.

In some implementations, the display unit includes: an imaging unit configured to output the AR graphic object; a flat mirror configured to reflect the AR graphic object; and a concave mirror configured to reflect the AR graphic object reflected by the flat mirror toward the screen.

In some implementations, the display unit further includes a flat mirror drive unit configured to adjust a position of the flat mirror, and the operations include: warping the AR graphic object by adjusting, through the flat mirror drive unit, the position of the flat mirror.

In another aspect, a vehicle includes: a plurality of wheels; a power source configured to drive at least one of the plurality of wheels; and the user interface apparatus.

In some scenarios, according to some implementations of the present disclosure, one or more of the following effects may be achieved.

First, a spatial correspondence of a displayed AR graphic object to a real object can be improved in presence of vehicle movement. As such, perceived realism by a user may be improved.

Second, through improved spatial correspondence, information may be provided to the user in a more accurate manner.

Effects of the present invention should not be limited to the aforementioned effects and other unmentioned effects will be clearly understood by those skilled in the art from the claims. The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features will be apparent from the description and drawings, and from the claims. The description and specific examples below are given by way of illustration only, and various changes and modifications will be apparent.

