<story><title>Tesla&apos;s &apos;Autopilot&apos; Will Make Mistakes. Humans Will Overreact</title><url>http://www.bloomberg.com/view/articles/2016-07-01/tesla-s-autopilot-will-make-mistakes-humans-will-overreact</url></story><parent_chain></parent_chain><comment><author>Animats</author><text>That&amp;#x27;s part of the problem.&lt;p&gt;Tesla has two basic problems with their &amp;quot;autopilot&amp;quot;.  One is hype, and one is bad technical design.&lt;p&gt;Tesla&amp;#x27;s &amp;quot;autopilot&amp;quot; is just automatic lane keeping and automatic cruise control.  Mercedes and BMW have been shipping that for years. The other car companies have hardware to check if the driver&amp;#x27;s hands are on the wheel.  Tesla not only didn&amp;#x27;t do that, they hyped those basic functions as being an &amp;quot;autopilot&amp;quot;, as if they had something comparable to what Google has.  Tesla has significantly overhyped their technology, to a dangerous level.&lt;p&gt;Here&amp;#x27;s another Tesla crash, from yesterday.[1]  This is a Tesla rear-ending the corner of a stalled van on a highway. This may be an &amp;quot;automation in wrong mode&amp;quot; error, and complicated excuses from Tesla will probably be forthcoming.  That&amp;#x27;s not good enough.  Airline pilots get into &amp;quot;wrong mode&amp;quot; errors, and they get extensive training, including simulator time.  Drivers don&amp;#x27;t get that.  This driver presumably thought the automation would do something sensible in that situation. It didn&amp;#x27;t.&lt;p&gt;The other big Tesla problem is a pure technical design error - the bumper-mounted radar is blind at windshield height.  This is the immediate cause of the fatal accident involving under-running the semitrailer.  It&amp;#x27;s also the cause of the parking accident with the truck with overhanging load sticking out the back.[2] Tesla&amp;#x27;s implementation has deadly blind spots.  They need a radar at windshield-top height. It&amp;#x27;s quite likely, now that the NHTSA is looking into this crash, that Tesla will have to do a recall and retrofit one.  (Along with hands-on-wheel sensors.)&lt;p&gt;Tesla was relying on stereo cameras too much.  Depth from stereo is always iffy; there needs to be some detail on the target to get range. You can&amp;#x27;t range a uniform surface with stereo vision.  (Human flyers have the same problem flying over ice.) A big white truck under some lighting conditions has that property.  Cameras are useful, but backed only by today&amp;#x27;s algorithms, not enough.  Teslas come with a sensor suite inadequate for the job.&lt;p&gt;From a software perspective, Tesla&amp;#x27;s software seems to be overoptimistic that there&amp;#x27;s no problem ahead. 3D vision systems know when they don&amp;#x27;t have range info for a large area. Tesla&amp;#x27;s software was willing to drive into that.  It didn&amp;#x27;t note the absence of range info for the road surface; it may not even be profiling the road ahead.  (We all had to do that in the DARPA Grand Challenge because we were operating off-road. That&amp;#x27;s a solved problem. Google does it with their roof-mounted LIDAR.)  Tesla owners have asked for &amp;quot;pothole detection&amp;quot; as a feature.  Lack of this may eventually take someone off a cliff.&lt;p&gt;The press is gradually picking up on this.  Until recently, Tesla&amp;#x27;s autopilot was treated as a magic black box in the press.  Now some automotive writers are starting to ask the right questions.&lt;p&gt;This is not a setback for automatic driving. This is just a Tesla problem.&lt;p&gt;[1] &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;www.youtube.com&amp;#x2F;watch?v=qQkx-4pFjus&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;www.youtube.com&amp;#x2F;watch?v=qQkx-4pFjus&lt;/a&gt;
[2] &lt;a href=&quot;http:&amp;#x2F;&amp;#x2F;www.roadandtrack.com&amp;#x2F;new-cars&amp;#x2F;car-technology&amp;#x2F;news&amp;#x2F;a29133&amp;#x2F;tesla-self-driving-crash-summon-autonomous&amp;#x2F;&quot; rel=&quot;nofollow&quot;&gt;http:&amp;#x2F;&amp;#x2F;www.roadandtrack.com&amp;#x2F;new-cars&amp;#x2F;car-technology&amp;#x2F;news&amp;#x2F;a29...&lt;/a&gt;</text></comment>
<story><title>Tesla&apos;s &apos;Autopilot&apos; Will Make Mistakes. Humans Will Overreact</title><url>http://www.bloomberg.com/view/articles/2016-07-01/tesla-s-autopilot-will-make-mistakes-humans-will-overreact</url></story><parent_chain></parent_chain><comment><author>joshdickson</author><text>I used to work on the radar systems in these vehicles. It&amp;#x27;s a problem that the feature is called &amp;quot;autopilot,&amp;quot; yes, but the larger issue is that the car does not &lt;i&gt;enforce&lt;/i&gt; what the company often says in press releases, which is that you need to remain alert and with your hands on the wheel. There have been similar systems in other vehicles for years - I&amp;#x27;m most familiar with those in Mercedes vehicles that are not as advanced but perform similar actions. Those systems will &lt;i&gt;automatically turn off&lt;/i&gt; after just a few seconds of removing your hands from the wheel. That is what the Tesla should do. The autopilot feature is a toy; it&amp;#x27;s not to be used in place of a human driver, nor would a human driver be able to step in quickly and take over for the system were it to suddenly fail had the person not been paying attention. It should not be possible to watch a Youtube video of someone driving completely hands free for minutes at a time.&lt;p&gt;Yes, Tesla should not call it &amp;quot;autopilot,&amp;quot; but if you want to really prevent people from using the system in a way in which it&amp;#x27;s not intended, you need to enforce it in hardware.</text></comment>