Franken-algorithms: the deadly consequences of unpredictable code

By | August 30, 2018

The death of a woman hit by a self-driving car highlights an unfolding technological crisis, as code piled on code creates ‘a universe no one fully understands’

The 18th of March 2018, was the day tech insiders had been dreading. That night, a new moon added almost no light to a poorly lit four-lane road in Tempe, Arizona, as a specially adapted Uber Volvo XC90 detected an object ahead. Part of the modern gold rush to develop self-driving vehicles, the SUV had been driving autonomously, with no input from its human backup driver, for 19 minutes. An array of radar and light-emitting lidar sensors allowed onboard algorithms to calculate that, given their host vehicle’s steady speed of 43mph, the object was six seconds away – assuming it remained stationary. But objects in roads seldom remain stationary, so more algorithms crawled a database of recognizable mechanical and biological entities, searching for a fit from which this one’s likely behavior could be inferred.

At first the computer drew a blank; seconds later, it decided it was dealing with another car, expecting it to drive away and require no special action. Only at the last second was a clear identification found – a woman with a bike, shopping bags hanging confusingly from handlebars, doubtless assuming the Volvo would route around her as any ordinary vehicle would. Barred from taking evasive action on its own, the computer abruptly handed control back to its human master, but the master wasn’t paying attention. Elaine Herzberg, aged 49, was struck and killed, leaving more reflective members of the tech community with two uncomfortable questions: was this algorithmic tragedy inevitable? And how used to such incidents would we, should we, be prepared to get?

Related: Weapons of Math Destruction by Cathy O’Neil review – trouble with algorithms

Related: Fast money: the battle against the high frequency traders

Facebook would claim they know what’s going on at the micro level … But what happens at the level of the population​?

Related: Magical thinking about machine learning won’t bring the reality of AI any closer | John Naughton

You have all these pieces of code running on people’s iPhones, and collectively it acts like one multicellular organism

Related: How algorithms are pushing the tech giants into the danger zone

Related: ‘Fiction is outperforming reality’: how YouTube’s algorithm distorts truth

Related: New Dark Age by James Bridle review – technology and the end of the future

Continue reading…

Read the original article

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.