With computers being given more and more responsibilities as they become smarter, faster, and able to decide on their own, the problem is how to go about it when they start making mistakes: from confusing a car stuck in traffic as illegally parked, to crashing planes to the ground (and killing everyone on board) the paradox of automation is the slow erosion of skills and expertise of the operators, rendering them useless when things go wrong.
The paradox of automation, then, has three strands to it. First, automatic systems accommodate incompetence by being easy to operate and by automatically correcting mistakes. Because of this, an inexpert operator can function for a long time before his lack of skill becomes apparent – his incompetence is a hidden weakness that can persist almost indefinitely. Second, even if operators are expert, automatic systems erode their skills by removing the need for practice. Third, automatic systems tend to fail either in unusual situations or in ways that produce unusual situations, requiring a particularly skilful response. A more capable and reliable automatic system makes the situation worse.
There are plenty of situations in which automation creates no such paradox. A customer service webpage may be able to handle routine complaints and requests, so that staff are spared repetitive work and may do a better job for customers with more complex questions. Not so with an aeroplane. Autopilots and the more subtle assistance of fly-by-wire do not free up the crew to concentrate on the interesting stuff. Instead, they free up the crew to fall asleep at the controls, figuratively or even literally. One notorious incident occurred late in 2009, when two pilots let their autopilot overshoot Minneapolis airport by more than 100 miles. They had been looking at their laptops.
|Talk Like Stephen Hawking|
|Trains of Russia|
|Man uses 35 cable modems to provide WiFi, sued by Comcast|
|3D Glass Printer|
|ASB GlassFloor: Glass Surface With Embedded LEDs to Create Programmable Marking Lines|
|"Most of what kids currently learn at school will probably be irrelevant by the time they are 40."|
|“There was not only automation but where the suggestion that humans had any control [...] was absent too.”|
|"This very internationalism that contributed to the apocalyptic disaster that ended the Bronze Age."|
|Top 10 Reasons Men Are Scum|
|“It was weeks later that she was at a party and realized she'd been texting with her dead friend's bot for 30 minutes.”|
|Loneliness is Not an Old Friend|
|“The use of AI assistants may dramatically accelerate and broaden what might be looked back on as a global period of cognitive decline.”|
|“That glazed-over look a grandma has at a Vegas slot machine is the same look Facebook chases in its users scrolling the feed.”|
|“You can make spaceships much bigger than anything we’ve seen so far in history.”|
|“It's unbelievable how much energy is released.”|
|“One of the major concerns with asteroid mining is, of course, getting to the asteroids.”|
|“You can think of quasars as lighthouses in the dark of the early universe.”|