This is your captain speaking. It’s foggy down here on the Ground. but hopefully it’s beautifully clear where you are at 30,000 feet… are you ready to get on a pilotless plane? 30 | NewScientist | 9 August 2014
COVER STORY
What would it mean to fly without a human at the controls, asks Paul Marks
1
JUNE 2009: Air France flight 447 is cruising from Rio de Janeiro to Paris when it hits a tropical storm in the mid-Atlantic. Minutes later, the Airbus A330 flies into the ocean, killing all 228 people on board. On a sunny July morning four years later, an Asiana Airlines flight approaching San Francisco airport smashes into the sea wall just ahead of the runway, severing the entire tail section and sending the fractured fuselage cartwheeling across the airstrip. Three people died and dozens were injured. These incidents appear unrelated, yet they share a tragic similarity: the pilot of each plane believed his flight control systems would automatically prevent the aircraft from stalling or flying too slowly to stay airborne. They were wrong. It turns out that this type of mix-up is a major contributor to a number of air crashes. And the confusion is set to get worse. With more things becoming automated, pilots can get muddled when something goes seriously wrong, losing track of where the autopilot’s responsibility ends and theirs begins. It is a recipe for disaster. So is it time to lose the human pilot altogether? Certainly many in the industry think so. Far better, they argue, for airliners to fly autonomously, under the remote supervision of pilots in an office thousands of kilometres away. Safety-wise it seems to make sense – flight crew error has been implicated in about half of all fatal airline accidents (see graph, page 33). Along with improved safety, pilotless passenger planes could offer dramatic cost savings for airlines and passengers alike. Without pilots, airlines would spend far less on salaries, simulator training, healthcare, layover hotels and retirement benefits, says Mary Cummings, a researcher in autonomous flight at Duke University in Durham, North Carolina. That should translate into lower fares, and automated flight should also be more fuel efficient, helping to further reduce
costs and cut greenhouse gas emissions. And with the pointy end of the aircraft no longer taken up by crew, spectacular, panoramic views would be on offer to passengers in the front seats – provided they pay a little extra, of course. There’s just one key question: how would you feel boarding a plane without a human hand at the helm? At the heart of this revolution lies a simple fact: computers now do so much on planes that airline pilots rarely have cause to take the controls. Autoflight computers can take over when the plane is just 30 metres off the ground, maintaining whatever speed, heading and height the crew tap into the flight management system. And the computer has long been able to home in on a runway radio beacon and land the aircraft automatically. Yet automation introduces fresh challenges
for pilots. When autoflight computers experience situations they haven’t been programmed to handle – sudden structural damage to the aircraft, say, or extreme weather like that experienced by flight 447 – they can unexpectedly throw responsibility back to the pilots. Those pilots may become confused over the level of control they have been handed when something goes seriously wrong. Equally dangerous is the fact that flight deck computers can overload pilots with a blizzard of alerts, checklists and audible alarms at critical moments. In November 2010, for instance, an engine exploded on Qantas flight 32 with 469 people on board, cutting 650 control wires. Yet as pilot Richard de Crespigny tried to land at Singapore, he and his co-pilot were distracted by 120 menus of instructions flashing on their screens. The US Federal Aviation Administration recognises that humans and computers may not be the safest combination. In 2013, it published results of a seven-year study revealing a litany of dangers posed by the pairing of humans with flight deck automation. The FAA’s chief investigator, Kathy Abbott, found that pilots habitually “rely too much” on autoflight systems and are “reluctant to intervene, even when they suspect the systems are not performing as they should”. Pilots continue to be confused over the state of the autoflight system, the report warns. In the short term, airlines are trying to reduce these risks by redesigning computer systems and giving pilots extra training. In the longer term, using less automation in the cockpit might even seem a sensible solution. Yet many in the aviation industry are pursuing another path: reducing the role of fallible humans in the cockpit even further. A consortium of plane-makers, including Boeing, Airbus, BAE Systems and Dassault, has started a €30 million, four-year research project to provide computer assistance for pilots during emergencies. Called the Advanced Cockpit for Reduction of Stress and Workload project (ACROSS), its aim is to use computers to help reduce the dangerous peaks in workload that can lead to confusion during a crisis. The idea is for automation to allow a pilot or co-pilot to cope alone should the other be incapacitated. Yet ACROSS is going further than that. One objective is to identify the key challenges needed to create an autoflight > 9 August 2014 | NewScientist | 31
“She realised that the jet’s autoflight system made her all but redundant” system that replaces the co-pilot entirely – allowing single-pilot operation from take off. However, even if an ultra-smart machine intelligence works fine as a co-pilot, what would happen if the lone human pilot became incapacitated? According to Cummings, any computerised co-pilot good enough to work with a lone human must be able to assume complete control – to take off, fly and land the plane entirely on its own – should the pilot fall ill. So why bother with the human? It would certainly reduce the risk of confusion.
act on them. “Humans cannot keep up.” Experience with US military drones confirms this – their crash rate dropped markedly the more automated they became. In particular, improvements were achieved by preventing pilots flying take off and landings, when crashes frequently happened. “Take off and landing are close to the highest workloads pilots experience,” says Cummings: almost half of all fatal airline incidents occur during these stages of flight. So how far away are pilotless passenger planes? Well, one already exists, after a fashion. An unpiloted Jetstream airliner operated by Humans redundant? BAE Systems has been flying 800-kilometre Bolstering this reasoning is a 2013 study by trips to see how it interacts with other aircraft a team at NASA’s Ames Research Center in and air traffic controllers – although it still has California. It found that an autoflight system a crew on board, just in case. for a new generation of single-pilot very light The Jetstream contains arguably the jets still led to high workloads that tax a pilot beginnings of the machine intelligence that “to the point that errors in navigation and pilotless planes will need – a smart flight flight control occur”. management system called the Airspace To save lives in an emergency, could computers “All aviation researchers recognise Integration Processor (AIP). The AIP avoids that moving from two pilots to one is an collisions using radio, radar and camera-based devise brilliant solutions like this river landing? intermediate step that will allow us to go sensors, and communicates with a ground from one pilot to zero,” says Cummings. pilot via satellite. After being given Indeed, Cummings believes that the era of destination coordinates, the AIP can plan cargo planes via satellite, ready to assume fully automated planes is inevitable. In her waypoints for a route, taking into account control if anything goes wrong. former job as a US navy pilot, she realised her hazardous weather and air traffic restrictions, But flight automation technology could fighter jet’s autoflight system made her all but says BAE flight engineer Rod Buchanan. come into its own much earlier. Thanks to redundant. It could land the craft on the deck Despite these advances, it is unlikely that rapid developments in electric propulsion of an aircraft carrier far better than a human, passenger airlines will be the first to introduce and intelligent flight controls, the time of she says. “It adjusted direction, airspeed and pilotless planes. Cummings expects cargo flying cars or “personal air vehicles” (PAVs) may finally be near, and the key to commercial altitude much faster than I could.” carriers such as FedEx and UPS to be the first Computers have the edge in split-second plane operators to drop from two pilots to just success will be complete automation, operations because eye-to-brain one. This will allow the technology to be tested researchers believe. After all, learning to fly costs thousands of pounds, and if large communication is slower than sensor-toin the same aircraft as those used by airlines, numbers of us are to safely fly our PAVs in a processor transmission. “From the time you but with no passengers aboard. If that proves crowded sky, we’ll need a computer at the see a stimulus that requires action, to the time safe, we can expect to see cargo airlines you actEngineers onEngineers it, is at best half a second,” she says. ditching the crew completely by around 2035, have been testing aircraft designed to fly themselves for more than a century have been testing aircraft designed to fly themselves for more than a century Engineers have been testing aircraft designed to fly themselves for more than a century Engineers have been testing aircraft designed to fly themselves for more than a century helm. “You cannot have the current volumes of road traffic in the air and still have manual A computer, meanwhile, takes just she suggests. Instead, a pilot based at a flight control,” says Mike Jump, an engineer milliseconds to detect sensor signals and company’s hub would watch over a fleet of
Look, no hands! Look, no hands! Look, no hands! Look, no hands!
December 1913 May May 19171917 December 1913 December 1913 1913 May 1917 December May 1917
JuneJune 1944 1944 June 1944 June 1944
October 1947 1994 October 1947 October March 1994 October 1947 1947March MarchMarch 1994 1994
aircraft makes Aeroflot flightAeroflot 593 593 Allied airtoforces begin commissioned to commissioned Orville Wright First aircraft Aeroflot flight Firstmakes aircraft makesmakes flight 593 First aircraft Aeroflot flight 5 airAllied forces begin Sperry commissioned to Orville Wright air forces beginFirst SperrySperry commissioned to Allied OrvilleOrville WrightWright Sperry Allied air forces begin a transatlantic flightaflight afterafter pilot’s operation Aphrodite, six programmable demonstrates crude a transatlantic crashes pilot’s a transatlantic flight crashes crashes after pilot’s transatlantic flight crashes after pil operation Aphrodite, build six build programmable demonstrates crude operation Aphrodite, six programmable demonstrates crudebuild operation Aphrodite, build six programmable demonstrates crude completely under the children accidentally B-17 drone flying bombs “autopilot” system completely under the children children accidentally completely under under the the accidentally completely children acciden fly B-17 flying bombs “autopilot” system to drone flybombers B-17 bombers flying bombs “autopilot” system to bombers flydrone B-17 drone bombers flying bombs to flyto “autopilot” system Engineers have been testing aircraft designed to fly themselves for more than aatcentury control of anof autopilot switch off autopilot at targets in Germany using pendulums control an autopilot switch off autopilot control of an autopilot switch off autopilot control of an autopilot switch off autop targets Germany using pendulums atin targets in Germany using pendulums at targets in Germany using pendulums
Look, no hands!
October March 1994 AprilApril December 1913 May June 19441931 August 19521952 December 1931 1944 20012001 June 1952 June 1952 December 1931 JuneJune 19141914 December December 1931 August 1944 April 2001 August 1944 1947 April 20 August 1944 JuneJune June 1914 June1917 1914 First aircraft makes Aeroflot Allied air forces begin Sperry commissioned to Orville Wright Lawrence Engineers test taking B-17 USthe Department Uncrewed Global Hawk Engineers testEngineers taking Engineers testflight taking Radio-controlled B-17 test593 taking US ofDepartment Radio-controlled B-17 Sperry climbs on the Department ofRadio-controlled Radio-controlled B-17 Uncrewed Global Haw US of Uncrewed Glo Uncrew Lawrence Sperry climbs on the climbs Lawrence Sperry climbs on Lawrence Sperry on Department the USof acrashes, transatlantic flight crashes after pilot’s operation Aphrodite, build six programmable demonstrates wing crude control of a B-25 crashes, narrowly Commerce licenses drone flies flies from thedrone US control of a B-25 control of a B-25 crashes, narrowly control of a B-25 Commerce licenses crashes, narrowly of hisofbiplane to show Commerce licenses narrowly drone from thefro US Commerce licenses drone flies fl wing his biplane to wing of his biplane to show wing ofshow his biplane to show completely under the children accidentally to fly B-17 bombers flying bombs “autopilot” system autopilot missing UK. autopilot in to Australia non-stop bomber's autopilot bomber's autopilot Ipswich, UK. Ipswich, bomber's autopilot for use infordrone missing Ipswich, UK.bomber's gyroscopic “autopilot” at“autopilot” an autopilot usefor in missing UK. to Australia non-stop autopilot usemissing in Ipswich, to Australia no to Aust gyroscopic “autopilot” at an gyroscopic at an gyroscopic “autopilot” atautopilot an for use control an autopilot switch off autopilot at targets in Germany usingEngineers pendulums system fromfrom the ground falls in Sweden passenger flights without refuelling system the ground system from the ground falls in Sweden system from the ground passenger flights Another fallsof infalls Sweden aviation safety contest passenger flights Another in Sweden without refuelling passenger flights without refue Engineers have been testing aircraft designed todesigned fly themselves for more than amore century withou Engineers have been testing aircraft designed tothemselves fly for more than aAnother century have been testing aircraft designed to fly for more than aAnother century aviation safety contest aviation safety contest Engineers have been testing aircraft to themselves fly for than a century aviation safety contest Engineers have been testing aircraft designed tothemselves fly themselves for more than a century
Look, no hands! Look, no hands! Look, no hands! Look, no hands! Look, no hands!
June 1952 December 1931 August 1944 April 2001 June 1914 October 1947 March 1994 December 1913 June June 1944 October 1947 March 1994 October 1947 March 1994 December 1913 1917 June 1944 October 1947 March 1994 December 1913 MayMay 1917 1944 October 1947 March 1994 December 1913 May 1917 June 1944 December 1913 May 1917 May 1917 June 1944 Engineers test taking Radio-controlled B-17 First aircraft US Department of Allied air forces Uncrewed Global Hawk Lawrence Sperry climbs on the makes Aeroflot flight 593 begin Sperry commissioned to Orville Wright aircraft makes Aeroflot flight 593 aircraft makes Aeroflot flight 593 Allied air forces begin Sperry commissioned Orville Wright First aircraft makes Aeroflot flight 593593 air forces Sperry commissioned to to to toAllied Orville Wright First aircraft makes Aeroflot flight Allied air begin forces begin Sperry commissioned Orville Wright Allied air forces begin FirstFirst Sperry commissioned Orville Wright controlflight of a B-25 narrowly Commerce licenses operationcrashes, drone flies from the US wing ofcrude his biplane to show a transatlantic crashes after pilot’s Aphrodite, buildbuild six build programmable demonstrates a transatlantic flight crashes after pilot’s a transatlantic flight crashes after pilot’s operation Aphrodite, six programmable demonstrates crude a transatlantic flight crashes after pilot’s Aphrodite, six programmable demonstrates crude a transatlantic flight crashes after pilot’s operation Aphrodite, build six programmable demonstrates crude operation Aphrodite, build six programmable operation demonstrates crude bomber's autopilot Ipswich, UK. autopilot for use in to fly B-17missing to Australia non-stop gyroscopic “autopilot” at an completely under the children accidentally drone bombers flyingflying bombs “autopilot” system completely under the children accidentally completely under the children accidentally toB-17 fly bombers flying bombs “autopilot” system completely under thethe children accidentally to fly drone bombers bombs “autopilot” system completely under children accidentally to B-17 fly B-17 drone bombers flying bombs “autopilot” system to flydrone B-17 drone bombers flying bombs “autopilot” system from the ground falls in Sweden control ofsystem passenger flights at targetsAnother without refuelling aviation safety contest ancontrol autopilot switch off autopilot Germany usingusing pendulums control ofautopilot an switch off autopilot of an switch off switch autopilot atintargets in Germany using pendulums ofautopilot an switch off autopilot at targets in Germany pendulums control ofautopilot an autopilot off autopilot at targets in Germany using pendulums at targets in Germany control using pendulums
June June 1952 December 1931 June 1952 August 1944 AprilApril 2001 1952 December 1931 June 1952 December 1931 June 1952 August 1944 April 2001 December 1931 August 1944 2001 December 1931 June June 1914 August 1944 April 2001 August 1944 April 2001 June 1914 1914 June 1914 June 1914 32 | NewScientist | 9 August 2014 Engineers test taking B-17 B-17 of Department Engineers taking Uncrewed Global Hawk Engineers testtest taking Radio-controlled B-17 US Department Engineers test taking US Department of of of Radio-controlled Uncrewed Global Hawk Engineers test taking Radio-controlled B-17 Uncrewed Global Hawk US Department Radio-controlled B-17 US of Radio-controlled Uncrewed Global Haw Lawrence Sperry climbs on the Uncrewed Global H Lawrence Sperry climbs on the Lawrence Sperry climbs on the Lawrence Sperry climbs onUS the Lawrence Sperry climbs onDepartment the ofcontrol a B-25 crashes, narrowly Commerce licenses of aof B-25 flies from the US control of acontrol B-25 crashes, narrowly Commerce licenses crashes, narrowly control aof B-25 Commerce licenses drone flies from the USthe a B-25 dronedrone crashes, narrowly flies from the US Commerce licenses crashes, narrowly control Commerce licenses drone flies from the US wingwing of his biplane drone flies from wing ofwing his biplane to show of his biplane to biplane show wing ofto his biplane to show ofshow his to show bomber's autopilot Ipswich, UK.Ipswich, forautopilot use inuse bomber's autopilot non-stop bomber's autopilot missing Ipswich, UK.UK.UK. autopilot for for use in use Ipswich, UK. bomber's autopilot for in use to Australia non-stop bomber's autopilot to Australia missing to Australia inmissing missing Ipswich, autopilot for in missing to Australia non-stop gyroscopic “autopilot” at an“autopilot” tonon-stop Australia non-st gyroscopic “autopilot” at an gyroscopic “autopilot” at an gyroscopic “autopilot” at an gyroscopic atautopilot an autopilot
What caused the crash? The majority of fatal airline accidents are down to humans Pilot error
Mechanical failure
Weather
Sabotage
Other human error
Other
60 50
30 20 10
Decade
at the University of Liverpool, UK, and part of the MyCopter project which is building the automation software for a vertical take off PAV. He predicts lift-off for flying cars by 2025. There is no doubt that automation will be attractive to airline operators: after fuel, crew are one of the industry’s major costs. Senior pilots can earn $240,000 or more a year and require regular training and refresher courses, in addition to benefits such as healthcare and pensions. The time they can spend in the air is also tightly regulated. “Flight crews have physical needs and strict duty periods, and those limit flight time,” says aviation consultant Donough Wilson from Coventry University, UK. Automation means better fuel economy too, says Cummings – an autoflight system won’t stray off the optimum route and so need to use extra fuel getting back on track. What’s
March 1994 rch 1994
July 2013 July 2013
Aeroflot flight 593 oflot flight 593 rashes after pilot’s shes after pilot’s hildren accidentally dren accidentally witch autopilot tch offoff autopilot
X47-B drone X47-B drone makes first makes thethe first autonomous landing autonomous landing aircraft carrier onon an an aircraft carrier
April 2014 April 2014
DARPA announces that DARPA announces that thethe Aircrew Labor In-Cockpit Aircrew Labor In-Cockpit Automation System could Automation System could replace crews of up to five replace crews of up to five
December 2013 2013 July 2013 April JulyJuly 2013 April 2014 2014 April 2014 US hearing investigates X47-B drone X47-B drone X47-B drone DARPA announces thatannounces thethe that the DARPA announces that DARPA ht 593 whether over-reliance makes thethe firstfirst makes makes the first Aircrew Labor In-Cockpit Aircrew Labor In-Cockpit Aircrew Labor In-Cockpit r pilot’s on autopilot is leading autonomous landing autonomous autonomous landing Automation landing System could Automation System could Automation System could dentally to airline accidents on an carrier onaircraft an aircraft oncarrier an aircraft carrier replace crews of up replace crews ofto upfive to fiveof up to five replace crews utopilot
ril 2001
December 2013 December 2013 December 2013
investigates US hearing investigates US hearing investigates rewed Global HawkUS hearing Hawk bal Hawk over-reliance whether over-reliance whether over-reliance ne flies ethe US m USfrom the USwhether is leading on on autopilot isautopilot leading is leading Australia top n-stop non-stop on autopilot
20 00 s
good for an airline’s bottom line, and the environment, could also benefit passengers by helping to keep seat prices down. And if pilotless planes can help reduce turnaround times between flights, they might go a little way towards reducing delays. Plane-makers could even rethink layouts. “Without the need to house pilots up front, there is no need to conform to current aircraft designs,” says Wilson. Losing the flight deck could offer passengers the views usually only enjoyed by pilots. Of course, the big concern with full automation is what happens if the systems fail and there is no on-board crew to take control. For example, it is unlikely that an AI “pilot” could ever match the bizarre-but-brilliant decision to ditch on the Hudson River, as Chesley Sullenberger did in January 2009, so preventing fatalities when his plane’s engines
July 2013 April 2014 December December 2013 2013 April 2001 April 2001 X47-B drone DARPA announces that the hearing investigates USUS hearing investigates Uncrewed Global Hawk Uncrewed Global Hawk makes the first In-Cockpit whether over-reliance over-reliance drone flies from drone flies from thethe USUSAircrew Laborwhether autonomous landing couldis leading autopilot is leading onon autopilot to Australia non-stop Automation System to Australia non-stop onwithout an aircraft carrier replace crewstoofairline to accidents five toupairline accidents without refuelling refuelling
4
19 90 s
19 80 s
19 70 s
19 60 s
19 50 s
0
SOURCE: PLANECRASHINFO.COM
Percentage
40
failed over New York City. Perhaps not, says Bryant Walker Smith, a lawyer who researches risk and technology at the University of South Carolina in Columbia, but airlines might be prepared to accept the risk of such freak accidents. “If automation eventually succeeds in reducing the number and severity of crashes and injuries, then even if manufacturers are liable in a greater share of crashes, their actual [risk] exposure might not be higher,” he says. But pilots are unlikely to let themselves be replaced by techology without a fight. “We will only be able to build resilient pilotless aircraft when we can replicate human consciousness, awareness and prediction in a machine,” says de Crespigny. “Until then it is pilots who have the only chance of saving people.” Richard Toomer, spokesman for the British Airline Pilots Association agrees: “Passengers want to know they are in the hands of two well-trained, well-rested pilots. We can’t see that changing anytime soon.” Yet with driverless cars expected on the roads soon, people may become more comfortable with the idea of fully automated vehicles – Cummings says she has seen some evidence of this in a recent survey. But she admits that many will be reluctant to accept pilotless planes. “Moving from two pilots to one will be easier than from one to zero,” she says: it’s a technological challenge that will face regulatory and cultural resistance too. The roots of that cultural resistance run deep, says Robert Bor, a clinical psychologist at the Royal Free Hospital in London, who specialises in aviation psychology. “It comes down to a primitive fear of not being in control.” Passengers like to see a capable person in charge of a plane – someone who has as much to lose as they do if things go wrong. And although pilots acknowledge that they are often simply monitoring automated systems, Bor argues that passengers still see them as “calm-under-stress, uniformed people who wrestle with the controls and battle against the odds on our behalf”. Cummings agrees. “The need to see a James T. Kirk on the bridge is strong,” she says. It will be up to the aviation industry to demonstrate equal or better safety levels than crewed planes, says Bor. So would he fly in a plane flown by machine? “I’d need clear evidence from extensive experiments showing it is safe,” he says. “But if I was told tomorrow I only have a ground pilot, I’d be troubled. I think it is going to be a hard sell.” n Paul Marks is senior technology correspondent at New Scientist 9 August 2014 | NewScientist | 33