(All of the commercial and general aviation aircraft currently in-flight in the United States.)

1. (All of the commercial and general aviation aircraft currently in-flight in the United States.)

2. MCI/KCI OKC DFW

3. Federal Aviation Administration What’s The Definition of Insanity? Julia Pounds Aerospace Human Factors Research Division FAA Civil Aerospace Medical Institute Presented at OKJDM April 28, 2007

4. Doing the same thing over and over and expecting different results. --Einstein

5. 1st A Little Background • When separation standards are violated due to an element of the ATC system, an operational error (OE) is recorded. • The FAA tracks the occurrence of OEs as an important metric for understanding trends in the National Airspace System (NAS). • Considerable organizational effort is directed toward reducing OEs (e.g., new automation & equipment, procedures, training approaches)

6. Example • Airborne flights • Radar control 4 1403:32 Separation was lost. Closest proximity was 600 feet vertically and 4.25 nautical miles laterally.

7. Example • Runway • Tower control

8. Background • An OE event triggers the FAA’s formal investigation process during which • The controller’s failure to maintain “situation awareness” is often discussed. • “Failure to detect” is a frequently recorded causal factor in the final report. • Recommendations can (and often do) include corrective training for operational personnel involved in the OE.

9. Background Recent FAA OE reduction initiatives have focused on: • Enhancing communication skills (e.g., ATC phraseology) • Improving position relief briefings • Reducing distractions • Factors related to a controller’s performance • Failure to detect displayed data • Failure to comprehend displayed data • Failure to project future status of displayed data

10. Background The FAA has a long history of training air traffic control specialists (ATCS) to maintain aircraft (A/C) separation. • Initial training • Recurrent training • Corrective training “The airport runway is the Most important mainstream In any town.” -Norm Crabtree

11. Considerations • Air traffic control performance requires cognitive resources to accomplish. It is primarily a thinking activity. • Air traffic control is a high consequence domain and thus requires expert performance levels. • Performance must be viewed as part of a complex web of human-in-the-loop systems. • Air traffic control can be viewed as a series of critical points that becomelinks in a chain of events.

12. Historically Preferred Approach TO PAY ATTENTION! Research Question What types of training were being assigned to controllers following an OE to • Improve thinking processes? • Maintain expert performance? • Aid performance in human-in-the-loop systems? • Break links in the chain of events?

13. Materials • FAA final reports for 752 OEs from January 2 to December 31,2003 (CY03) were obtained. • The text field containing training recommendations was extracted for each OE.

14. Procedures • An ATC subject matter expert identified every training item listed in each report. • Not included were associated items commonly done after in most OEs as routine procedure, e.g., having the controller • Complete an on-the-job training session with an instructor prior to returning to duty • Review of the voice tapes • Watch a re-creation of the event • Discuss the event with his/her supervisor

15. Example of Training Recommendations From a Final OE Report • Controller will be administered refresher training that will focus on duty priority, operational listening and remembering, improving scanning, and maintaining situational awareness. • Review the event playback and voice recording with the supervisor. • Review “Breaking the Chain” - the training video on reducing OEs • Complete refresher training on arrival and departure procedures • Complete computer-based instruction courses (CBI) for the following: • Situational awareness • ATC communications • ATC OE reduction • All operational supervisors in the facility will be required to review the CDR and voice recording and be briefed on the events that led to this OE.

16. RESULTS 3714 training recommendations were identified in the 752 OE reports. 47% - CBI programs (national or locally-developed) 43.9% - FAA Orders (employee reviews paragraphs of an Order pertaining to important aspects of the OE) 9.1% - Other (employee watched videos about a particular factor, such as “Breaking the Chain”, or watched traffic simulations, reviewed maps, etc.)

17. Discussion The results of this study supported employees’ anecdotes of a dependency on knowledge-based training strategies for controllers. ATC relies on highly skilled performance. A skill-based training paradigm is needed to supplement existing training programs and target skills that support strong controller performance.

18. Discussion • Beginning in 2002, the FAA developed, tested, and deployed the National Air Traffic Professionalism Program (NATPRO) • a skill-based program • integrates both knowledge-based and skill-based components • delivered using a Seminar-Practicum format • Yes, a skills training paradigm for controllers is possible

19. National Air Traffic Controller Professional Performance Program (NATPRO) • Series 1 (“Pay Attention!”) is currently used in all en route centers and being deployed to terminal facilities (towers and radar approach control facilities) • Topics include attention processes, concentration, and multitasking. • Series 2 (“Listen Up”) is currently being deployed to en route centers. • Topics target listening skills and readback/hearback processes between controllers and pilots.

20. Many Questions Remaining For both knowledge-based & skill-based training • Measurement: How to measure training effectiveness? • Individual behaviors: Does the training improve controllers’ operational performance? • System level: Does the training reduce OEs? • What other kinds of training are needed?

22. What’s The Definition of Insanity? Julia Pounds Aerospace Human Factors Research Division FAA Civil Aerospace Medical Institute Presented at OKJDM April 28, 2007