
Ensuring Safety During Transformative Changes
______
Committee on Emerging Trends in
Aviation Safety
Transportation Research Board
Consensus Study Report
Transportation Research Board Special Report 351
Subscriber Categories: Aviation; safety and human factors
Transportation Research Board publications are available by ordering individual publications directly from the TRB Business Office, through the Internet at www.TRB.org or nationalacademies.org/trb, or by annual subscription through organizational or individual affiliation with TRB. Affiliates and library subscribers are eligible for substantial discounts. For further information, contact the Transportation Research Board Business Office, 500 Fifth Street, NW, Washington, DC 20001 (telephone 202-334-3213; fax 202-334-2519; or e-mail TRBsales@nas.edu).
Copyright 2024 by the National Academy of Sciences. National Academies of Sciences, Engineering, and Medicine and National Academies Press and the graphical logos for each are all trademarks of the National Academy of Sciences. All rights reserved.
Printed in the United States of America.
This publication was reviewed by a group other than the authors according to the procedures approved by a Report Review Committee consisting of members of the National Academy of Sciences, the National Academy of Engineering, and the National Academy of Medicine.
This study was sponsored by the Federal Aviation Administration.
International Standard Book Number-13: 978-0-309-72100-4
International Standard Book Number-10: 0-309-72100-8
Digital Object Identifier: http://doi.org/10.17226/27805
The National Academy of Sciences was established in 1863 by an Act of Congress, signed by President Lincoln, as a private, nongovernmental institution to advise the nation on issues related to science and technology. Members are elected by their peers for outstanding contributions to research. Dr. Marcia McNutt is president.
The National Academy of Engineering was established in 1964 under the charter of the National Academy of Sciences to bring the practices of engineering to advising the nation. Members are elected by their peers for extraordinary contributions to engineering. Dr. John L. Anderson is president.
The National Academy of Medicine (formerly the Institute of Medicine) was established in 1970 under the charter of the National Academy of Sciences to advise the nation on medical and health issues. Members are elected by their peers for distinguished contributions to medicine and health. Dr. Victor J. Dzau is president.
The three Academies work together as the National Academies of Sciences, Engineering, and Medicine to provide independent, objective analysis and advice to the nation and conduct other activities to solve complex problems and inform public policy decisions. The National Academies also encourage education and research, recognize outstanding contributions to knowledge, and increase public understanding in matters of science, engineering, and medicine.
Learn more about the National Academies of Sciences, Engineering, and Medicine at www.nationalacademies.org.
The Transportation Research Board is one of seven major program divisions of the National Academies of Sciences, Engineering, and Medicine. The mission of the Transportation Research Board is to mobilize expertise, experience, and knowledge to anticipate and solve complex transportation-related challenges. The Board’s varied activities annually engage about 8,500 engineers, scientists, and other transportation researchers and practitioners from the public and private sectors and academia, all of whom contribute their expertise in the public interest. The program is supported by state departments of transportation, federal agencies including the component administrations of the U.S. Department of Transportation, and other organizations and individuals interested in the development of transportation.
Learn more about the Transportation Research Board at www.trb.org.
Consensus Study Reports published by the National Academies of Sciences, Engineering, and Medicine document the evidence-based consensus on the study’s statement of task by an authoring committee of experts. Reports typically include findings, conclusions, and recommendations based on information gathered by the committee and the committee’s deliberations. Each report has been subjected to a rigorous and independent peer-review process and it represents the position of the National Academies on the statement of task.
Proceedings published by the National Academies of Sciences, Engineering, and Medicine chronicle the presentations and discussions at a workshop, symposium, or other event convened by the National Academies. The statements and opinions contained in proceedings are those of the participants and are not endorsed by other participants, the planning committee, or the National Academies.
Rapid Expert Consultations published by the National Academies of Sciences, Engineering, and Medicine are authored by subject-matter experts on narrowly focused topics that can be supported by a body of evidence. The discussions contained in rapid expert consultations are considered those of the authors and do not contain policy recommendations. Rapid expert consultations are reviewed by the institution before release.
For information about other products and activities of the National Academies, please visit www.nationalacademies.org/about/whatwedo.
AMY R. PRITCHETT (Chair), The Pennsylvania State University
CODY H. FLEMING, Iowa State University
R. JOHN HANSMAN, JR., Massachusetts Institute of Technology
CHRISTOPHER A. HART, Hart Solutions LLC
MARGARET T. JENNY, MJENNY STRATEGIES, LLC
PAUL MCCARTHY, PEEMAC, LLC
WILLIAM B. ROUSE, Curis Meditor, LLC
NADINE B. SARTER, University of Michigan
ASHOK N. SRIVASTAVA, Intuit
KATHLEEN M. SUTCLIFFE, Johns Hopkins University
ALYSON G. WILSON, North Carolina State University
LIDA BENINSON, Study Director, Consensus and Advisory Studies, Transportation Research Board
STEPHEN GODWIN, Scholar, Consensus and Advisory Studies, Transportation Research Board
THOMAS R. MENZIES, JR., Director, Consensus and Advisory Studies, Transportation Research Board
DYLAN REBSTOCK, Program Officer, Consensus and Advisory Studies, Transportation Research Board
DANIEL TALMAGE, Program Officer, Board on Human-Systems Integration, Division of Behavioral and Social Sciences and Education
CLAUDIA SAULS, Program Coordinator, Consensus and Advisory Studies, Transportation Research Board
TIMOTHY MARFLAK, Program Coordinator, Consensus and Advisory Studies, Transportation Research Board
This page intentionally left blank.
This Consensus Study Report was reviewed in draft form by individuals chosen for their diverse perspectives and technical expertise. The purpose of this independent review is to provide candid and critical comments that will assist the National Academies of Sciences, Engineering, and Medicine in making each published report as sound as possible and to ensure that it meets the institutional standards for quality, objectivity, evidence, and responsiveness to the study charge. The review comments and draft manuscript remain confidential to protect the integrity of the deliberative process.
We thank the following individuals for their review of this report:
JANE GARVEY, Federal Aviation Administration (retired)
VALERIE MANNING, Independent Consultant
KAREN MARAIS, Purdue University
SUPRIYA MUNSHAW, Johns Hopkins University
EMILIE ROTH, Roth Cognitive Engineering
TIMOTHY VOGUS, Vanderbilt University
JAMES WILLIAMS, JHW Unmanned Solutions LLC
Although the reviewers listed above provided many constructive comments and suggestions, they were not asked to endorse the conclusions or recommendations of this report, nor did they see the final draft before its release. The review of this report was overseen by CHRIS HENDRICKSON
(NAE), Carnegie Mellon University, and CRAIG PHILIP (NAE), Vanderbilt University. They were responsible for making certain that an independent examination of this report was carried out in accordance with the standards of the National Academies and that all review comments were carefully considered. Responsibility for the final content rests entirely with the authoring committee and the National Academies.
The committee appreciates the support of the Federal Aviation Administration (FAA) staff in providing background information related to the Commercial Aviation Safety Team, the Aviation Safety Information Analysis and Sharing program, and the Annual Safety Culture Survey.
This report was developed under the overall supervision of Thomas R. Menzies, Jr., Director of Consensus and Advisory Studies, Transportation Research Board (TRB). Lida Beninson, Senior Program Officer, TRB, served as the study director. She and Stephen Godwin, Scholar, TRB, assisted the study committee in the preparation of this report. Dylan Rebstock provided support for report development. Daniel Talmage provided liaison with the National Academies of Sciences, Engineering, and Medicine’s Board on Human-Systems Integration. Claudia Sauls and Timothy Marflak of TRB provided support to the committee in arranging meetings.
The committee would like to thank the following individuals for providing input to this study:
ANGELA O. ANDERSON, FAA-ARM
MARK FLEMING, Saint Mary’s University
DAVID HEMPE, FAA-AIR
KYLIE KEY, FAA-Civil Aerospace Medical Institute
GENOVEVA MARTIN, FAA-Accident Investigation and Prevention
KATHERINE MURPHY, FAA-Accident Investigation and Prevention
KIMBERLY PYLE, FAA-Accident Investigation and Prevention
WARREN RANDOLPH, FAA
ROBERT RUIZ, FAA-AFS
JEFFERY SCHROEDER, FAA
JEFFREY VINCENT, FAA-AUS
JAMES WILLIAMS, JHW Unmanned Solutions LLC
The committee would like to acknowledge the work of the consultants from The Aerospace Corporation who have supported the workshops efforts for this report: Kara Cunzeman, Paul Frakes, Sarah Georgin, Catrina Melograna, Jeffrey Parr, and Paula Pool.
3 INTEGRATED SAFETY MANAGEMENT ACROSS THE LIFECYCLE AND ACROSS ORGANIZATIONS
Review of Current Processes for Safety Assurance
Status of the Office of Aviation Safety’s Safety Culture Assessment
Maturing Safety Culture Across the Industry
5 INTEGRATED SAFETY MANAGEMENT ACROSS THE LIFECYCLE AND ACROSS ORGANIZATIONS
The Overarching Finding: New Concerns Always Emerge
Gaps in the State of the Art on Aviation Safety Management
2-1 Aircraft Safety-Critical Functions
4-1 Hypothesized Dimensions of Regulator Safety Culture
A-2 Exact Phraseology for an Air Traffic Control Clearance to Conduct an Instrument Approach
2-1 Layers of defense in current air traffic safety, and the assumptions they are built on
I write this preface from the 2024 Experimental Aircraft Association Air Venture gathering in Oshkosh, Wisconsin, a great annual event in aviation. I am struck here by the dichotomy it captures—the value of historical experience (as the old guard shares with the new all their insights on the classic technologies underlying so much of present-day aviation) juxtaposed with the spirit of innovation (shown by all the new things being demonstrated overhead as I type).
This report is written within this tension between the security of the known and the potential for innovation. In the closing chapter of our first report (NASEM, 2022), our committee identified several major potential sources of stress on commercial aviation safety, presenting both challenges and opportunities. These include new technologies, new business models, and new entrants who are not steeped in the same knowledge and culture underlying aviation safety.
Our focus in this report is on transformative changes to technology and operations, which we define as those representing such a step-change that current methods for assessing and managing safety cannot be simply tweaked or extrapolated. We stepped back to examine how and where safety of transformative changes can and needs to be addressed, using the existing safety management principles recommended by the International Civil Aviation Organization as a framework. This framework includes (1) the safety-risk management inherent to designing, evaluating, certifying, and approving new technologies and operations; (2) the safety assurance process of continually monitoring operations for any possible safety
concern; and (3) the aspects of organizational structure and culture that can drive an organization’s ability to support safety in all its aspects.
To learn from the community, we held two workshops that engaged representatives of the Federal Aviation Administration (FAA), those proposing transformative changes to technology and operations, and the aviation safety community. The agendas of these workshops appear in Appendix B. We continued our efforts by engaging with current and former representatives of FAA and experts in safety culture.
Finally, we are grateful for the comments of independent peer reviewers and their perspectives and improvements to the report, whose names were unknown to the committee during the review process.
Amy R. Pritchett, Chair
Committee on Emerging Trends in Aviation Safety
NASEM (National Academies of Sciences, Engineering, and Medicine). 2022. Emerging Hazards in Commercial Aviation—Report 1: Initial Assessment of Safety Data and Analysis Processes. Washington, DC: The National Academies Press. https://doi.org/10.17226/26673.
| AAM | advanced air mobility |
| ADS-B | Automatic Dependent Surveillance-Broadcast |
| AIM | Aeronautical Information Manual |
| AIS | autonomous and intelligent system |
| ARC | Aviation Rulemaking Committee |
| ASIAS | Aviation Safety Information Analysis and Sharing |
| ASRS | Aviation Safety Reporting System |
| ASTM | American Society for Testing and Materials |
| ATO | Air Traffic Organization |
| AVS | Office of Aviation Safety (FAA) |
| BVLOS | Beyond Visual Line of Sight |
| CAST | Commercial Aviation Safety Team |
| CFR | Code of Federal Regulations |
| DA/DH | decision altitude or decision height |
| DAA | Detect and Avoid |
| EFVS | enhanced flight vision systems |
| FAA | Federal Aviation Administration |
| FAR | Federal Aviation Regulation |
| FDM | Flight Data Monitoring |
| FOQA | Flight Operations Quality Assurance |
| GPA | glide path angle |
| GPS/GLONASS | Global Positioning System/Globalnaya Navigatsionnaya Sputnikovaya Sistema |
| IAEA | International Atomic Energy Agency |
| IFP | instrument flight procedure |
| IFR | Instrument Flight Rules |
| ILS | Instrument Landing System |
| INS | Inertial Navigation System |
| JO | Job Order |
| LORAN | long range navigation |
| LOSA | Line Operations Safety Audit1 |
| MASPS | Minimum Aviation System Performance Standards |
| MOPS | Minimal Operational Performance Standard |
| MPS | minimum performance standard |
| MRO | maintenance, repair, and overhaul |
| NAS | National Airspace System |
| NASA | National Aeronautics and Space Administration |
| NEA | Nuclear Energy Agency |
| NISA | Nuclear and Industrial Safety Agency |
| NTSB | National Transportation Safety Board |
| OCI | Organizational Culture Inventory |
| ODA | Organizational Designation Authorization |
| OEM | original equipment manufacturer |
| OIG | Office of Inspector General |
| OSED | Operational Services and Environment Definition |
| PMA | Parts Manufacturer Approval |
| RNP | Required Navigation Performance |
| RTCA | Radio Technical Commission for Aeronautics (a standards body now known by its acronym) |
| RVR | runway visibility range |
___________________
1 LOSA is referred to as “Line Operation Safety Assessment” in some documents by the Federal Aviation Administration.
| SA | safety assurance |
| SAS | Safety Assurance System |
| SMICG | Safety Management International Collaboration Group |
| SMS | safety management system |
| SRM | safety risk management |
| STC | Supplemental Type Certification |
| sUAS | small unmanned aerial system |
| TERPS | Terminal Instrument Procedures |
| TSO | Technical Standard Order |
| UAS | unmanned aircraft system |
| UN | United Nations |
| VLOS | Visual Line of Sight |
| VSRP | voluntary safety reporting program |
This page intentionally left blank.