Data-Driven Decision Making: September/October 2020
Data-Driven Decision Making: September/October 2020
Data-Driven
Decision Making
U.S. Department
of Transportation
Federal Aviation
Administration
ISSN: 1057-9648
FAA Safety Briefing
September/October 2020
Volume 59/Number 5
The September/October 2020 issue of FAA Safety Briefing
focuses on the integral role of data in the aviation indus-
Elaine L. Chao Secretary of Transportation try. Feature articles and departments explore the many
Steve Dickson Administrator ways data is collected, analyzed, and shared to make
Ali Bahrami Associate Administrator for Aviation Safety better and more informed safety-related decisions. We’ll
Rick Domingo Executive Director, Flight Standards Service also look at some of the FAA’s collaborative processes and
Susan K. Parson Editor
tools that are helping to improve safety and efficiency in
Tom Hoffmann Managing Editor
the National Airspace System.
James Williams Associate Editor / Photo Editor
Jennifer Caron Copy Editor / Quality Assurance Lead
Paul Cianciolo Associate Editor / Social Media
Jamie Harvey Art Director
7
Show Me the Data! A Look at Data Sharing and Analysis in Aviation Safety
27 Flight Forum: letters from the
Safety Briefing mailbag
Big Data, Little Team How You Benefit from the FAA’s Surface Safety Metric
16
Rise to the Top A Look at Frequent Accident Issues for Balloonists
19
September/October 2020 1
JUMPSEAT RICK DOMINGO, FLIGHT STANDARDS SERVICE EXECUTIVE DIRECTOR
TRANSFORMATION TO INFORMATION
We must continue leaning coordinates is data, but it’s not terri- set of lat/long coordinates isn’t very
into our role as a data-driven, bly useful by itself. In the context of helpful. While it does specify where
risk-based decision-making a chart or a moving map navigator, you are, you need a lot more data
oversight organization that though, the latitude and longitude in the form of lots more lat/long
prioritizes safety above all else. data becomes information. It denotes coordinates to pinpoint not only the
a specific point in space that might be destination, but also the path that
— Steve Dickson a named waypoint (hopefully with a will get you there. In the same vein,
FAA Administrator name that is easy to pronounce). a single set of data — or a small set
Using the latitude/longitude exam- of data — isn’t terribly conducive to
Data. It’s a (deceptively) simple ple lets me make a couple of import- driving solid information and sound
four-letter word. We can probably ant points about data and informa- decisions. That’s why several of the
all agree that it’s important; after all, tion, ideas that are threaded through articles in this issue emphasize and
the team chose data as the organizing the articles in this issue of FAA Safety re-emphasize the need for more data.
theme for this issue of FAA Safety Briefing magazine. First is the “gar- We all want to see the GA accident
Briefing magazine. It’s a word that we bage in, garbage out” idea. Even the and incident rates decrease, and
use all the time, not just in aviation, tiniest-appearing mistake in latitude/ data is key to figuring out where the
but in pretty much every aspect of longitude data can have huge adverse hazards are, and what mitigations
modern life. If I asked you to tell me consequences. I can recall at least two we can take to eliminate them. So
what it means, no doubt you could aviation accidents in which lat/long it’s great to see how the FAA Safety
quickly offer a reasonable definition. data errors played a role in the tragic Team (FAASTeam) is using the new
Like a lot of commonly used outcome. Incorrect data inevitably FAASTeam Data Analysis Tool, or
four-letter words, though, the word skews the information and decisions FATDAT, the subject of one of this
“data” has become something of that arise from it. The point is clear: issue’s features, to gather more data
an abstraction. We think we know in any technical field, but especially in and — important — to transform
what it is, but overuse has possibly one as complex as aviation, it’s critical that data into information we can all
muddied its meaning. For example, I to get — and use — correct data. use to improve safety. You’ll also see
suspect that many of us think “data” several other examples of how greater
and “information” are just two words More is Better (in both senses of the term) data is
for the same thing, and we use them Here’s the second important idea. leading to greater safety information.
interchangeably. Certainly the two If you want to take a trip, a single Read on for more!
terms are related, but they are still
quite different.
SAFETY ENHANCEMENT TOPICS Please visit bit.ly/GAFactSheets for more information on these and other topics.
SEPTEMBER OCTOBER
Preflight After Maintenance Pilots and Medications
What items should you focus Learn more about the
on and/or add to your preflight possible side effects of
inspection checklist after medications (prescribed or
maintenance? over-the-counter) and whether
they may be hazardous to
flight operations.
September/October 2020 3
ATIS
knowledge and skills. Experienced personnel could mistake DEF for Fuel continue improving GA safety. The
aviation instructors will also find System Icing Inhibitor (FSII) and add library uses three different "perspec-
the updated information useful for it to the FSII storage tanks on mobile tives" to arrange the accidents and
improving their effectiveness in train- refuelers. DEF and FSII are both clear, illustrate the complex interrelation-
ing activities. Go to bit.ly/FAAbooks colorless liquids and if DEF is mis- ship of accident causes. Each accident
to download the new handbook. takenly added to a FSII storage tank, contains at least one high-level lesson
contamination can be very difficult, if related to a threat element, and at least
Check Your Fuel not impossible to detect. one lesson related to a theme element.
A couple of years ago, more than a For more information, download the See this issue’s Angle of Attack
dozen aircraft fuel systems were con- Safety Alert for Operators (SAFO) at department and go to
taminated when Diesel Exhaust Fluid bit.ly/SAFO18015. LessonsLearned.FAA.gov to learn more.
(DEF) was added instead of deicing
fluid. Fixed base operators (FBOs) Lessons Learned Library Now
and aircraft operators must be diligent Includes GA and Rotorcraft
in ensuring that staff are properly The FAA’s Accidents Lessons
trained, and that employees follow Learned Library has new
company policies and procedures to materials, and is now orga-
prevent DEF or other contamination. nized into three sections:
DEF is a urea and water-based small airplane, transport
fluid. Federal regulations require its airplane, and rotorcraft.
use in the emission reduction systems The purpose of expanding
of modern diesel engine vehicles. the library to include gen-
DEF is not a fuel additive, aviation eral aviation (GA) lessons
or otherwise. It is a clear liquid that learned is to capture infor-
is stored in a specialized tank on the mation related to selected
chassis of diesel engine vehicles and accidents that contain key
injected into engine exhaust to reduce safety information, including
noxious emissions. Flight line service resulting actions taken to
*Please refer to 14 CFR 91.225(d) & (e) for specific exemptions and airspace limitations.
NOW PLAYING
CONDITION INSPECTION LEO M. HATTRUP, M.D., FAA MEDICAL OFFICER
W
hen you think about it, we use data every day. we need to understand what people are seeing, learn
Whether it’s studying the latest weather maps to from each other, and adapt.
decide if we’re going to fly, or reading product Truly integrated data and collaboration, more commonly
reviews to guide our online purchases, or navigating with known as data fusion, is playing an increasingly import-
GPS to find the best way to get from point A to point B, ant role in improving aviation safety. Data fusion delivers
data is a key factor that influences many of our routine insight and innovation from multiple data sources and
choices. In fact, data is critical to helping us make better, gives safety teams a better
more informed decisions about practically anything in our To improve opportunity to understand
day-to-day lives.
When it comes to aviation, data makes its way into the
safety we need the full context of events
when incidents and acci-
tools you rely on in the cockpit every time you fly. Avionics to understand dents occur. Using shared
manufacturers turn the raw data from navigational charts what people data, the safety teams work
and instrument approaches that the FAA produces into are seeing, together to identify risk,
a wide variety of electronic products that feed into flight spot trends and causal
management systems, iPads, and mobile devices and give learn from factors, and develop safety
pilots greater situational awareness. each other, strategies to mitigate risk
But data is not only beneficial when it’s individually and adapt. before they lead to serious
consumed. It is even more valuable when it is shared. events or loss of life. Best
Whether from person to person or throughout the practices and lessons
broader community, the more information or data you learned are continuously shared to evaluate progress and
share, the more decisions you influence, the more value identify areas to improve.
you provide, and the more people you can help. Data This issue of FAA Safety Briefing is dedicated to the
sharing means collaboration and communication with importance of data in the aviation community and the
the aviation community, and these are key factors that many ways that data is collected, analyzed, and shared to
help the general aviation (GA) community and the FAA make better, more informed decisions, with the ultimate
make important safety decisions to improve processes goal to improve safety and efficiency in the aviation
and prevent accidents and incidents. To improve safety industry. So let’s have a look at some of the ways the FAA
September/October 2020 7
and industry partners are working together to develop Until recently, most GA pilots had no means of shar-
innovative approaches for analyzing data. ing FOQA or ASAP-like data to ASIAS because there
were no systems available to capture and store GA data.
There’s an App for That GA pilots primarily relied on the Aviation Safety Report-
These days, data sharing is fast, easy, and convenient. You ing System (ASRS) to report safety hazards. While ASRS
can even monitor your own personal data, thanks to move- continues to be an essential safety reporting mechanism,
ment-based wearables like a Garmin® or a Fitbit® to track we needed to find a way for GA data to be shared with
calories burned, monitor sleep habits, and see how many ASIAS. To meet this need, the FAA, academia, and indus-
steps you’ve taken during the day. Your data syncs seam- try created the National General Aviation Flight Infor-
lessly to data tracking apps so you can pinpoint areas for mation Database (NGAFID).
improvement to help you reach your fitness goals. The NGAFID allows GA pilots to analyze and share
Modern avionics have made the collection of flight their flight data in two ways. First, operators equipped with
data and flight performance analysis just as accessible. Air avionics capable of recording flight data, such as a Garmin
carriers are leveraging voluntary safety reporting programs, G-1000, can upload flight and engine data anonymously
such as the Flight Operational Quality Assurance (FOQA), into NGAFID. Devices that record flight data offer an easy,
to capture and analyze flight data to identify safety risks and free way for pilots to visually analyze flight perfor-
and trends without fear of reprisal. Lessons learned from mance for trends and changes over time to improve their
these programs are shared at industry-sponsored and flying. Second, pilots can share their data with NGAFID
FAA-facilitated events like InfoShare. The event brings from a smart phone/tablet using the General Aviation Air-
together safety professionals from across the aviation borne Recording Device, or GAARD™, mobile app. ASIAS
community in a protected environment to share safety developed the GAARD app with the MITRE Corporation
concerns, lessons learned, and best practices. Over the last to help GA pilots understand how they are flying and
few years, the GA, university, and broader flight training provide a way to collect
communities have developed successful InfoShare events. With the GAARD and upload de-iden-
ASIAS, the Aviation Safety Information Analysis and Shar- tified aircraft perfor-
ing system, is another safety initiative that brings de-identi- app, pilots can mance data directly into
fied data from voluntary programs, like FOQA, the Avi- share their data NGAFID, which also
ation Safety Action Program (ASAP), and the Air Traffic from a smart feeds the ASIAS data-
Safety Action Program (ATSAP), and fuses it together
phone or tablet. base. All data collected
from onboard avionics, a
to help form a complete picture of risks in the National
Airspace System (NAS). This data is leveraged by the Flight Data Monitoring
Commercial Aviation Safety Team (CAST) and the General (FDM) recorder, or the GAARD app is anonymous and
Aviation Joint Steering Committee (GAJSC) to monitor de-identified so pilots can share their data without any
risks in the system and to proactively mitigate those risks fear of reporting or reprisal. ASIAS leverages thousands of
before they lead to serious incidents and accidents. de-identified flights to help spot trends, such as excessive
Jennifer Caron is FAA Safety Briefing’s copy editor and quality assurance lead. She is a
certified technical writer-editor in aviation safety and flight standards.
September/October 2020 9
Driven By Data
How the FAA Safety Team Leverages
Data to Improve GA Safety
By Tom Hoffmann
FAA photo by Bryan Dahlvang
A
s a reader of this magazine, you’ve no doubt partic- Safety Liaison Team Lead Charlie Hamilton was chosen
ipated in a few (hopefully many!) FAA Safety Team to spearhead these efforts. With Charlie in the left seat, a
(FAASTeam) hosted seminars or webinars over the crew comprising FAA operational research analysts (Wade
years. Or perhaps you’ve caught wind of a new procedure Weisenburger, Brad Billheimer, and Chad Porter), and a
or best practice to improve safety at your local airport. The small FPM beta test group (Jay Flowers, Lance Little, Dr.
FAASTeam Program Managers (FPMs) and Representatives Paul Foster, and Ryan Newman) was able to launch the new
throughout the country do their very best to relay engag- FAASTeam Data Analysis Tool, more affectionately known
ing, timely, and relevant information to their stakeholders, as the FATDAT, in just over a year.
whether it focuses on the type of flying you do in your local “We had been trying to get a data analysis program for
area, or is based on “big-picture” nationwide accident trends. the FPMs for many years,” says Charlie. Using different
To do this, FPMs endeavor to keep their fingers on the types of programs, FPMs in the past had to work inde-
pulse of GA activities by monitoring data on both a local pendently and spend hours manually crunching numbers
and national level. The goal is to enable a proactive focus for their regions. Since FPMs are not trained as data ana-
on problem areas. That’s easier said than done, especially lysts, these methods didn’t produce results consistent with
given the veritable firehose streams of data springing from the FAASTeam’s national work program.
various sources and directions. Realizing the need for
a more streamlined source of data to help FPMs better Every “Bit” Counts
inform the community and direct more effective accident Key to the success of FATDAT is its ability to easily consol-
mitigation strategies, the FAASTeam has developed a new idate critical safety data into one central repository. It pulls
tool to do just that — FATDAT. in data from three locations: the NTSB aviation accident
database, the FAA’s Accident and Incident Data System
FATDAT — What’s That? (AIDS), and pilot deviation (PD) data from the FAA’s Air
National FAASTeam Manager Valerie Palazzolo was among Traffic Quality Assurance (ATQA) database.
the first to recognize the need for a more efficient data Coordinating this data was no easy task since databases
analysis tool for FPMs, and so under her direction in 2018, don’t all speak the same language. In fact, the team is still
the team initiated production of a new tool. FAASTeam working to import data from another FAA Air Traffic
source to better complement PD data. During devel- easier to develop a risk management strategy,” says Jay
opment, the FATDAT team also had to contend with Flowers, National FAASTeam Aviation Safety Inspector.
taxonomy variations within the data. Challenges notwith- As a former FPM, Jay recalls using the tool to develop a
standing, the tool has proven successful in harmonizing mitigation strategy that successfully helped reduce the
different data sets and giving FPMs a more robust look risk of PDs for students
at aviation activity in their areas of responsibility. Filters in the University of
Key to the North Dakota’s (UND)
within FATDAT provide even greater fidelity, allowing
FPMs to sort data by date, time, airport, phase of flight, success of the flight program. FATDAT
aircraft type, operating rules, and much more. This high- FATDAT is its helped flag a pattern
lights another main advantage of FATDAT — making it ability to easily of PDs that occurred
easier to work with the data. “No more having to build pie with two person crews,
charts,” remarks Charlie, “the tool does it for you.”
consolidate specifically when an
Houston-based FPM Lance Little can directly attest to critical safety instructor and a cer-
FATDAT’s ease of use and efficiency, especially its ability to data into tificated pilot were on
board. In probing UND’s
filter data by field office. “I used to ‘hand hack’ accident data one central curriculum, Jay discov-
for the entire state of Texas, then separate my data from the
other three field offices,” says Lance. That once labor inten- repository. ered that crew resource
sive practice now takes him only a fraction of the time. management (CRM)
courses were not empha-
Big Data, Meet FATDAT sized until the very end of their program. His advocacy to
Since FATDAT came online in June 2019, this widely- place CRM coursework at the beginning of their curricu-
embraced tool has enabled new ways of looking at lum ultimately led to a reduction in these specific PDs.
mitigation strategies. “FATDAT helps you look at safety Jay’s expertise with FATDAT, along with his skill at
issues on a large scale, and in a manner that makes it developing an instruction manual, led him to becoming
September/October 2020 11
the current project lead. He adds that in addition to helping
find and fix risk areas, FATDAT helps FPMs keep local
Flight Standards District Office personnel abreast of safety
issues via quarterly briefings and an annual report. These
help drive local funding and resource allocation to better
focus on specific needs. In addition, the detail contained in
the annual reports is especially useful at the local Runway
Safety Action Team (RSAT) meetings (held annually at all
U.S. towered airports) to inform NAS users of any trends in
their local flying areas. Contact your local Runway Safety The FATDAT helps
Program Manager for more on RSAT meetings FPMs keep local
Flight Standards
(faa.gov/airports/runway_safety/regions).
District Office
personnel
May I Suggest a Side of Runway Safety with Your Webinar? abreast of safety
So what’s in it for you? FATDAT may seem like inside base- issues via quar-
terly briefings
ball, but it can have a direct impact on your safety. FPMs and an annual
and FAASTeam Reps now use this information to fine tune report (pictured
their focus on issues and solutions that directly matter to here).
you. It’s about providing the right information, to the right
single engine land, in the Colorado area, and data indi-
people, at the right time. But wait, it gets better!
cates an increased risk for controlled flight into terrain
Where the proverbial bias-ply high-tech rubber com-
(CFIT) accidents in that area, your MyWINGS page might
pound meets the road is what I’m about to tell you, so hold
automatically suggest a course or flight activity on moun-
on to your yokes. As I write, a team of experts is diligently
tain flying and/or night flying. The system may also alert
working to completely revamp the FAASTeam website,
you to a mechanical issue with your particular aircraft
FAASafety.gov. Along with efforts to improve user-friend-
make and model based on incoming data from SDRs.
liness and incorporate mobile phone platforms is a rather
With these enhancements, the sky’s the limit for devel-
innovative approach to better data integration. The aim
oping more robust and proactive GA accident mitigation
is to link up several different data sets well beyond what
strategies for both trainers and trainees.
FATDAT currently uses, including but not limited to the
FAA’s Safety Assurance System (SAS), the Airmen and
Delivering With Data
Aircraft Registries, the Service Difficulty Reporting System
(SDR), and the Aviation Safety Reporting System (ASRS, It remains to be seen how these updates to FAASafety.gov
aka NASA Forms). will impact FATDAT going forward. According to National
Using an advanced artificial intelligence (AI) system, FAASTeam Outreach Manager Brad Wood, “there is still
the enhanced site will be able to “learn” from all these data a lot of good value the tool can provide, particularly with
sources and identify what training airmen might need. This visual representations of safety data.” Jay and Brad have
behind-the-scenes trend teamed up to boost the reporting power of FAASafety.gov
analysis will also inform and will work towards a solution that best fits the needs of
FATDAT has the FPM and Reps, as well as individual airmen.
FPMs and FSDOs on
enabled new what type of training will As for the timeframe, the advanced analytics and AI
ways of looking benefit a particular area functionality of the site will likely take about a year to com-
plete. However, be on the lookout for a Phase I launch of
at mitigation or user group. For exam-
FAASafety.gov in late September 2020 that will debut some
ple, data sources may
strategies. indicate a rise in weath- key look and feel enhancements to improve user experience.
er-related accidents in “We’re excited about the potential for FATDAT and our
the Northwest area of the U.S. The AI system would then revamped FAASafety.gov website to really move the needle
be able to make specific weather training recommendations on GA safety,” says National FAASTeam Operations Lead
for pilots in that area, and prompt the FAASTeam to con- Kevin Clover. “Both tools will leverage vast amounts of
sider increasing or augmenting existing training to cover data more efficiently, and in a way that better aligns with
these weather-related causal factors. our risk-based strategies for education and outreach.” Stay
The information an airman receives from the enhanced tuned for more information in future issues!
site will be based on the user’s profile settings and prefer-
Tom Hoffmann is the managing editor of FAA Safety Briefing. He is a commercial
ences. If your account shows that you are a private pilot,
pilot and holds an A&P certificate.
T
he search for the missing link in human evolution was programs to collect flight data, to include Flight Data
one of the most well-known and yet least remembered Monitoring (FDM) or Flight Operations Quality Assurance
events of history. One hundred years later, the phrase (FOQA) programs that provide a conduit to this data.
conjures mental images of dry text books and dust covered
skeletons. What actually happened was a story of intense Making It a Million
competition, worldwide adventures, and even scandal (see Adding GA was the obvious next step, but it presented a
Piltdown Man). Researchers in the late 19th and early 20th number of challenges. One was the fact that GA, depend-
century were frantically searching for a transitional form ing on destinations operators may be flying to interna-
that would connect humans with our simian ancestors at a tionally, may not be subject to data collection require-
time when many people didn’t agree on such an idea. ments. Compounding that issue is the operating reality.
After a century of reflection, we now know that there The air carrier world has a limited number of participants
wasn’t a missing link, but several. In fact, the entire construct operating in a largely similar way. GA has a much larger
of a linear ladder of evolution turned out to be a misinter- number of participants who operate in a massively wider
pretation caused by a lack of fossil records. The more we set of circumstances.
uncovered, the more we learned. The task was enormous, but as the famous Chinese prov-
How we think about our safety in the air can work the erb says, the journey of 1,000 miles starts with a single step.
same way. When we only have a small amount of data, For the FAA, that step happened in 2015 with a project based
we can only see a limited number of solutions. That’s why in Phoenix, Ariz. Phoenix provided a robust and diverse test
the FAA and the general aviation (GA) community have bed for a GA ASIAS implementation. “We wanted to demon-
been working towards data sharing. As we’ve previously strate how ASIAS could help the community,” said Corey
reported, earlier efforts led to establishing the Aviation Stephens, an operational research analyst in the FAA’s Office
Safety Information Analysis and Sharing (ASIAS) sys- of Accident Investigation and Prevention.
tem. Using a massive quantity of voluntarily-reported This touches on another issue the FAA faced with
data together with other data sources, ASIAS created a attempting to incorporate GA into an FDM program;
warehouse for safety analysts to find problems and facil- what’s in it for me (WIIFM)? “We wanted to demonstrate
itate solutions. Initially, ASIAS focused on air carrier how ASIAS could help the community,” said Stephens.
data mostly because many air carriers have implemented So the FAA turned to flight training organizations like
September/October 2020 13
the University of North Dakota, which had already estab-
lished FDM programs and staff who understood systems
like ASIAS and the benefits they could provide. Working
with these partners and the MITRE Corporation, the FAA
created a framework to allow collection of this data. The
strong desire to open FDM to the widest possible audience
led to the creation of the National General Aviation Flight
Information Database (NGAFID).
This GA-focused FDM effort has been very successful.
GA participation in ASIAS has grown since the effort began
in 2013. To date, 118 business operators have joined ASIAS,
primarily made up of business jets with traditional FDM An example of NGAFID data showing exceedances during a flight.
programs. The NGAFID allows those aircraft not equipped
to participate in those types of programs. Currently, 13
universities and flight training institutions make up the vast
majority of the data in the NGAFID. In a few short years,
this still expanding group has amassed more than 1,000,000
flight hours of recorded data. That’s a major milestone. As
discussed in previous issues, (most recently, “Welcome to the
Information Age,” Nov/Dec 2019, p. 18 at bit.ly/SBNov19)
data compounds into information, and the more data you
have, the better your information.
But there’s been a clear missing link from the NGAFID.
You, the typical GA pilot, haven’t really been a factor in the
NGAFID. Only about 200 non-business or university-related Here is an example of the new Turn to Final Analysis tool, an enhancement added with
individuals have contributed. So how do we fill that gap? NGAFID 2.0. It allows users to clearly see which turns indicate a high probability of a
loss of control situation over a select period of time.
WIIFM?
NGAFID 2.0 also offers some interesting options to
First and foremost, contributing to the NGAFID helps col-
“see” your flights. You can have them plotted on a street
laborative government and industry safety teams discover
map, a sectional, a satellite view, and even Google Earth.
risks and develop more effective safety interventions based
You can recreate flights using commercially available
on actual data. For the individual pilot, NGAFID allows
software that allows you to animate from multiple view-
you to track your own flight activity and analyze your own
points (e.g., in the cockpit, a chase view, etc.). This review
data. Part of the FAA/industry push to make FDM even
capacity can also be really helpful in detecting subtle
more valuable is NGAFID 2.0. Much of the upgrade work
trends that can be hard to spot as they happen. Approach
focused on behind-the-scenes fixes to make NGAFID work
or departure speed is an example. You might be increas-
better. You might not immediately notice, but they allow
ing your approach speed by just a knot or two per week
for a better overall user experience and the potential for
(or the converse on your departure), but after a few weeks
enhancements down the line.
this habit could lead to an unstable approach. NGAFID
What this means for you is that detailed analysis and
lets you look back to search for the root cause. These are
review of your flights is only a few clicks or taps away. In
powerful tools once available only to pilots and operators
fact, there are even automatic alerts to highlight poten-
of large and sophisticated fleets.
tial safety issues you may have encountered during your
flights. You can also customize the parameters to alert you The Ways In
if you have a specific aspect of your flight(s) you want to
“We look at the NGAFID as a hub, and entry methods as
monitor, in addition to those NGAFID researchers and
spokes,” explained Stephens. “We are always looking for
others in the GA community have identified. Depending
more and better ways to get data into the NGAFID.” Cur-
on your method of logging data, you can even use the
rently, the primary data source is modern avionics, like the
NGAFID to monitor for airworthiness and maintenance
Garmin G1000, which record a number of flight parame-
concerns. Yet another benefit is the ability to compare
ters. “Modern avionics allow us to collect all this data by
your data to that of other operators in your class or type.
simply using a memory card slot that’s already there,” said
Want to know how you stack up against other 172 driv-
Stephens. “Some of our larger fleet users even have wireless
ers? Here’s your chance.
options that automatically begin downloading data when
PILOTS
GET YOUR GUARD UP WITH THE GAARD APP!
Go to ngafid.org or scan the QR code to get started GAARD App on iTunes Store
today! (Android/Google Play Store
version coming soon . . . )
BIG DATA,
Little Team
How You Benefit from the FAA’s Surface Safety Metric
By Nick DeLotell
B
ig Data: “big data” — noun, extremely large data lels between the FAA’s 21st century ethos, and these 19th
sets that may be analyzed computationally to reveal and 20th century concepts. Are you surprised to know
patterns, trends, and associations, especially relating that data analysis and safety risk management pre-date
to human behavior and interactions. (Oxford Dictionary) manned flight? While the value of data and the concepts
It wasn’t long into his flying career when Wilbur Wright of safety risk management are not novel, today’s tools
was quoted as saying, “In flying I have learned that care- and technology make the FAA more and more effective at
lessness and overconfidence are usually far more dangerous managing risk through Big Data.
than deliberately accepted risks.”
Merely eleven years before Wilbur and his brother Big Data, Little Team
made their famous flight, Sir Arthur Conan Doyle released Right now, there is a small, passionate, and professional team
another of his Sherlock Holmes short stories, The Adven- of FAA experts dedicated to improving safety on the surface
ture of the Copper Beeches. In it, when he’s frustrated at the of our nation’s airports. To be clear on that, we’re talking
lack of evidence, Holmes is quoted as saying, “Data! Data! about all towered airports from Guam to the Virgin Islands
Data! I can’t make bricks without clay.” and everything in between. The team is small (20 people),
Here’s a final nugget for you; nearly 50 years before but is also diverse, with each person bringing their own
the Wright brothers packed up their flying machine and unique experience and perspectives as airline pilots, general
headed to Kitty Hawk, the 1854 Rulebook of the New York aviation pilots, air traffic controllers, and data scientists.
and Erie Railroad stated, “The road must be run safe first, They’re known as the FAA Runway Safety Group and they’ve
and fast afterward.” taken Big Data and safety risk management concepts to the
Can you imagine an aviation system that embraces the next level with their new Surface Safety Metric (SSM).
fundamental concepts of these centuries-old quotes? For The traditional runway incursion data analysis might
comparison, here are some key words and phrases from look purely at rates (e.g., 25 runway incursions per million
our core ethos at the FAA: flight operations) or statistics (e.g., most pilot deviations
“Safety Risk Management” are caused by general aviation (GA) pilots). While there’s
“Data-Driven Risk-Based Decision Making” certainly a benefit to knowing rates and statistics, the num-
“… safest, most efficient aerospace system in the world.” bers don’t always tell the full story. That’s where the SSM
It doesn’t take Sherlock Holmes to detect some paral- is different. The SSM goes beyond traditional data analysis
September/October 2020 17
Cleared for Takeoff
The lessons and concepts from the 19th and 20th centuries
hold as true today as ever. You can apply them and contrib-
ute to the safest and most efficient aerospace system in the
world by remembering three simple things regardless of the
type of aircraft you’re strapping into:
1. Wilbur said it best. Don’t be careless or overconfident
Blue skies and happy landings! Taxi safely, my friends. Runway Safety Pilot Simulator
RunwaySafetySimulator.com
Nick DeLotell is an aviation safety inspector in the FAA’s Flight Standards Service FAA RIM Program
in collaboration with the Runway Safety Group. He holds an airline transport faa.gov/airports/special_programs/rim
pilot certificate, flight and ground instructor certificates, and is a remote pilot.
When Cody McClelland first started working as the new Air Traffic came in my office to discuss ways they could have done better in
Manager at Baton Rouge Metro/Ryan Field Airport (BTR) in March of situations they were unsure about. I think in the end it’s about
2019, one of the first things brought to his attention was that BTR relationships and having a dialog with a very valuable resource:
ranked first in runway incursions in the FAA’s Southwest Region, the pilots. They provided insight on what they were thinking and
with 16 in that year alone. Cody quickly began thinking outside the expecting from ATC. A lot of times my controllers and supervisors
box to identify a way to break this pattern. Many of the issues were coached pilots on what ATC was expecting them to do. I think the
related to parallel runways 4L and 4R and their complex taxiway results speak for themselves — all the effort that controllers and
intersections. He decided to address the issue through a coaching pilots have put in have made BTR a safer place to fly.”
and mentoring philosophy with both the local controllers and pilots. We take this opportunity to thank Cody for his awareness and quick
Cody shared this actions to address the issue, and for helping to reduce runway
philosophy at a local incursions at BTR. To learn more about the issues Cody identified,
Experimental Aircraft check out this “From the Flight Deck” video on BTR at
Association (EAA) FAA.gov/airports/runway_safety/videos/BTR.
dinner and at FAA Safety
Team (FAASTeam) pilot Runway Incursions at BTR/Baton Rouge Metro/Ryan Field
meetings to help the Fiscal Year Runway Incursions Runway Incursion
pilot and air traffic Rate/100k Operations
community. “I wanted BTR to be an environment that encouraged
2019 16 28.3
learning before and after we make mistakes,” Cody stated. “The
controllers, after a bit, embraced the concept, and some even 2020 1 3.3
By Adam Magee
“
Expect the unexpected” has long been the gold
standard in preparedness. Flight instructors preach
planning as an effective accident prevention tool.
When analyzing the National Transportation Safety
Board (NTSB) database on hot air balloon accidents, one
theme becomes apparent: Hot air balloon accidents mostly
arise from deficiencies in accident mitigation efforts. So
it’s worth taking a fresh look at some of the preflight and
inflight actions that show up as contributing factors in
accidents. The goal is to offer a data-driven approach to
aeronautical decision making and accident prevention.
September/October 2020 19
Consider this number: around 54-percent of all hot air this mission. The FAA develops tools like the PAVE and
balloon accidents involve pilots who qualify for the highest IMSAFE checklists (and so much more) because they can
level of the Balloon Federation of America’s Pilot Achieve- help prevent accidents. The checklists keep pilots aware
ment Award Program. This points to complacency and of items that can have a negative impact on the flight. A
implies that the plateau of sustainability can be difficult, if natural first step in accident prevention is to simply use the
not impossible, to achieve. When analyzing the NTSB data- tools your tax dollars have helped create.
base of hot air balloon accidents, the outside forces acting
on the peaks and valleys, as well as a complacency factor, Another Tool You Can Use
become apparent. The accident narratives shed light on the Have you ever used a flight risk assessment tool (FRAT)?
hazardous attitudes in play. Going through PAVE and IMSAFE checklists in your head
For example, the high-hour balloon pilot who decides doesn’t take actual risk exposure into account. Our brains
to take off on a windy evening when other pilots decide tend to compartmentalize individual hazard and fail to
not to fly is exhibiting the macho hazardous attitude. The appreciate their cumulative effects. Even if it happens uncon-
accident narrative is full of an “I can do it!” attitude. In sciously, we may also allow personal desires to manipulate a
these instances, tell yourself that “taking chances is foolish” risk assessment so we can meet personal goals. The best way
in order to catch your behavior. Listen to corrective action to compensate for these inherent shortcomings is to take this
suggestions from crewmembers or other pilots. Difficult? task to paper. Putting everything on “paper” (even electronic
Yes, but it could prevent an accident. paper) allows us to establish risk limits in an atmosphere
To combat the hazardous attitudes found in the peaks free from the pressure of an impending flight. It also offers
and valleys, take yourself through an “unawareness check- a perspective on the entire risk picture. Most importantly, it
list” before each flight. To teach this concept, I start by sets the stage for managing risk through proactive mitigation
explaining the mission of the FAA: to have the safest aero- strategies that are documented.
space system in the world. The entire airman certification Designs can vary, but FRATs generally ask a series of
process, FAA Safety Team (FAASTeam), this magazine, questions that help identify and quantify risk for a flight.
and everything else the FAA does are all aimed at fulfilling The FAASTeam’s current FRAT tool (an automated spread-
sheet available at go.usa.gov/xkhJK) follows the PAVE
Back to Basics
If you’re a certificated balloon pilot, it’s probably been
a while since you’ve read through the Lighter-than-Air
balloon private pilot Practical Test Standards (PTS) (Note:
Airman Certification Standards for LTA are in develop-
ment). But do you recall how it tests the applicants’ ability
points towards the impulsivity hazardous attitude. Pilots
to pick a launch spot based on suitable landing areas down-
want to “do something quickly” to avoid an accident, but
wind both in flight planning and launch site selection? The
hastily executed actions often make the situation worse.
ability for a balloon to land at a location other than an air-
Checklists are a great accident mitigation strategy; they
port is what makes balloons unique. It also makes balloon
help pilots combat impulsivity. When faced with a difficult
flight riskier. Contact with power lines is the number one
situation, your checklist provides an opportunity to think
fatal cause of balloon accidents.
and perform a double check. An often overlooked but very
Seventy-nine-percent of balloon accidents occur during
important checklist is for the passenger briefing. In many
the landing phase of flight. Further analysis reveals two
hot air balloon landing phase accidents, an inadequate
major themes: lack of proficiency and impulsivity.
passenger briefing has unnecessarily led to broken bones,
Pilot proficiency is important; many accidents involve
and in one case, a fatality.
pilots who are rusty or are flying an unfamiliar aircraft.
Sometimes the pilot is flying an aircraft new to them and
In Data We Trust
twice the size of the balloon they normally fly. We all know
14 CFR section 61.57 sets recent flight experience for car- To “expect the unexpected” in hot air balloon accidents
rying passengers, but does currency equate to proficiency? involves understanding the statistics behind accidents.
No! That’s where the WINGS Pilot Proficiency Program Such data helps guide the FAA’s development of accident
comes in. WINGS encourages pilots to obtain additional mitigation strategies and aeronautical decision making
knowledge and flying skill with an authorized instructor. resources. Whether your craft is lighter or heavier than air,
This additional instruction knocks the rust off for pilots make it a habit to know these resources and make them a
who have not recently flown much. Consider that with hot regular part of your flight planning.
air balloons, 48-percent of accidents involve pilots with 15
Adam Magee is a commercial hot air balloon pilot/flight instructor, designated
or fewer hours in the last 90 days.
pilot examiner, FAA Safety Team (FAASTeam) Representative, and was named
When faced with a difficult situation in flight (e.g., the 2019 District and Regional FAA CFI of the Year. He is co-founder/president of
changing weather conditions, missed landing spots, flying The Balloon Training Academy, a 501(c)(3) non-profit organization and industry
into congested areas, etc.) the accident narrative often member of the FAASTeam.
September/October 2020 21
CHECKLIST SUSAN K. PARSON
#GOT DATA?
Unmanned Aircraft Systems (UAS), • Kansas Department of Transpor- IPP. PSPs are an industry-focused part-
also known as drones, are a burgeon- tation (Topeka, Kansas) nership. Through a three-year agree-
ing industry. UAS operations are fast • Lee County Mosquito Control ment, the FAA works directly with
increasing in number, technical com- District (Ft. Myers, Florida) companies to research and develop
plexity, and sophistication. The FAA • Memphis-Shelby County Airport applications and operations that will
is working to incrementally integrate Authority (Memphis, Tennessee) support decisions and rulemaking.
UAS into the National Airspace System Companies go through a rigorous
• North Carolina Department of
(NAS) in a way that assures the safety of selection process and demonstrate
Transportation (Raleigh, North
people and property, both in the air and innovative concepts that will contrib-
Carolina)
on the ground. The FAA’s Unmanned ute to increasingly more complex UAS
Integration Office (AUS) has the task of • North Dakota Department of operations. These operations include:
coordinating those efforts. Transportation (Bismarck, North Operations Over People, Expanded
With the exponential growth of Dakota) Operations (beyond visual line of sight,
UAS technologies and applications • City of Reno (Reno, Nevada) swarms, and on-airport operations),
over the past few years, research has • University of Alaska-Fairbanks Small UAS Package Delivery Opera-
expanded to keep pace and bet- (Fairbanks, Alaska) tions, Large Carrier Cargo Operations,
ter enable the FAA to support full and Passenger Transport Operations.
The Lead Participants serve as the
integration. Applied research will PSP entrants provide data and
primary point of contact with the
inform the integration path, which is research that is applied to technical
FAA, and they partner with private
intended to enable increasingly more standards development. In return,
sector companies and organizations
complex UAS operations over time. they receive FAA guidance as well as
to carry out their operations. The IPP
In order to promote applied authorization for experimental oper-
tests and evaluates various models
research, the FAA established the ations. The data helps answer several
of involvement in development and
Integration Pilot Program (IPP), a questions about UAS Integration: What
enforcement of federal regulations for
government focused initiative, and the kind of aircraft are best suited for cer-
UAS operations. It informs develop-
Partnership for Safety Program (PSP), tain operations? What is the durability
ment of future federal guidelines and
an industry-focused initiative. and reliability of specific aircraft? What
regulatory decisions on UAS opera-
standards do we need for aircraft?
Integration Pilot Program tions nationwide.
What safety standards are necessary?
IPP operations focus on Detect and
Launched in 2017, the IPP offers a Data on new aspects of operation is
Avoid (DAA) technologies, Command
pathway for state, local, and tribal critical to the step-by-step approach to
and Control (C2) links, navigation,
governments to partner with private UAS integration. The agency contin-
weather, and human factors. Examples
sector entities (e.g., operators as well uously applies lessons from the IPP
of use include agriculture, commerce,
as manufacturers) to accelerate the and PSP to UAS decision making,
emergency management, human trans-
safe integration of UAS operations. In rulemaking, and standards develop-
portation, and other sectors. Part of the
May 2018, the Secretary of Transpor- ment. Program participants contribute
FAA’s role is to emphasize the need to
tation announced ten Lead Partici- to the FAA’s research needs and foster
balance the benefits of innovation with
pants for the IPP: a meaningful dialogue between local
the need to protect national security,
and national interests. While many
• Choctaw Nation of Oklahoma public safety, critical infrastructure
challenges remain, the flexibility and
(Durant, Oklahoma) and the NAS. The IPP will close out in
innovation that the IPP and PSP offer
• City of San Diego (San Diego, October 2020.
will play a major role in facilitating safe
California) and successful UAS integration.
Partnerships for Safety Program
• Virginia Tech — Center for Inno-
vative Technology (Herndon, Established in 2019, the PSP is the next
Danielle Corbett is an aviation safety inspector with
Virginia) integration step to transition from the
the FAA’s Office of Unmanned Aircraft Systems.
September/October 2020 23
NUTS, BOLTS, AND ELECTRONS JENNIFER CARON
If you have ever shopped for a strongly encourages filing MDRs on need surveillance, immediate follow
product online, you know the power a voluntary basis. If a system com- up, or escalation to the FAA’s Monitor
of data in the form of user reviews ponent or part has malfunctioned, Safety/Analyze Data process, which
and star ratings that influence your report it. If there’s a flaw or an imper- quickly disseminates the safety info
decision to click and buy. Voluntary fection, report that too. “The MDR and determines whether corrective
feedback from past purchasers is tre- provides valuable safety information action is required by an AD,” Robino
mendously valuable in helping other and may be the first indication of a explains. The rest of the SDR team
buyers identify issues, spot trends, potential safety problem or a defect,” is focused on older records so users
and make better, more knowledgeable, says Gracie Robino, Business Program have a better ability to see a real-time
and much faster decisions. Manager in the FAA’s Flight Standards history of MDRs.
So too is the power behind aviation Service. “It can identify equipment The best is still to come. “In the
reporting systems like the FAA’s Ser- malfunction trends that can help future, we see the system supporting
vice Difficulty Report system (SDR). catch problems early. That allows a more robust and user-friendly for-
It relies on voluntary feedback from advisories, service bulletins, airwor- mat for data retrieval with enhanced
users like you, maintenance profes- thiness directives (ADs), and alerts search engine capabilities,” says
sionals on the front lines of the indus- to benefit from better information,” Robino. “Technology will allow the
try, to say something and let other Robino explains. upload of photos and images, and
people know when you see something A case in point: “Thanks to the users will receive email notification
that could potentially cause a safety multiple MDR reports from GA that their MDR and supporting
hazard. If you or other mechanics mechanics, we identified a compres- documentation was successfully
in your shop see either brand new sor brush as a frequently defective received,” she explains. Additionally,
issues or that same old problem with part, and we were seeing aircraft tail the importance of aviation mainte-
a propeller, an appliance, or any fires as a result,” says Christy Eck- nance alerts is recognized as a means
aircraft part for that matter, please erman, Continued Airworthiness of disseminating reports back into
say something — and not just to Specialist in the FAA’s Wichita Air- the maintenance community with
those in your shop. Share by report- worthiness Certification Office. “We discussion to potentially revamp the
ing it online. Using the SDR system, were able to issue an airworthiness program in the future.
create a Malfunction/Defect Report directive to address the problem.” Bottom line? If you see something,
(MDR). You’ll find it under the Public say something at av-info.faa.gov/sdrx.
Functions tab at av-info.faa.gov/sdrx. We’ve Heard Your Feedback We need your valuable input.
The MDR is confidential — you can Users have reported that the SDR sys-
remain anonymous if you choose — tem is not friendly, the format is out of Jennifer Caron is FAA Safety Briefing’s copy editor
and there’s absolutely no punishment date, and that reports are not reviewed and quality assurance lead. She is a certified
for reporting. On the contrary, you get or processed promptly. The good news technical writer-editor in aviation safety and
flight standards.
the satisfaction of knowing that your is that the SDR moderniza-
review and “buyer beware” experi- tion effort is underway. The
ence with a part or appliance will help infrastructure is being rebuilt
others make better, more informed and changes have already been
decisions about airworthiness. When made. “Thanks to an increase
it comes to safety, your input could in staffing and additional sup-
save someone’s life. port from data processing, we
no longer have a backlog,” says
We Read Your Reviews Robino. “The newest reports
Filing isn’t mandatory for part 91 are directly reviewed by two
operators, pilots, and mechanics who aviation safety inspectors. They
work their own shops, but the agency identify any safety hazards that
September/October 2020 25
VERTICALLY SPEAKING GENE TRAINOR
HISTORY LESSONS
September/October 2020 27
POSTFLIGHT SUSAN K. PARSON
OPPORTUNITY IN AMBIGUITY
Ambiguity is something it’s never a one-and-done decision. those “doesn’t look right” observations
that I really respond to. As more recent training practices and “doesn’t feel right” instincts.
I like the complexity of it. acknowledge, it’s really a continuous
process of putting new data (e.g., Actions
— Robert Redford Circling back to Mr. Redford’s affinity
updated weather) in the context of the
pilot-passenger-plane-plan elements for ambiguity, I suspect he might love
While actor Robert Redford might like and using that information to evaluate aviation. I also think we aviators have
ambiguity, it is generally not some- and manage the resulting risk(s). more in common with the impro-
thing that technically minded people Here’s another level of ambiguity visational stage than we realize. We
enjoy. On the contrary, those drawn and complexity. People in general might think we prefer to operate with
to aviation vocations or avocations and pilots in particular take pride in a carefully memorized script, using
strongly prefer the kind of “numbers being rational, and in making deci- that hard data to know exactly what’s
don’t lie!” certainty that one of the lead sions based on facts. But what about going to happen as we move through
characters in the “Hidden Figures” those “gut feelings” we all sometimes each flight phase “scene” toward the
movie asserted. We take pride in bas- experience? grand finale of planned destination.
ing our actions on data. The language One of my favorite books is But aviation is more like improvi-
of aviation is replete with the imagined Malcolm Gladwell’s Blink, which sational theatre: we are constantly
certainty of binary go/no-go decisions. explores the reasoned underpinnings challenged to adapt — to accept and
After being immersed in aviation of so-called snap judgments and gut incorporate new data into informa-
for over 25 years, I understand the feelings. The core idea is that human tion that influences the next move.
appeal. As a liberal arts major, though, beings take in a great deal more data Improvisational theatre works
the alleged certainty of data often than we can consciously, or “ratio- because it uses the scaffolding of its
makes me squirm. The zeros and ones nally,” process. Nevertheless, other “yes, and” prime directive to safely
of binary code may seem solid. We parts of the brain do note, process, manage the ambiguity and complexity
focus so heavily now on risk manage- and catalog data that might eventually of unscripted action. Risk management
ment because we recognize that peo- be served up in the form of eye-blink offers the same kind of scaffolding to
ple, policies, and realities more often conclusions, or in a gnawing sense aviators — enabling us to use it for
lie somewhere in the infinite number of unease. The book explains that we growth and discovery, while keeping
of fractions between zero and one. have to work to separate the signal safe for many encore performances.
You can’t even permanently pinpoint from the noise in such cases. But the
which fraction, because circumstances opportunity to manage the risk of this Susan K. Parson ([email protected]) is editor
shift continuously, whether minutely ambiguity starts with accepting that of FAA Safety Briefing and a Special Assistant in
or by magnitudes. the FAA’s Flight Standards Service. She is a general
“all available information” includes
aviation pilot and flight instructor.
Fractions
The classic aviation scenario of the go/
no-go decision illustrates the point.
You get weather data. It can be “good”
(VFR), “bad” (IFR), or somewhere in
between (MVFR). That’s one level of
ambiguity. The weather data becomes
information when you put it in the
context of a specific pilot, passen-
ger(s), plane, and plan. Each of these
elements has multiple facets, any of
which can change in a heartbeat. So,
Official Business
Penalty for Private Use $300
faa.gov/news/safety_briefing @FAASafetyBrief