How To Avoid The Ethical Nightmares of Emerging Technology
How To Avoid The Ethical Nightmares of Emerging Technology
Article
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
Carolina Niño
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
In 2015, the platform’s role in violating citizens’ privacy and its potential
for political manipulation was exposed by the Cambridge Analytica
scandal. Around the same time, in Myanmar, the social network
amplified disinformation and calls for violence against the Rohingya,
an ethnic minority in the country, which culminated in a genocide that
began in 2016. In 2021, the Wall Street Journal reported that Instagram,
which had been acquired by Facebook in 2012, had conducted research
showing that the app was toxic to the mental health of teenage girls.
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
It’s time for a new approach. Companies that develop these technologies
need to ask: “How do we develop, apply, and monitor them in ways
that avoid worst-case scenarios?” And companies that procure these
technologies and, in some cases, customize them (as businesses are
doing now with ChatGPT) face an equally daunting challenge: “How do
we design and deploy them in a way that keeps people (and our brand)
safe?”
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
Third, that business leaders are ultimately responsible for this work,
not technologists, data scientists, engineers, coders, or mathematicians.
Senior executives are the ones who determine what gets created, how
it gets created, and how carefully or recklessly it is deployed and
monitored.
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
Carolina Niño
Let’s focus on the move from “AI ethics” to “responsible AI” as a case
study on the problematic impacts of shifting language. First, when
business leaders talk about “responsible” and “trustworthy” AI, they
focus on a broad set of issues that include cybersecurity, regulation,
legal concerns, and technical or engineering risks. These are important,
but the end result is that technologists, general counsels, risk officers,
and cybersecurity engineers focus on areas they are already experts on,
which is to say, everything except ethics.
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
But when AI ethics fail, the results are specific. Ethical nightmares
are vivid: “We discriminated against tens of thousands of people.”
“We tricked people into giving up all that money.” “We systematically
engaged in violating people’s privacy.” In short, if you know what your
ethical nightmares are then you know what ethical failure looks like.
Artificial intelligence. Let’s start with a technology that has taken over
the headlines: artificial intelligence, or AI. The vast majority of AI out
there is machine learning (ML).
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
Discriminatory impacts are just one ethical nightmare to avoid with AI.
There are also privacy concerns, the danger of AI models (especially
large language models like ChatGPT) being used to manipulate people,
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
Blockchain. Suppose you and I and a few thousand of our friends each
have a magical notebook with the following features: When someone
writes on a page, that writing simultaneously appears in everyone
else’s notebook. Nothing written on a page can ever be erased. The
information on the pages and the order of the pages is immutable; no
one can remove or rearrange the pages. A private, passphrase-protected
page lists your assets — money, art, land titles — and when you transfer
an asset to someone, both your page and theirs are simultaneously and
automatically updated.
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
Carolina Niño
Blockchain is most often associated with
financial services, but every industry
stands to integrate some kind of blockchain solution, each of which
comes with particular pitfalls. For instance, we might use blockchain
to store, access, and distribute information related to patient data, the
inappropriate handling of which could lead to the ethical nightmare of
widescale privacy violations. Things seem even more perilous when we
recognize that there isn’t just one type of blockchain, and that there are
different ways of governing a blockchain. And because the basic rules of
a given blockchain are very hard to change, early decisions about what
blockchain to develop and how to maintain it are extremely important.
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
Why does this responsibility fall to business leaders as opposed to, say,
the technologists who are tasked with deploying the new tools and
systems? After all, most leaders aren’t fluent in the coding and the math
behind software that learns by example, the quantum physics behind
quantum computers, and the cryptography that underlies blockchain.
Shouldn’t the experts be in charge of weighty decisions like these?
I’ve tried to convince you of three claims. First, that leaders and
organizations need to explicitly identify their ethical nightmares
springing from new technologies. Second, a significant source of risk
lies in how these technologies work. And third, that it’s the job of senior
executives to guide their respective organizations on ethics.
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
• What policies are in place that address or fail to address your ethical
nightmares?
• What processes are in place to identify ethical nightmares? Do they
need to be augmented? Are new processes required?
• What level of awareness do employees have of these digital ethical
risks? Are they capable of detecting signs of problems early? Does the
culture make it safe for them to speak up about possible red flags?
• When an alarm is sounded, who responds, and on what grounds do
they decide how to move forward?
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
•••
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
If you give people the opportunity, the breathing room, to do the right
thing, they’ll do it happily. Creating that opportunity means not only
permitting but encouraging or requiring people to talk the language of
ethical nightmares. Make it a priority. Weave it into existing enterprise
strategy. Ensure that everyone in the organization can tell you its
nightmares and can rattle off five or six things the company does at
the everyday operational level to make sure they don’t happen.
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.
HBR / The Big Idea / How to Avoid the Ethical Nightmares of Emerging Technology
This document is authorized for use only in Prof. Puneet Arora's Business Ethics/ PGDM at Management Development Institute - Gurgaon from Jan 2024 to Feb 2024.