58687
58687
com
https://ebookmass.com/product/practical-implementation-of-a-
data-lake-translating-customer-expectations-into-tangible-
technical-goals-1st-edition-nayanjyoti-paul/
OR CLICK HERE
DOWLOAD NOW
https://ebookmass.com/product/motor-control-translating-research-into-
clinical-practice-5th-edition-ebook-pdf/
ebookmass.com
https://ebookmass.com/product/integrating-behavioral-health-into-the-
medical-home-a-rapid-implementation-guide-1st-edition-ebook-pdf/
ebookmass.com
https://ebookmass.com/product/data-driven-harnessing-data-and-ai-to-
reinvent-customer-engagement-1st-edition-tom-chavez/
ebookmass.com
https://ebookmass.com/product/scritch-scratch-lindsay-currie-4/
ebookmass.com
The Secret Lives of Country Gentlemen (The Doomsday Books
1) 1st Edition Kj Charles
https://ebookmass.com/product/the-secret-lives-of-country-gentlemen-
the-doomsday-books-1-1st-edition-kj-charles/
ebookmass.com
https://ebookmass.com/product/integrating-stem-with-music-units-
lessons-and-adaptations-for-k-12-shawna-longo/
ebookmass.com
https://ebookmass.com/product/womens-work-and-politics-in-wwi-
america-1st-ed-edition-lars-olsson/
ebookmass.com
https://ebookmass.com/product/spruce-creek-puck-boys-clayton-spruce-
creek-puck-boys-series-book-1-maddie-walde/
ebookmass.com
https://ebookmass.com/product/socialism-scott-r-sehon/
ebookmass.com
The Unravelling 1st Edition Will Gibson
https://ebookmass.com/product/the-unravelling-1st-edition-will-gibson/
ebookmass.com
Practical
Implementation
of a Data Lake
Translating Customer Expectations
into Tangible Technical Goals
—
Nayanjyoti Paul
Practical
Implementation of a
Data Lake
Translating Customer
Expectations into Tangible
Technical Goals
Nayanjyoti Paul
Practical Implementation of a Data Lake: Translating Customer
Expectations into Tangible Technical Goals
Nayanjyoti Paul
Edison, NJ, USA
Preface������������������������������������������������������������������������������������������������xi
Introduction���������������������������������������������������������������������������������������xiii
iii
Table of Contents
iv
Table of Contents
Chapter 7: Miscellaneous�����������������������������������������������������������������167
Objective: Advice to Follow�������������������������������������������������������������������������������167
Recommendations��������������������������������������������������������������������������������������������167
Managing a Central Framework Along with
Project-Specific Extensions�������������������������������������������������������������������������167
Allowing Project Teams to Build “User-Defined Procedures” and
Contribute to the Central Framework����������������������������������������������������������168
Advantages and Disadvantages of a Single vs. Multi-account Strategy�����169
Creating a New Organizational Unit AWS Account vs. Onboard Teams
to a Central IT Managed AWS Account��������������������������������������������������������171
Considerations for Integrating with Schedulers������������������������������������������172
Choosing a Data Warehouse Technology�����������������������������������������������������173
Managing Autoscaling���������������������������������������������������������������������������������174
Managing Disaster Recovery�����������������������������������������������������������������������175
v
Table of Contents
Index�������������������������������������������������������������������������������������������������195
vi
About the Author
Nayanjyoti Paul is an associate director and
chief Azure architect for GenAI and LLM
CoE for Accenture. He is the product owner
and creator of patented assets. Presently, he
leads multiple projects as a lead architect
around generative AI, large language models,
data analytics, and machine learning. Nayan
is a certified master technology architect,
certified data scientist, and certified Databricks
champion with additional AWS and Azure
certifications. He has been a speaker at conferences like Strata Conference,
Data Works Summit, and AWS Reinvent. He also delivers guest lectures at
universities.
vii
About the Technical Reviewer
Arunkumar is an architect with 20+ years of
experience in the IT industry. He has worked
with a wide variety of technologies in the
data, cloud, and AI spaces. He has experience
working in a variety of industries such as
banking, telecom, healthcare, and avionics.
As a lifelong learner, he enjoys taking on new
fields of study and challenging himself to
master the necessary skills and knowledge.
ix
Preface
This book explains how to implement a data lake strategy, covering the
technical and business challenges architects commonly face. It also
illustrates how and why client requirements should drive architectural
decisions.
Drawing upon a specific case from my own experience, I begin with
the consideration from which all subsequent decisions should flow: what
does your customer need?
I also describe the importance of identifying key stakeholders and the
key points to focus on when starting a project. Next, I take you through
the business and technical requirements-gathering process and how to
translate customer expectations into tangible technical goals.
From there, you’ll gain insight into the security model that will allow
you to establish security and legal guardrails, as well as different aspects of
security from the end user’s perspective. You’ll learn which organizational
roles need to be onboarded into the data lake, their responsibilities,
the services they need access to, and how the hierarchy of escalations
should work.
Subsequent chapters explore how to divide your data lakes into zones,
organize data for security and access, manage data sensitivity, and use
techniques for data obfuscation. Audit and logging capabilities in the
data lake are also covered before a deep dive into designing data lakes to
handle multiple file formats and access patterns. The book concludes by
focusing on production operationalization and solutions to implement a
production setup.
xi
Preface
xii
Introduction
I landed at the airport and took an Uber to my customer’s office. I was
supposed to meet with the program manager on the customer side. After
the initial process and getting myself “checked in,” I entered the conference
room that was booked for our team. I knew most of the team from other
projects, but I was meeting a few of them for the first time. After the usual
greetings and a few of my colleagues congratulating me on my new role, I
was ready for the day to unfold.
This customer was a big organization, and there was a clear
“separation of concerns” from multiple teams. The schedule was set up,
and our first tasks were to get acquainted with the different organizational
units, identify the key stakeholders, and understand the stakeholders’
primary “asks.” It was important for my team to understand the key
organizational units and have one-on-one initial discussions. We needed
to connect with the following people and teams:
xiii
Introduction
xiv
Introduction
xv
Introduction
xvi
Another Random Document on
Scribd Without Any Related Topics
the name of the dragon (here Regin’s brother, Fafnir). The Voluspo
(stanza 12) names a Regin among the dwarfs, and the name may
have assisted in making Regin a dwarf here. Hreithmar: nothing is
known of him outside of this story. Othin, Hönir and Loki: these same
three gods appear in company in Voluspo, 17–18. Andvari’s fall:
according to Snorri, who tells this entire story in the Skaldskaparmal,
Andvari’s fall was in the world of the dark elves, while the one where
Loki killed the otter was not; here, however, the two are considered
identical. With his eyes shut: according to Snorri, Otr ate with his
eyes shut because he was so greedy that he could not bear to see
the food before him diminishing. Ron: wife of the sea-god Ægir, who
draws down drowning men with her net; cf. Helgakvitha
Hjorvarthssonar, 18 and note. Snorri says that Loki caught the pike
with his hands.
2. Snorri quotes this stanza. The name of the speaker is not given in
the manuscripts. Oin: nothing further is known of Andvari’s father.
Norn: cf. Voluspo, 20.
Prose. Snorri says Andvari’s ring had the power to create new gold.
In this it resembled Baldr’s ring, Draupnir; cf. Skirnismol, 21 and
note. [361]
6. Snorri quotes this stanza, introducing it, as here, with “Then Loki
said” in the prose. Regius omits this phrase, but inserts “said Loki” in
line 1. [362]
14. Yngvi’s heir: Yngvi was one of the sons of the Danish king
Halfdan the Old, and traditionally an ancestor of Helgi (cf.
Helgakvitha Hundingsbana I, 57 and note). Calling Sigurth [365]a
descendant of Yngvi is, of course, absurd, and the use of this phrase
is one of the many reasons for believing that stanzas 13–18
belonged originally to the Helgi cycle. The threads, etc.: another link
with Helgi; cf. Helgakvitha Hundingsbana I, 3–4. As Helgi was
likewise regarded as a son of Sigmund, stanzas 13–14 would fit him
just as well as Sigurth.
Prose. The fleet, and the subsequent storm, are also reminiscent
[366]of the Helgi cycle; cf. Helgakvitha Hundingsbana I, 29–31, and II,
prose after stanza 16. A man: Othin.
17. Sea-trees and roller-steeds (the latter because ships were pulled
up on shore by means of rollers) both mean “ships.”
18. The Volsungasaga quotes this stanza. Hnikar and Fjolnir: Othin
gives himself both these names in Grimnismol, 47; Feng (“The
Seizer”) does not appear elsewhere. According to the Volsungasaga,
no one knew Othin’s name when he came to Volsung’s house and
left the sword there for Sigmund. [367]
19. This and the following stanzas are strongly suggestive of the
Hovamol, and probably came originally from some such collection.
25. This stanza almost certainly had nothing originally to do with the
others in this passage; it may have been taken from a longer version
of the Hovamol itself.
Introductory Note
The so-called Fafnismol, contained in full in the Codex Regius,
where it immediately follows the Reginsmol without any indication of
a break, is quoted by Snorri in the Gylfaginning (stanza 13) and the
Skaldskaparmal (stanzas 32 and 33), and stanzas 6, 3, and 4
appear in the Sverrissaga. Although the Volsungasaga does not
actually quote any of the stanzas, it gives a very close prose parallel
to the whole poem in chapters 18 and 19.
[373]
Fafnir spake:
Sigurth spake:
Fafnir spake:
Sigurth spake:
[374]
Fafnir spake:
Sigurth spake:
Fafnir spake:
Sigurth spake:
10. “Some one the hoard | shall ever hold,
Till the destined day shall come;
For a time there is | when every man
Shall journey hence to hell.”
Fafnir spake:
Sigurth spake:
Fafnir spake:
Sigurth spake:
14. “Tell me then, Fafnir, | for wise thou art famed,
And much thou knowest now: [376]
How call they the isle | where all the gods
And Surt shall sword-sweat mingle?”
Fafnir spake:
Sigurth spake:
Fafnir spake:
Sigurth spake:
Fafnir spake:
Sigurth spake:
Fafnir spake:
Sigurth spake:
Regin spake:
[379]
Sigurth spake:
Regin spake:
Sigurth spake:
A second spake:
A third spake:
A fourth spake:
A fifth spake:
A sixth spake:
Sigurth spake:
Our website is not just a platform for buying books, but a bridge
connecting readers to the timeless values of culture and wisdom. With
an elegant, user-friendly interface and an intelligent search system,
we are committed to providing a quick and convenient shopping
experience. Additionally, our special promotions and home delivery
services ensure that you save time and fully enjoy the joy of reading.
ebookmass.com