[DSC Europe 24] Ewelina Kucal & Maciej Dziezyc - How to Encourage Children to Read Books? LLMs for Education and Fun!
0 likes•32 views
Children who read books regularly grow up to be better-educated adults with higher earning potential and stronger emotional intelligence. But how can we encourage them to read books? In this talk, you will learn how SoftwareOne leveraged Large Language Models and AWS Cloud to create the Book Aligned Activities AI Engine for Worldreader, a US-based non-profit organization. This AI Engine allows Worldreader to create engaging and creative book activities for children in Kiswahili and English, reducing the development time from weeks to minutes.
![19
Zero-shot vs Few-shot approaches
Few-shot
Paul Atreides, a brilliant and gifted young man born into a great destiny beyond his
understanding, must travel to the most dangerous planet in the universe to ensure the future
of his family and his people. As malevolent forces explode into conflict over the planet's
exclusive supply of the most precious resource in existence-a commodity capable of
unlocking humanity's greatest potential-only those who can conquer their fear will survive.
['Action', 'Adventure', 'Science Fiction’]
A botched store robbery places Wonder Woman in a global battle against a powerful and
mysterious ancient force that puts her powers in jeopardy.
['Action', 'Adventure', 'Fantasy']
After the devastating events of Avengers: Infinity War, the universe is in ruins due to the
efforts of the Mad Titan, Thanos. With the help of remaining allies, the Avengers must
assemble once more in order to undo Thanos' actions and restore order to the universe once
and for all, no matter what consequences may be in store.
['Adventure', 'Science Fiction', 'Action']
Harry, Ron and Hermione walk away from their last year at Hogwarts to find and destroy the
remaining Horcruxes, putting an end to Voldemort's bid for immortality. But with Harry's
beloved Dumbledore dead and Voldemort's unscrupulous Death Eaters on the loose, the
world is more dangerous than ever.](https://image.slidesharecdn.com/ewelinakucalmaciejdziezyc-worldreader-250217194551-28a1a23a/85/DSC-Europe-24-Ewelina-Kucal-Maciej-Dziezyc-How-to-Encourage-Children-to-Read-Books-LLMs-for-Education-and-Fun-19-320.jpg)
![21
Chain of thought
Prompting techniques
• Challenge: model was not complaint - Claude 3 Opus sometimes returned activities in the language other
than book’s e.g., Spanish instead of English
• Solution:
The output template:
``` “Thought” which we discard in post-processing
Detected language: [English/Swahili]
[ { "skill": "Vocabulary", "placement": "Pre/Post", "activity": "...", "title": "..." }, ... ]
```](https://image.slidesharecdn.com/ewelinakucalmaciejdziezyc-worldreader-250217194551-28a1a23a/85/DSC-Europe-24-Ewelina-Kucal-Maciej-Dziezyc-How-to-Encourage-Children-to-Read-Books-LLMs-for-Education-and-Fun-21-320.jpg)
[DSC Europe 24] Ewelina Kucal & Maciej Dziezyc - How to Encourage Children to Read Books? LLMs for Education and Fun!
- 1. How to Encourage Children to Read Books? LLMs for Education and Fun! 22/11/2024 Maciej Dzieżyc, Ewelina Kucal
- 2. Delivering outcomes in software, cloud, data and AI
- 4. 4
- 5. 5
- 6. 6
- 7. 7
- 8. 8
- 9. 9
- 10. 10 Book Aligned Activates (BAAs) categories Activity Category Code Activity Category Name Activity Skill GROW Growing Positive Emotions Self Awareness Self Management Responsible Decision-Making Relationship Skills Social Awareness PLAY Play-based Physical Symbolic Pretend Play with Objects Game with Rules READ Reading Champion Phonics Phonemic Awareness Vocabulary Fluency Reading Comprehension Writing
- 11. 11 Solution
- 12. 12 AWS Services 101 • Amazon Simple Service Storage (Amazon S3) • Objects (files) stored in buckets • S3 Events (“notifications”) about changes, e.g., new file upload • AWS Lambda • Serverless function running in the cloud • Put Python code and just run it • Amazon Bedrock • Collection of APIs to Large Language Models (among other services) • AWS Step Functions • Workflow Orchestration – glue between elements of the solution • Easier visibility into data being send between modules
- 13. 13 Architecture
- 14. Model choice 14 • Amazon Bedrock API • Pay-as-you-go • Basically, no setup required • Claude 3 Opus • Why this model? • The state-of-the-art model on Amazon Bedrock at the time of delivery • Low load of requests • Multilingual input • No fine-tuning necessary
- 15. How to find SOTA model? 15 • Leaderboard at lmarena.ai • LM Arena asks users to blindly rate outputs of the LLMs for the user provided prompt • Elo score calculated like in chess or online multiplayer games • This method has its limitations, but it’s best quick assessment
- 16. System message 16 Feature-specific set of instructions GOAL: o to direct and improve the quality and safety of a model’s output. BEST PRACTICES: o Use clear and direct language o Keep instructions concise o Emphasize certain words by bolding **words** o Address the AI system using first-person language o Build robust instructions o Repeat most important constraints at the end
- 17. 17 Long and elaborate system message Define task Explanation of pre/post Reader’s context BAAs requirements BAAs examples (few-shot learning) The structure of the output (chain of thought)
- 18. 18 Zero-shot vs Few-shot approaches Zero-shot Harry, Ron and Hermione walk away from their last year at Hogwarts to find and destroy the remaining Horcruxes, putting an end to Voldemort's bid for immortality. But with Harry's beloved Dumbledore dead and Voldemort's unscrupulous Death Eaters on the loose, the world is more dangerous than ever. Genre:
- 19. 19 Zero-shot vs Few-shot approaches Few-shot Paul Atreides, a brilliant and gifted young man born into a great destiny beyond his understanding, must travel to the most dangerous planet in the universe to ensure the future of his family and his people. As malevolent forces explode into conflict over the planet's exclusive supply of the most precious resource in existence-a commodity capable of unlocking humanity's greatest potential-only those who can conquer their fear will survive. ['Action', 'Adventure', 'Science Fiction’] A botched store robbery places Wonder Woman in a global battle against a powerful and mysterious ancient force that puts her powers in jeopardy. ['Action', 'Adventure', 'Fantasy'] After the devastating events of Avengers: Infinity War, the universe is in ruins due to the efforts of the Mad Titan, Thanos. With the help of remaining allies, the Avengers must assemble once more in order to undo Thanos' actions and restore order to the universe once and for all, no matter what consequences may be in store. ['Adventure', 'Science Fiction', 'Action'] Harry, Ron and Hermione walk away from their last year at Hogwarts to find and destroy the remaining Horcruxes, putting an end to Voldemort's bid for immortality. But with Harry's beloved Dumbledore dead and Voldemort's unscrupulous Death Eaters on the loose, the world is more dangerous than ever.
- 20. 20 Few-shot learning Prompting techniques • Few-shot learning and zero-shot learning are a by-product of emerging properties of LLMs • We used a few-shot learning in the first version of the prompt • Why few-shot over zero-shot? • Activities should not only reflect values, requirements etc. but also “vibe” and style of existing one • Few-shot – more tokens – higher cost
- 21. 21 Chain of thought Prompting techniques • Challenge: model was not complaint - Claude 3 Opus sometimes returned activities in the language other than book’s e.g., Spanish instead of English • Solution: The output template: ``` “Thought” which we discard in post-processing Detected language: [English/Swahili] [ { "skill": "Vocabulary", "placement": "Pre/Post", "activity": "...", "title": "..." }, ... ] ```
- 22. 22 The Challenge of Validation How did we get to this prompt? • There’s no ground truth like in Retrieval Augmented Generation Chatbots or classical Machine Learning • Solution? Just ask the client! • Write a prompt • Identify pitfalls in outputs • Correct • Generate outputs for the client • Gather feedback • Repeat
- 23. 23 Outcomes
- 24. 24 Heroes to Zero #4: More Clean For More Green { "skill": "Self Awareness", "placement": "Pre", "activity": "The main character in this story is good at understanding what people need. Before reading, think about what you're good at. What are your strengths? Write about or discuss with someone a time when you used one of your strengths to accomplish something.", "title": "Knowing Your Strengths", "category": "Grow" }
- 25. 25 Rini and Jojo Work It Out: The Super-Fast Apple Sorting Machine { "skill": "Physical", "placement": "Post", "activity": "Rini and Jojo made an apple sorting machine. Gather some small balls or rolled up socks. See if you can gently toss them into a basket or box. Take a step back each time to make it more challenging. How many can you get in a row?", "title": "Toss and Sort", "category": "Play“ }
- 26. Summary 26 • Activity generation time reduced from days to seconds • More creative, less repetitive activities • Solution delivered within a month • High value with out of the box tools • Scaling to zero architecture
- 27. 27 Key takeaways • There are founds for AI4Good • LLMs are not only user facing chatbots • Close collaboration with a client was crucial as there was no ground truth • Start small and build around feedback and failure
- 28. Thank you Questions? How to reach us? dziezyc.ai LinkedIn: Ewelina Kucal
- 29. 29 Disclaimer • This publication contains proprietary information that is protected by copyright. SoftwareOne reserves all rights thereto. • SoftwareOne shall not be liable for possible errors in this document. Liability for damages directly and indirectly associated with the supply or use of this document is excluded as far as legally permissible. • The information presented herein is intended exclusively as a guide offered by SoftwareOne. The publisher's product use rights, agreement terms and conditions and other definitions prevail over the information provided herein. The content must not be copied, reproduced, passed to third parties or used for any other purposes without written permission of SoftwareOne • Copyright© by SoftwareOne. All Rights Reserved. SoftwareOne is a registered trademark of SoftwareOne. All other trademarks, service marks or trade names appearing herein are the property of their respective owners.