Practical Applications of AI in Media Production and Broadcast
Download as PPTX, PDF0 likes117 views
1. The document discusses practical applications of AI in media production and broadcast, including use cases like scripted/unscripted entertainment, transcription and archiving, closed captions, and localization. 2. It describes Limecraft's cloud-based workflow automation platform that uses AI for tasks like automated logging, computer-assisted editing, subtitling and localization to reduce costs and improve efficiency. 3. Case studies show how the platform has helped productions like a daily soap opera streamline workflows and deliver content like timed subtitles without manual post-processing.
Practical Applications of AI in Media Production and Broadcast
- 1. © LIMECRAFT connected creativity Practical Applications of AI in Media Production and Broadcast (Contact : [email protected])
- 2. LIMECRAFT connected creativity Copyright 2016 Limecraft , NV. Confidential – Distribution prohibited without permission • Intro and Solution Overview • Use Case 1 – Scripted and Unscripted Entertainment • computer assisted logging, transcript-based edit, transfer to edit • Key Feature: Automated processing of raw material, computer assisted logging • Use Case 2 – Transcription and Archiving • computer assisted logging, transcript-based edit, transfer to edit • Key feature: AI (ASR, NER, deep captioning) • Use Case 3 – Closed Captions • same-language subtitling for accessibility purposes • Key feature: automatic “spotting” • Use Case 4 – Localisation • Translated subtitles for localization of content • Key feature: machine translation and timecode management • About Limecraft• A Agenda
- 3. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission 000. Introduction and Solution Overview
- 4. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission LIMECRAFT connected creativity 001. | State of the Art State of the Art • Manual transcription and “annotation” • Unstructured ”meta” information • Limited collaboration potential Traditional methods don’t scale • Increasing volumes of raw material • Increasing post-production cost • Several output versions versions
- 5. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission LIMECRAFT connected creativity COR E Editing (Avid Media Composer/Adobe Premiere/ Apple FC) Transcoding/EDL Processing/Machine Transcription/Machine Translation/… On Premise Media Asset Management System Customer or Cloud infrastructure Logging (Flow) Ingest (Edge) Subtitling (Flow) Editing Gateway (Edge) Shoot (ARRI, Sony, RED, Panasonic, Canon) Transcription (Limecraft ‘Transcriber’) Existing Application Landscape Limecraft Platform Value Added3rd Partyapps On Premise Media Asset Management System Customer or Cloud infrastructure Cloud Connector 3rd party Cloud infrastructure 000. Limecraft Platform
- 6. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity Limecraft Flow is a cloud-based Asset Management and Workflow Automation platform Key Features • Cloud-based • White labeled • Turn-key integration with any existing storage, tape and MAM solutions • Flexibly Customisable Workflows • API to access individual micro- services Using AI for automation • Production: automate logging • Post-production: computer assisted edit • Mastering: subtitling and localisation Key Benefits to end user • No loss of material or redundant
- 7. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity How can we take advantage of Artificial Intelligence (AI)? – Which data? – How to handle inaccuracy? – What’s the benefit for production?
- 8. 001. Use Case 1 – Ingest and Transfer to Edit
- 9. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission LIMECRAFT connected creativity Limecraft automatically processes dailies overnight. Using speech-to-text, shots are automatically cut into scenes. Key Features • 1000 files per day automatically tagged • Overall version control • Local storage, online collaboration Key Benefits • No loss of material or redundant copies • Faster access for review and pre-cut • Reduction of the turn around time
- 10. © LIMECRAFT connected creativity Limecraft “Edge” for on site processing • Local Client for offload, dailies encoding • Play-out of native formats • Automated audio sync and colour grading • Checksum verification after each transfer • Transfer to Edit platform/PAM/MAM Key benefits • Ease of use – a single tool for offload, encoding of proxies and ingest • Multiple parallel transfers in a single operation • Maximum protection against errors 001. Edge
- 11. LIMECRAFT connected creativity Copyright 2019 Limecraft , NV. Confidential – Distribution prohibited without permission Raw Footage on Offline storage Limecraft Cloud Connector Edge Client Limecraft Flow Headquarters 001. More complex Avid Integration
- 12. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity Case Study: ‘Un si grand soleil’ by France Télévisions Format • Daily soap • Shot in Montpellier, cut in Paris • 3 studios, Multi-cam, VFX on set Challenges • 8 files per “shot”, up to 1000 files per day • High post-production rythm: 1 episode per day • Deliver the master data to enable interactive output Solution • Integrate script and breakdown • Automated transfer back and forth Avid Interplay, grading, VFX, Sound • Delivers timed subtitles and master data without manual post processing More info : https://www.limecraft.com/2020/02/16/case-study-the-sun-chronicles/
- 13. 002. Use Case 2 – Transcription and Archiving
- 14. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission ASR automatically turns audio into timed text in 122 languages. Using complementary NLP and NER, we can automatically tag and categorize content fragments. Use Cases • Machine transcription • Manual post-editing for 100% accuracy • Auto-tagging • Ease of searching • Text-based pre-cut (paper-edit)
- 15. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity
- 16. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission LIMECRAFT connected creativity 19.2 | Product Update: Named Entity Recognition
- 17. Centralized and structured transcription and logging of material -> Faster cataloguing, better search and retrieval, offline edit – Supervised or unsupervised Machine transcription (ASR) and Named Entity Recognigion – Manual Post-editing of the Transcript • Correct segmentation and interpunction • Correct recognition errors – Search and Selection • Every word is time-coded • Pick specific parts or subclips to an order or shopping basket – Hand-over to Edit Workstation or Archive • Compatible with Avid MC, Avid Interplay, Adobe Premiere
- 18. 003. Use Case 3 – Subtitling
- 19. Automatic creation of subtitles – Machine transcription – Spotting rules – Delivered in a variety of formats, including EBU-TT-D, SRT, STL, etc. Key benefits – 50% cost saving compared to manual subtitling – Producers and distributors can create subtitles themselves – Retain the rights of the subtitles
- 20. LIMECRAFT connected creativity 003. Subtitling Objective • Shorter cycle time • Significant cost reduction Findings (Victoria Barlow, key user) • I never even read the instructions. So I just went straight in and it was easy to figure out what I needed to do. • It was super easy for me to tweak the words, the timings, placement,… • Small things, which could be easily overlooked, like when I tweaked some words then hit play, the video automatically skips back a couple of seconds so I hear and see what I did, without having to scroll back myself – genius. • Having he warnings pop up when my subtitle chunks were too long is a really nice learning tool, and saves me having to manually check Challenge • Cut transcription into closed captions, taking into account BBC style guide Solution • Full-featured subtitle editor
- 21. LIMECRAFT connected creativity 004. Full Automation
- 23. 1. Auto-transcription of logging forms the basis for the next step: assistance of localized subtitling • Together with BBC we’ve been working on providing subtitling workflows to end users – Journalists, content producers who typically have no easy direct access or budget to subtitling
- 24. LIMECRAFT connected creativity 004. Subtitling Objective • Shorter cycle time • Significant cost reduction Achieved (Victoria Barlow, key user) • I never even read the instructions. So I just went straight in and it was easy to figure out what I needed to do. • It was super easy for me to tweak the words, the timings, placement,… • Small things, which could be easily overlooked, like when I tweaked some words then hit play, the video automatically skips back a couple of seconds so I hear and see what I did, without having to scroll back myself – genius. • Having he warnings pop up when my subtitle chunks were too long is a really nice learning tool, and saves me having to manually check Challenge • Cut transcription into closed captions, taking into account BBC style guide Solution • Full-featured subtitle editor
- 25. 004. Use Case 4 – Localisation
- 26. Localisation is a different ball game – Using Machine translation (not Automatic Speech Recognition) – Not intended for the hard of hearing – Maintain consistent timing Using Machine Translation – Translating existing subtitles (the “Template”) – Adding non-domestic subtitles at marginal cost – Enabling producers and distributors to extend their reach
- 28. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity Business Case - Subtitling and localisation Subtitling and localisation • Translation of scripts and subtitles • Supports >100 languages • Automatic Spotting Key features • Secure online service – no downloads required • Configurable spotting rules • Computer Assisted QC Business Case • Saves up to 80% of the cost due to manual work • Reduces the turn around time Free try available : www.limecraft.com
- 30. LIMECRAFT connected creativity Limecraft: The Company • Incorporated May 2010, privately owned • Market – Film, Television and Corporate Video • Solution – Cloud-based Workflow Automation and Media Asset Management Video Production worldwide: growing market with compelling opportunities • Industry under pressure to move towards full digital transformation • Government regulations invoke change and investments (subtitling) • Rise of VOD Platforms results in massive demand of more and faster productions Limecraft’s Value Proposition disrupting the current production process • 80% savings in direct production costs • Increased efficiency cuts 30% of the post-production cost • Creating alternative versions (outputs) at marginal cost About Limecraft
- 31. LIMECRAFT connected creativity Media Asset Mgnt Limecraft Flow : From File-based Production to a more Scalable Industrial Process In the cloud where possible, local where necessary Replace paper documents by browser-based(!) applications Interconnect pre-existing Asset Management and Storage Services Metadata processing reduces turn-around times Maximum collaboration and re-use of content 31.
- 32. LIMECRAFT connected creativity Post-Production MasteringProduction Conventional video production involves a lot of manual work and excessive file transfers. This is hard to scale. Due to the rise of VOD platforms, there’s a increasing demand • to process more material on the input side • to create more versions on the output side Limecraft Flow: AI assisted workflows to INDUSTRIALISE media production MASTERINGCOST OUTPUT VERSIONS PRODUCTIONCOST RAW MATERIAL conventional conventional Limecraft Limecraft reduce the cost of material intake (400$>80$ per shooting day) online collaboration offloads 30% of the edit suite capacity different versions at marginal cost (15$ > 1$ per minute) 80% SAVINGS 30% EFFICIENCY X10 PRODUCTIVITY Business Case – how Limecraft Flow addresses today’s Production Challenges
Editor's Notes
- #18: Skip to demo and mention this as walking through the demo!