Building Owly: An AI Comic Video Generator for My Son • Agustinus Nalwan • YOW! 2023
This presentation was recorded at YOW! Perth 2023. #GOTOcon #YOW
Agustinus Nalwan - GM of AI, Data Platform & Data Science @agustinusnalwan2200
RESOURCES
ABSTRACT
Utilising an Amazon Bedrock Large Language Model (LLM) and a fine-tuned Stable Diffusion 2.1 on Amazon SageMaker JumpStart, I developed an AI tech called Owly that crafts personalised comic videos with music, starring my son’s toys as the lead characters.
I will take you through the process (but not limited to) how I utilised LLM to generate the story script via prompt engineering and how I fine-tuned the model to learn to generate an image with a new characters. [...]
TIMECODES
00:00 Intro
02:04 Project faAi
02:56 Project Ellee
04:20 Demo: Ellee in action
06:12 Owly – a personalized comic video generator
07:44 What does Owly do?
08:09 Demo: Owly in action
10:49 How does Owly work?
12:58 LLM
13:18 Demo
16:52 Amazon Bedrock
17:10 Building the comic image generator
17:45 How the Stable Diffusion model was built
19:52 Challenges & enhancements
24:28 Problems & solutions
26:44 unplanned cool feature
30:10 Architecture
32:15 Something cool
33:48 Outro
Download slides and read the full abstract here:
RECOMMENDED BOOKS
Sean Moriarity • Genetic Algorithms in Elixir •
Sean Moriarity • Machine Learning in Elixir •
Ian Goodfellow, Yoshua Bengio & Aaron Courville • Deep Learning •
Francois Chollet • Deep Learning with Python •
#Owly #AI #ArtificialIntelligence #AIVideoGenerator #LLM #AmazonBedrock #AmazonSageMaker #StableDiffusion #AgustinusNalwan #YOWcon
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at
Sign up for updates and specials at
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
1 view
0
0
2 months ago 00:00:53 1
Israeli air strike destroys historic mosque in Lebanon
2 months ago 00:01:22 1
Israeli air strike on Beit Lahiya kills at least 73 Palestinians.
2 months ago 00:00:26 1
Hezbollah drone targets Netanyahu’s house
2 months ago 00:26:23 29
New Infinity N5 Fireteam Rules; All You Need To Know! | Infinity N5 Week
3 months ago 00:00:49 1
Israelis evacuate building in Haifa during Hezbollah rocket attack
3 months ago 00:03:20 1
We Build A MEGA Pirate Gaming Table for Blood & Plunder!
4 months ago 00:15:14 1
What is the ORIGIN of all MASS in the Universe? Physics of symmetry breaking
4 months ago 00:01:19 1
Palestinian woman builds a water purifying device in Gaza
4 months ago 00:02:24 1
Volvo Trucks - Look Who’s Driving feat. 4-year-old Sophie
4 months ago 00:00:43 1
Palestinian civil defence teams rescue baby from building in flames after Israeli air strike
4 months ago 00:12:50 1
Unboxing: Les Grognards Cavalry | Wargames Atlantic
5 months ago 00:01:08 1
Israeli air strikes target residential area in Khan Younis
5 months ago 00:11:13 3
Unboxing: 28mm Late Roman Archers & Slingers | Victrix Miniatures
5 months ago 00:00:31 1
Israeli soldier shares footage of him blowing up Rafah’s water reservoir ’In honour of Shabbat’
6 months ago 00:01:00 1
Palestinians search for victims under rubble following Israeli strike on building in Jabalia
6 months ago 00:01:01 1
Seven Syrians killed during protests at Turkish military bases in northern Syria
6 months ago 00:01:36 1
At least 42 killed in Israeli attacks on northern Gaza on Saturday
6 months ago 00:07:00 1
Footage shows moments of intense Israeli shelling in central Gaza
6 months ago 00:01:22 1
Dutch police attack pro-Palestine protesters in The Hague with batons
7 months ago 00:01:12 1
Israeli settlers set fire to West Bank village
8 months ago 00:07:45 1
Canada’s First 3D Printed Multi-unit Home
8 months ago 00:01:50 1
‘Children are dying from little cuts’ because Israel won’t ‘open gates’ | Miko Peled | UNAPOLOGETIC
8 months ago 00:00:45 1
Police arrest pro-Palestine protesters camping outside Reichstag building in Berlin
8 months ago 02:45:26 1
What life in Gaza has really been like since October 7th | Journalist Youmna El Sayed | UNAPOLOGETIC