“What’s wrong with LLMs and what we should be building instead” - Tom Dietterich - #VSCF2023
Thomas G. Dietterich is emeritus professor of computer science at Oregon State University. He is one of the pioneers of the field of machine learning.
He served as executive editor of the journal called Machine Learning (1992–98) and helped co-found the Journal of Machine Learning Research.
He is one of the members of our select valgrAI Scientific Council.
Keynote: “What’s wrong with LLMs and what we should be building instead”
Abstract: Large Language Models provide a pre-trained foundation for training many interesting AI systems. However, they have many shortcomings. They are expensive to train and to update, their non-linguistic knowledge is poor, they make false and self-contradictory statements, and these statements can be socially and ethically inappropriate. This talk will review these shortcomdifferentings and current efforts to address them within the existing LLM framework. It will then argue for a , more modular architecture that decomposes the functions of existing LLMs and adds several additional components. We believe this alternative can address all of the shortcomings of LLMs. We will speculate about how this modular architecture could be built through a combination of machine learning and engineering.
Timeline:
00:00-02:00 - Introducción
00:00-02:00 Introduction to large language models and their capabilities
02:01-3:14 Problems with large language models: Incorrect and contradictory answers
03:15-4:28 Problems with large language models: Dangerous and socially unacceptable answers
04:29-6:40 Problems with large language models: Expensive to train and lack of updateability
06:41-12:58 Problems with large language models: Lack of attribution and poor non-linguistic knowledge
12:59-15:02 Benefits and limitations of retrieval augmentation
15:03-15:59 Challenges of attribution and data poisoning
16:00-18:00 Strategies to improve consistency in model answers
18:01-21:00 Reducing dangerous and socially inappropriate outputs
21:01-25:26 Learning and applying non-linguistic knowledge
25:27-37:35 Building modular systems to integrate reasoning and planning
37:36-39:20 Large language models have surprising capabilities but lack knowledge bases.
39:21-40:47 Building modular systems that separate linguistic skill from world knowledge is important.
40:48-45:47 Questions and discussions on cognitive architectures and addressing the issue of miscalibration.
45:48 Overcoming flaws in large language models through prompting engineering and verification.
Follow us!
LinkedIn:
Instagram:
Youtube: @valgrai/
Twitter:
1 view
40
16
3 months ago 00:03:30 1
BODY COUNT - Psychopath (LYRIC VIDEO)
3 months ago 00:05:22 10
GET THE SHOT - Dominant Predation feat. PALEFACE SWISS (OFFICIAL VIDEO)
3 months ago 00:06:03 1
Schumann Update 5/20
3 months ago 00:04:18 1
Take Me! [Helltaker Original Song] ★ MiatriSs
3 months ago 00:03:14 1
Nemo - The Code | Switzerland 🇨🇭 | Official Music Video | Eurovision 2024
3 months ago 00:03:55 1
French Affair - Do what you like ( Official Video )
3 months ago 00:03:34 1
Bryan Adams and Melanie C - When You’re Gone (Classic Version)
3 months ago 00:04:28 1
Sinead O’Connor - The Emperor’s New Clothes (Official Music Video)
3 months ago 00:03:24 1
Falling In Reverse - “Watch The World Burn“
3 months ago 00:04:15 1
EMMETT BROWN Ft Sunesis - Holdin’ Back
3 months ago 00:02:59 1
LITTLE BIG - Lobster Popstar (Official Video)
3 months ago 00:05:09 1
Sinéad O’Connor - Nothing Compares 2 U (Official Music Video) [HD]
3 months ago 00:02:32 1
ALMA x Kristian Kostov - So High (Official Video)
3 months ago 00:05:27 1
Judas Priest - Panic Attack (Official Video)
3 months ago 00:09:37 1
What To Do When You Can’t Visualize | Tour of Consciousness with Dr. Dain Heer
3 months ago 00:00:52 1
That’s One Way to WIN | RAINWORLD #shorts #gaming #rainworld
3 months ago 00:00:23 1
I’m just asking you what’s wrong with me putting this in Funny Couple’s Daily Life. This operation
3 months ago 00:06:24 1
Metallica - The Unforgiven (Official Music Video)
3 months ago 00:03:45 1
CHAOSBAY - THE WAY TO HELL (Official Video)
3 months ago 00:01:01 1
Cuban Crocodile Galloping Compilation
3 months ago 00:03:01 2
GOOSEBUMPS Hyemin x Dalsooobin
3 months ago 00:03:54 1
BARRY GIBB _ LINDA GIBB ~ CARRIED AWAY ~
3 months ago 00:03:31 1
The Devil Wears Prada - Salt (Official Music Video)
3 months ago 00:04:02 1
Night Club - “Die in the Disco“ (Official Animated Video)