After a conversation with one of the ’Textbooks Are All You Need’ authors, I can now bring you insights from the new phi-1 tiny language model. See if you agree with me that it tells us so much more than how to do good coding, it affects AGI timelines by telling us whether data will be a bottleneck.
I cover 5 other papers, including WizardCoder, Data Constraints (how more epochs could be used), TinyStories, and more, to give context to the results and end with what I think timelines might be and how public messaging could be targeted.
With extracts from Sarah Constantin in Asterisk and Carl Shulman on Dwarkesh Patel, Andrej Karpathy and Jack Clark (co-founder of Anthropic), as well as the Textbooks and TinyStories co-author himself, Ronen Eldan, I hope you get something from this one. And yes, the title of the paper isn’t the best.
1 view
347
114
2 months ago 00:00:07 1
Đàn ông có khó cũng nên tập, Là trụ cột gia đình
2 months ago 00:00:09 1
Ngủ ko đủ, người mệt mỏi ko có sức, tập 100 cái mỗi ngày lấy lại tinh thần
2 months ago 00:54:58 1
From Waste Things, I Created My Own Super Boat
2 months ago 01:01:07 1
☯ BASHAR ☯ BEETHOVEN @ 432Hz ♦ 1 HOUR LOOP 7th SYMPHONY MVT. II of the first 3 min..
2 months ago 00:55:55 1
🔥 Best Islands in the World 🔥 Phi Phi Islands in Krabi, Thailand!
2 months ago 00:03:12 1
Vẫn - Right (Video Lyrics) (Unofficial) | Khi Right chơi Drill
2 months ago 00:03:12 1
10/22 PHI vs. WSH Postgame: Travis Sanheim
2 months ago 00:01:30 8
10/22 PHI vs. WSH Postgame: Egor Zamula
2 months ago 00:05:32 2
10/22 PHI vs. WSH Postgame: John Tortorella
2 months ago 00:02:23 1
10/22 PHI vs. WSH Postgame: Samuel Ersson
2 months ago 00:03:16 1
10/22 PHI vs. WSH Postgame: Sean Couturier
2 months ago 00:00:13 1
#Shorts Batte Forte | Choreo | TÌNH AEROBICS
2 months ago 00:17:18 1
⚔️ СТАРКАНИСТ. Мастер рун ДД через одну панель и луч. Весь контент двумя кнопками. TESO(2023)
2 months ago 01:28:09 3
Phil Collins - Live And Loose In Paris
2 months ago 03:20:04 1
Best Classical Music 432Hz 》Mozart • Beethoven • Bach • Chopin 》Piano Violin & Orchestral