OLD VERSION: Building Abstractions at the Hardware-software Boundary - Andrew Bitar & Aidan Wood
UPDATED VERSION:
CppNorth Twitter:
CppNorth Website:
---
Building Abstractions at the Hardware-software Boundary - Andrew Bitar & Aidan Wood - CppNorth 2022
Slides:
CppNorth 2022 video sponsors:
think-cell:
Adobe:
With the slowing of Moore’s law and explosion of ML workloads - there has been a new renaissance in domain specific architectures (DSAs) to help meet today’s compute demands. A large swath of these architectures are spatial in nature where compute is often unrolled in space to expose as much parallelism to accelerate a given workload. With this comes a natural regularity to the overall architecture which software compilers can take advantage of. Here we explore the inherent challenges that traditional architectures like GPUs and CPUs have for the software compilation problem, and discuss how DSAs can avoid such problems in its software architecture.
Additionally, due to the deterministic characteristics of many spatial architectures like FPGAs and Tensor Streaming Processors (TSPs) - we show how we can use software to abstract out many of the details of the hardware to make the software compiler agnostic to specific hardware parameters of the device (such as vector length or number of PEs). Unlike traditional architectures, this allows a software chip-model to drive the underlying algorithms mapping to a given architecture and accurately model the resulting performance of the hardware - even prior to the construction of the device. Furthermore, this makes migration to new devices much simpler and simplifies the overall software development process. We will illustrate these concepts using FPGA open source tools and Groq’s TSP.
---
Andrew Bitar
Andrew Bitar received his MASc from the University of Toronto, where his research focus was on spatial architectures and applications for FPGAs. Before joining Groq, he was a Technical Lead at Intel developing a FPGA Deep Learning Accelerator and compiler. Andrew now leads a team working on Groq’s novel Tensor Streaming Processor compiler, focused on ML and HPC workloads.
---
Aidan Wood
Aidan Wood received his BASc from the University of Waterloo in 2021. During his degree he completed internships at AMD, Ubisoft Toronto, and Intel PSG. He concluded his degree with a capstone project building a configurable soft processor and accompanying LLVM-based C Compiler. At Groq, he is an IC working on Groq’s novel Tensor Streaming Processor Compiler, focused on ML and HPC workloads.
---
YouTube Channel Managed By Digital Medium Ltd:
---
#Programming #CppNorth #abstraction
1 view
3196
1221
3 months ago 00:02:38 1
Lil Nas X - Old Town Road (Official Video) ft. Billy Ray Cyrus
3 months ago 00:01:49 1
Martha by Tom Waits - Kalimba Cover
3 months ago 00:08:04 1
ABBA News – New 4K Video | Björn’s Summer
3 months ago 01:10:24 1
Do not seek revenge or bear a grudge Leviticus 19:18
3 months ago 00:03:18 1
OTYKEN - LEGEND (Official Music Video)
3 months ago 00:01:00 1
Neil LeVang Ghost Riders In The Sky 1961, Iconic cowboy song and its relevance in that era.
3 months ago 00:58:42 1
Retro Sessions - Vol 02 ★ 80’s & 90’s Deep House Mix 2022 By Abee Sash
3 months ago 00:57:42 1
Retro Sessions - Vol 05 ★ 80’s & 90’s Deep House Mix 2023 By Abee Sash
3 months ago 01:01:08 1
Retro Sessions - Vol 03 ★ 80’s & 90’s Deep House Mix 2023 By Abee Sash
3 months ago 00:07:23 1
МАЙКЛ ДЖЕКСОН ЖИВ? (GTA: ПИРАТСКИЙ ПЕРЕДОЗ #2)
3 months ago 00:02:58 1
CASCADA - CALL ME (Official Music Video)
3 months ago 00:04:28 1
lambvaxx - Exquisite Champion
3 months ago 00:04:20 1
Robert Burns - My Love is Like a Red, Red Rose
3 months ago 00:56:25 1
FATHER’S DAY SPECIAL: Osbourne Girl’s Take Over
3 months ago 00:03:00 1
Earth Angel - Marvin Berry & The Starlighters (HQ)
3 months ago 00:21:53 1
NZXT H7 Flow RGB 2024 Case Review
3 months ago 00:03:33 2
LA PALOMA by WALKIN’ SHOES - Instrumental
3 months ago 00:46:51 1
Pharmacist - Medical Renditions Of Grinding Decomposition FULL ALBUM (2020 - Goregrind / Deathgrind)
3 months ago 00:04:12 1
Secret Service — Lit de Parade (OFFICIAL VIDEO, 2021)
3 months ago 00:20:59 1
old songs but it’s lofi remix pt. 2
3 months ago 00:03:57 1
Walking Blues (Robert Johnson) feat. Keb’ Mo’ | Playing For Change | Song Around The World
3 months ago 00:03:05 3
Պսակի երթ / psaki yert major version
3 months ago 00:04:38 1
We Will Rock You (Udo Dirkschneider Version) Official Music Video