Beam Summit 2022 - Writing a Native Go Streaming Pipeline

Session presented by Danny McCormick and Jack McCluskey, at Beam Summit 2022. Over the past year, the Beam Go Sdk has rolled out several features to support native streaming DoFns. During this talk, Danny, Software Engineer at Google, and Jack, Software Engineer at Google, dig into those features and discuss how they can be used to build streaming pipelines written entirely in Go. You will come away with an understanding of some of the challenges associated with processing unbounded datasets. You will also learn how you can build your own custom streaming splittable DoFns to address those challenges.