In this episode, we chat with Chris Riccomini about the evolution of stream processing and the challenges in building applications on streaming systems. We also chat about leaky abstractions, good and bad API designs, what Chris loves and hates about Rust and finally about his exciting new project that involves object storage and LSMs.
Connect with Chris at:LinkedInXBlogMaterialized View Newsletter - His newsletter
The missing README - His book
SlateDB - His latest OSS Project
Chapters
00:00 Introduction and Background
04:05 The State of Stream Processing Today
08:53 The Limitations of SQL in Streaming Systems
14:00 Prioritizing the Developer Experience in Stream Processing
18:15 Improving the Usability of Streaming Systems
27:54 The Potential of State Machine Programming in Complex Systems
32:41 The Power of Rust: Compiling and Language Bindings
34:06 The Shift from Sidecar to Embedded Libraries Driven by Rust
35:49 Building an LSM on Object Storage: Cost-Effective State Management
39:47 The Unbundling and Composable Nature of Databases
47:30 The Future of Data Systems: More Companies and Focus on Metadata
