streaming - Rion.IO

Surviving the Streaming Dungeon with Kafka Queues

Recently, I’ve been borderline addicted to Matt Dinniman’s Dungeon Crawler Carl series, which I cannot recommend enough. The books drop their characters into massive, chaotic dungeons filled with monsters, traps, loot, and a deeply unhinged AI that seems determined to keep things interesting. If you’re wondering what

apache flink kafka debezium

Prepare for Launch: Enrichment Strategies for Apache Flink

Sometimes, when we’re getting ready to launch a new Apache Flink job — or even just roll out a major new feature — we run into a familiar problem: we need meaningful data in state before the job can do what we built it to do. While enrichment is probably the

apache flink ai streaming

Exploring Squirrelly Apache Flink Performance Issues through Continual AI-Driven Evaluation

Last month, I wrote up a blog post discussing a three-phase cycle (profile, analyze, improve) for leveraging LLMs and other AI tooling to evaluate Apache Flink jobs for potential performance improvements. This post goes through what that process might look like in a more automated fashion to help you track

apache flink streaming open-source

Exploring Dynamic Sink Routing in Apache Flink via DemultiplexingSink

Last year, I wrote a blog post discussing ideas on how to support use-cases in Apache Flink that required dynamically resolving (and potentially creating) sinks at runtime based on the incoming data. While this solution was fairly practical, it was written against older APIs as opposed leveraging the new Unified

streaming ai community

Reflections on Current 2025: Streaming, AI, Beignets, and The Buffalo Bills?

As the mental (and possibly physical) hangover begins to wear off, I figured I’d take a moment to reflect on my recent trip to Confluent’s 2025 Current conference, conveniently held right here in my home state of Louisiana. It was a week filled with brilliant people, incredible sessions,

apache flink ai streaming

Incremental Optimization in Apache Flink ... with AI

While performance always matters, streaming pipelines are where it can matter a lot. Concepts like Big O notation that you may have repressed from your days learning computer science can come back to bite you if neglected (I’m looking at you, quadruply nested loops). Often, the most minimal of

apache flink streaming kotlin

Dynamic Sink Routing in Apache Flink

Apache Flink makes it incredibly seamless to take your streaming data and throw it exactly where you want it to go. It supports tons of different sources and sinks out of the box to easily plug and play to your ETL'ing hearts desire. But what happens when you

kotlin apache beam learning

Avoiding Kotlin Minefields in Apache Beam

Without a doubt, the Java SDK is the most popular and full featured of the languages supported by Apache Beam [https://beam.apache.org/] and if you bring the power of Java's modern, open-source cousin Kotlin [https://kotlinlang.org/] into the fold, you'll find yourself with

kafka learning streaming

An Education in Streaming

I’m probably one of the few folks out there that love a good technical book. Sure, well written blog posts, tutorials, and exploratory projects are amazing, but if you really want to dig deep, books can be a great resource. Since I’ve fallen in love with streaming data