Published data stream to Kafka (aka Azure Event Hubs), serialized it and wrote SparkSQL queries against resulting Delta Lake tables.