Fabric Architecture Podcast

Event Schema Set: Contracts That Stop Midnight Breakage


Listen Later

Event Schema Set: Contracts That Stop Midnight Breakage

Episode 21 • 2026-05-22

Event Schema Set is Fabric's contract layer for streaming data — but it ships in Preview with real gaps. Matthias and Fabia unpack the retrofit trap, the dead-letter gap everyone worries about, and when Confluent Schema Registry is honestly the better call.

What we discuss

  • A real-world mistake from a pre-Fabric era
  • The one question that reframes the architectural debate
  • How we got here — predecessor products and evolution
  • Why the "obvious" answer is often wrong
  • A real Reddit/Microsoft Q&A question unpacked
  • The concrete recommended architecture
  • F-SKU realism — what this actually costs
  • When the rejected approach is actually right
  • Risks of the recommended path
  • What Microsoft is shipping that changes the calculus
  • The architectural principle to take home
  • Key takeaways

    • Treat schemas as append-only contracts. Add fields with defaults — safe. Remove required fields — breaks consumers. Change a type — silent data corruption. Rename a field — silent loss in KQL queries. The system won't stop you. Your...
    • Fair argument. And honestly? If you're an existing Kafka shop with established Confluent practices — use Confluent. The migration cost isn't worth it. Eventstream can deserialize Confluent-encoded payloads natively. You get Avro plus JSON...
    • But you operate a separate cluster. Separate auth. Separate billing. If your entire stack is Fabric-native — Eventstream, Notebook, Activator, Eventhouse — the integration is a real win. No client library. No external cluster. Governance...
    • Resources

      • Schema Registry — known limitations
      • CloudEvents 1.0
      • Use schemas in eventstreams
      • Real-Time Hub Schemas
      • Business Events Concepts
      • Consume Business Events from Activator
      • Eventhouse
      • Confluent Kafka source
      • Schema Registry in Fabric Real-Time Intelligence (preview) — Overview
      • Create and manage event schema sets
      • Create and manage event schemas in schema sets
      • EventSchemaSet REST API definition
      • Eventstream Overview — Schema Management section
      • Multiple-Schema Inferencing in Eventstream (Preview)
      • Eventstream Data Formats: JSON, CSV, Avro
      • About the show

        Built on ElevenLabs voice synthesis. Matthias — cloned voice. Fabia — designed AI co-host. See Matthias live on YouTube (Fabric Friday), at his meetups, and at conferences like FabCon.

        Hosted by Matthias Falland — Microsoft Data Platform MVP and community architect behind the Fabric Periodic Table. New episodes every Friday.

        Submit your case

        Have an architecture decision you are wrestling with? DM Matthias on LinkedInfind him as Matthias Falland. Three to five sentences about the decision, your team size, and your current stack. We anonymize before airing.

        Built on ElevenLabs voice synthesis. Brand design based on fabricperiodictable.com.

        ...more
        View all episodesView all episodes
        Download on the App Store

        Fabric Architecture PodcastBy Matthias Falland