Analyze Happy: Crafting Your Modern Data Estate

Send us a text

In this episode, we dive deep into how Microsoft Fabric stacks up against Azure Databricks' Unity Catalog when managing confidential and highly regulated data like Personally Identifiable Information (PII). You'll learn:

• The current state of Fabric's governance features, including Purview integration, access control via Azure AD, and OneLake's secure storage capabilities.
• How Unity Catalog excels with granular RBAC, real-time lineage tracking, and VNet-native security.
• Practical guidance for setting up hybrid architectures that leverage both platforms for secure, compliant data modernization.
• Real-world tips on anonymizing PII, monitoring with Azure SRE Agent, and automating policy enforcement with GitHub Copilot.

Whether you're planning a secure BI layer, orchestrating PII data flows, or modernizing legacy systems—this episode equips you with the clarity and strategy to make confident decisions on Fabric and Databricks in the Azure ecosystem.

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!

Send us a text

Discover how data-driven decision-making (DDDM) is transforming the way businesses operate and make choices. This episode explores the growing recognition that relying on data, rather than solely on intuition, leads to more confident and proactive strategies. Learn about the numerous advantages of DDDM, including increased efficiency and productivity, improved customer experience, better risk management, and potential cost savings.

Key Facts and Ideas:

• Paradata is increasingly important: In the age of AI, understanding how data was collected (paradata) is crucial alongside metadata. Blockchain technology may assist with this.
• SMART goals are essential for data initiatives: Defining specific, measurable, achievable, relevant, and time-bound objectives helps track progress in building a data-first culture.
• Data governance is key to overcoming data silos: Establishing guidelines and educating employees on the benefits of data sharing are crucial.
• BI gathers data from internal and external sources: This provides a holistic view for decision-making.
• Executive sponsorship requires formal responsibilities and time commitment: Clearly defining expectations ensures the sponsor's effective involvement.
• Microsoft Fabric aims to simplify data analytics: By integrating various tools onto a single platform, it intends to democratize data access and collaboration.
• Data quality is a significant issue in data transformation: Companies need to address data bottlenecks early in their data journey.
• Too much data can be as challenging as too little: Identifying the right data for decision-making is critical.
• Data should represent real customers: Leaders need to ensure that data analysis doesn't lose sight of the human element. Programs like customer lunch-and-learns can help.
• Informed intuition blends data and experience: It's not just a "gut feeling" but a logical conclusion derived from both analysis and past learnings.
• Developing intuition requires experience and learning from failures: Creating a psychologically safe environment where mistakes are accepted is important.
• Checking intuition with others can validate decisions and gain buy-in.

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!

Send us a text

Struggling to navigate your organization’s overwhelming data jungle? In this episode of Taming the Data Beast, we break down two game-changing tools—data catalogs and data marketplaces—that transform chaos into clarity.

Picture your data as a wild, uncharted forest. A data catalog is your trusty map, pinpointing every asset with details like its source, meaning (metadata), journey (lineage), and usage rules. It’s like a library guide for data, helping everyone from analysts to execs find, understand, and trust the right information fast.

Now, imagine a data product marketplace as a vibrant online shop stocked with ready-to-go data treasures—curated dashboards, reports, APIs, or even AI models. It’s self-service made simple, letting business users grab what they need without tech roadblocks, speeding up decisions and innovation.

Join us as we dive into:  

• How data catalogs supercharge discovery, governance, and teamwork.  
• Why data marketplaces unlock self-service, monetization, and rapid results.  
• The dynamic duo effect: how catalogs fuel thriving marketplaces.  
• Why these tools are your key to a data-driven, empowered organization.

Whether you’re a CIO aiming to maximize data’s potential, a data pro craving efficiency, or just curious about taming complexity, this episode delivers a clear, engaging guide to mastering your data with catalogs and marketplaces—turning your "beast" into a powerhouse.

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!

Send us a text

Welcome to Analyze Happy: Crafting Your Modern Data Estate Podcast. In this deep dive episode, we tackle a critical aspect of building your data future with Microsoft Fabric: security and governance.

As you embrace the power of a unified analytics solution , ensuring the safety and compliance of your data is paramount. Fabric offers a multi-layered security model to address diverse data access requirements.

We'll explore how to apply granular permissions using workspace roles, item permissions, and the OneLake data access roles (preview). Learn how to configure data access through the SQL analytics endpoint and manage permissions for lakehouses, warehouses, and semantic models. Understand that workspace roles grant implicit permissions, while item permissions allow for fine-grained control over individual Fabric items.

Given the focus on OneLake in our previous discussion and the sources, we'll emphasize OneLake security best practices. Discover how to restrict access to specific folders and tables within a lakehouse for various workloads like Apache Spark and SQL analytics endpoints .

We'll also address the crucial topic raised in Don Heerschap's paper: network security for OneLake. While Fabric offers robust data security features, actively setting up network security features like private links remains essential to protect your data from public internet access.

Furthermore, we’ll delve into data protection using sensitivity labels from Microsoft Purview Information Protection, ensuring your data remains classified and protected throughout its lifecycle, even when exported.

Finally, we'll touch upon the governance capabilities within Fabric, leveraging the Admin portal, domains, capacities, and Microsoft Purview to manage, protect, and ensure compliance across your data estate

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!

Send us a text

Discover how Azure Databricks and Microsoft Fabric are working "hand-in-glove"  to forge a robust hybrid data estate as of April 2025. This episode delves into the complementary strengths of each platform, where Databricks excels in heavy data processing, data engineering, and AI/ML, while Fabric provides unified analytics, business intelligence, and a centralized data hub with OneLake2 .

We'll explore how their seamless integration streamlines the data supply chain from ingestion to actionable insights . Learn about Databricks' role in ingesting data from diverse sources  and performing heavy transformations, and how it writes processed data directly to Fabric's OneLake .... We'll also cover how Fabric mirrors external data sources into OneLake  and offers lightweight transformations.

Understand the critical role of OneLake as the shared storage and how Unity Catalog governs data in Databricks, with metadata mirrored in Fabric , creating a single source of truth. We'll highlight how this integration powers advanced analytics in Databricks and enables real-time Power BI reporting in Fabric via Direct Lake mode

Gain insights into the security nuances, including centralized access control with Unity Catalog in Databricks  and RBAC in Fabric, as well as data protection through encryption8  and auditing with Microsoft Purview . We'll also discuss the networking aspects, covering connectivity options like VNet peering  and firewall considerations 

Finally, we'll touch upon the latest 2025 updates, such as enhanced Unity Catalog integration, semantic model publishing ..., improved Databricks activities in Data Factory, and OAuth token federation for secure API access ..., showcasing how these developments further deepen the collaboration between Azure Databricks and Microsoft Fabric for a modern, scalable, and insightful data estate .

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!

Send us a text

This episode explores the crucial steps involved in securely connecting PTC/Kepware's KEPServerEX, a leader in industrial connectivity, to Microsoft Azure IoT Hub through Azure IoT Edge. Learn how leveraging Azure IoT Edge as a gateway enhances security by isolating KEPServerEX from the internet and enables powerful edge processing capabilities . We'll delve into the necessary prerequisites, including setting up an Azure IoT Hub, an IoT Edge device as a transparent gateway, and the KEPServerEX IoT Gateway plug-in . Understand the critical environmental setup, such as managing TLS certificates for secure communication ... and ensuring proper name resolution for the IoT Edge gateway .... We'll also cover the process of registering KEPServerEX with IoT Hub and generating SAS tokens for authentication .... Finally, we'll guide you through the configuration of the KEPServerEX IoT Gateway agent to establish a secure MQTT over TLS connection to your Azure IoT Edge device .... Discover how this integration unlocks the potential to preprocess industrial data at the edge, paving the way for advanced analytics and machine learning without sending all detailed data to the cloud .

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!

Send us a text

Dive into the world of Microsoft Fabric and Power BI optimization with Semantic Link and Semantic Link Labs. Join us as we unravel the power of these Python libraries within Fabric Notebooks, demonstrating how they bridge the gap between data science and BI, automate tedious tasks, and unlock new possibilities for managing your semantic models and reports – even if you're not a Python expert.

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!

Send us a text

Unlock your organization's next level of productivity with AI. Welcome to "The AI-Powered Workplace", the podcast providing a strategic executive overview of Microsoft 365 Copilot and Agents. Discover how Microsoft's integrated AI assistant enhances efficiency across your familiar Microsoft 365 applications, leveraging secure access to organizational data for intelligent, context-aware support

Learn how specialized Microsoft Agents, built on platforms like Copilot Studio automate key tasks and streamline business processes, driving operational excellence . We address critical leadership considerations, including licensing models6 , robust security measures, and essential governance policies, ensuring responsible and impactful AI implementation.

Gain actionable insights to strategically leverage these powerful intelligent automation technologies, fostering a more productive, innovative, and ultimately, more efficient workplace Tune in to navigate the future of work with Microsoft AI and empower your organization's succe

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!

Send us a text

This podcast  delves into the transformative capabilities of this open-source storage framework, exploring how it delivers reliability, performance, and scalability for modern data architectures. For practitioners, we break down key optimization techniques like V-Order for lightning-fast query performance across Microsoft Fabric compute engines and Apache Spark .... Understand how Delta Lake's ACID transactions, schema evolution, and time travel ensure data integrity and simplify complex data pipelines. 

For senior executives, this podcast  highlights the strategic benefits of adopting a Lakehouse architecture with Delta Lake at its core. Discover how Delta Lake unifies batch and streaming data processing, reduces operational complexity, and enhances data governance. We discuss how features like Optimize Write address the "small file problem" and improve analytical workload efficiency. Gain insights into how organizations are leveraging Delta Lake for critical use cases, from financial services to retail, driving data-driven decision-making and innovation.

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!

Send us a text

This podcast delves into the world of intelligent AI agents and Microsoft Fabric, exploring how these cutting-edge technologies are revolutionizing enterprise operations. Discover how AI agents automate everyday tasks and complex workflows, boosting productivity for practitioners, while Microsoft Fabric provides the unified data platform necessary to scale AI initiatives and drive strategic advantages for senior executives. Learn how to leverage these innovations for enhanced efficiency, better decision-making, and a competitive edge in the age of AI.

Support the show

Thank you for tuning in to "Analyze Happy: Crafting Your Data Estate"!
We hope you enjoyed today’s deep dive. If you found this episode helpful, don’t forget to subscribe for more insights on building modern data estates with Microsoft technologies like Fabric, Azure Databricks, and Power Platform.

Connect with Us:

• Have a question or topic you’d like us to cover? Reach out on linkedin.com/company/dataqubi or [email protected]
• Visit our website at www.dataqubi.com or episode resources, show notes, and additional tips on data governance, AI transformation, and best practices.

Stay Ahead:
Check out the Microsoft Learn portal for free training on Azure IoT, Fabric, and more, or explore the Azure Databricks community for the latest updates. Let’s keep crafting data solutions that fit your organization’s culture and tech landscape—happy analyzing until next time!