Don't Panic! It's Just Data

Managing network traffic efficiently is essential to control cloud costs. Network flow

reports are critical in providing detailed insights into data movement across cloud

environments. These reports help organisations identify usage patterns, track

bandwidth consumption, and uncover inefficiencies that may lead to higher expenses.

With a clear understanding of how data flows, businesses can make informed decisions

to optimise traffic, reduce unnecessary data transfers, and allocate resources more

effectively. This helps lower cloud costs, improves network performance, and enhances

security by revealing unusual or potentially harmful traffic patterns.

In this episode, Wayne Eckerson from Eckerson Group speaks to Ben Schaechter,

CEO of Vantage, about optimising network traffic costs with Vantage’s Network Flow

Reports.

Key Takeaways:

● Network Flow Reports provide detailed insights into AWS costs.

● They help identify specific resources driving network traffic costs.

● Organisations can reduce costs by up to 90% with proper configuration.

● The shift towards cost management in cloud services is critical.

● FinOps teams are becoming essential for cloud cost optimization.

● Anomaly detection can alert teams to unexpected cost spikes.

● Vantage integrates with multiple cloud providers for comprehensive cost

management.

● Effective cost management does not have to impact production workflows.

Chapters:

00:00 - Introduction to Vantage and Network Flow Reports

02:52 - Understanding Network Flow Reports and Their Impact

06:09 - Real-World Applications and Case Studies

09:03 - The Shift in Cost Management Focus

11:54 - Tangible Benefits of Implementing Network Flow Reports

15:07 - The Role of FinOps in Cost Optimization

18:00 - Conclusion and Future Insights

Safe Software’s FME is transforming Omaha’s approach to urban mobility with groundbreaking solutions for asset management, e-scooter tracking, and parking management. 

FME’s robust data integration capabilities are at the core of Omaha’s advancements. The data integration platform enables real-time tracking of e-scooters, offering precise data on their locations and usage patterns. This innovation enhances the management and accessibility of e-scooters, making urban mobility more efficient and user-friendly.

Automated parking management processes, facilitated by FME, streamline city operations and reduce manual efforts. This automation leads to smoother parking experiences for residents and visitors, while dynamic rate adjustments, powered by FME, ensure that parking fees are responsive to real-time demand, optimising availability and revenue.

In this episode, Wayne Eckerson from Eckerson Group speaks to Jacob Larson, an Applications Analyst from the City of Omaha, to discuss Omaha’s usage of FME. 

Key Takeaways:

• FME helps automate the tracking of e-scooters in real time.
• Data sharing agreements with providers like Lime enhance tracking capabilities.
• Omaha's parking management has been transformed through automation.
• FME allows for dynamic changes in parking rates based on events.
• The integration of GIS data with third-party APIs is crucial for parking management.
• Omaha is pioneering a real-time parking information system in the US.

Chapters: 

00:00 - Introduction to Omaha's Data Initiatives

01:03 - FME's Role in Asset Management

04:53 - Real-Time Tracking of E-Scooters

07:48 - Automating Parking Management

10:06 - Innovations in Parking Availability

12:59 - Dynamic Parking Rate Management

Safe Software’s FME is transforming Omaha’s approach to urban mobility with groundbreaking solutions for asset management, e-scooter tracking, and parking management. 

FME’s robust data integration capabilities are at the core of Omaha’s advancements. The data integration platform enables real-time tracking of e-scooters, offering precise data on their locations and usage patterns. This innovation enhances the management and accessibility of e-scooters, making urban mobility more efficient and user-friendly.

Automated parking management processes, facilitated by FME, streamline city operations and reduce manual efforts. This automation leads to smoother parking experiences for residents and visitors, while dynamic rate adjustments, powered by FME, ensure that parking fees are responsive to real-time demand, optimising availability and revenue.

In this episode, Wayne Eckerson from Eckerson Group speaks to Jacob Larson, an Applications Analyst from the City of Omaha, to discuss Omaha’s usage of FME. 

Key Takeaways:

• FME helps automate the tracking of e-scooters in real time.
• Data sharing agreements with providers like Lime enhance tracking capabilities.
• Omaha's parking management has been transformed through automation.
• FME allows for dynamic changes in parking rates based on events.
• The integration of GIS data with third-party APIs is crucial for parking management.
• Omaha is pioneering a real-time parking information system in the US.

Chapters: 

00:00 - Introduction to Omaha's Data Initiatives

01:03 - FME's Role in Asset Management

04:53 - Real-Time Tracking of E-Scooters

07:48 - Automating Parking Management

10:06 - Innovations in Parking Availability

12:59 - Dynamic Parking Rate Management

Open source technologies are transforming how businesses manage real-time data on cloud platforms. By leveraging flexible, scalable, and cost-effective open-source tools, organisations can process and analyse large volumes of data with speed and precision. These technologies offer unmatched transparency, customisation, and community-driven innovation, making them ideal for real-time monitoring, analytics, and IoT applications.

As data demands grow, open-source solutions ensure that businesses stay agile, reduce vendor lock-in, and maintain full control over their cloud infrastructure. The result? Faster insights, smarter decision-making, and enhanced performance—all powered by open source. 

In this episode, Paulina Rios Maya, Head of Industry Relations at EM360Tech, speaks to Mikhail Epikhin, Chief Technology Officer at Double Cloud, about The Power of Open Source in Cloud Platforms. 

Key Takeaways:

• Open-source technologies provide standard building blocks for products.
• Community-driven innovation is essential for the evolution of technology.
• Flexibility in data infrastructure is crucial for real-time processing.
• Observability and monitoring are vital for performance optimisation.
• Managed services can accelerate product development and feature implementation.

Chapters:

00:00 - The Power of Open Source in Cloud Platforms

05:24 - Apache Airflow: Enhancing Real-Time Data Management

10:08 - Balancing Open Source and Managed Services

13:57 - Best Practices for Scalability and Performance

Big Data LDN 2024, the UK’s leading data, analytics, and AI event, is less than a week away – promising two days filled with ground-breaking stories, expert insights, and endless innovation.

Taking place at the Kensington Olympia in London on September 18-19, this year’s event features fifteen theatres and over 300 expert speakers sharing insights on some of the industry’s hottest topics – from generative AI to data analytics and privacy. 

With the event less than a week away, EM360Tech’s Head of Podcast Production, Paulina Rios Maya, grabbed Big Data LDN’s Event Director, Andy Steed, for a chat about his expectations for this year’s event and its growing importance in the data world.

In the episode, they discuss: 

• The exciting themes or breakthroughs attendees can expect to see showcased this year
• How Big Data London remains relevant in such a rapidly evolving field
• The unique networking opportunities or interactive experiences attendees have at the conference
• The standout sessions or keynote speakers at the conference

00:00: Introduction to Big Data LDN 2024

01:35: Showcasing Data Stories, Transformations, and Challenges

02:33: The Networking Opportunities with Industry Leaders and Peers at Big Data LDN 2024

05:01: Staying Relevant with a Focus on Generative AI and Real-World Use Cases

06:55:The Importance of Data Events for Community Building and Learning

Big Data London is the UK's largest data and analytics event, attracting over 16,500 visitors each year. Taking place at the Olympia in London on September 18-19, this year’s event features fifteen theatres and over 300 expert speakers across the two-day conference. 

Attendees can meet face-to-face with tech providers and consultants to find solutions to your data challenges and view the latest product releases and software demos to enhance your business' data capabilities.

It’s also a great opportunity for attendees to strengthen their business network with new and existing partners, and immerse themselves within the data community and network with speakers, colleagues and practicioners all in 2 days at Big Data LDN.

Sign up to Big Data LDN 2024 today and be part of the UK’s leading hub for the Data Community to learn and share best practices, build relationships and find the tools needed to develop an effective data-driven business.

We can’t wait to see you there!

Sustainable sourcing is essential for businesses committed to environmental and social responsibility, but achieving it requires accurate and reliable data. Master Data Management (MDM) ensures that all sourcing data—such as supplier information, certifications, and compliance records—is consistent and up-to-date. This enables organisations to make informed decisions that align with their sustainability goals, reduce waste, and promote ethical practices throughout their supply chain.

MDM is the foundation of a successful sustainability strategy. By providing a single source of truth for all critical data, MDM helps businesses monitor and track their sustainability efforts effectively. With accurate data, companies can identify opportunities to improve resource efficiency, reduce carbon footprints, and ensure compliance with environmental standards, ultimately leading to a more sustainable and resilient business model.

In this episode, George Firican, Founder of LightsOnData, speaks to Matthew Cawsey, Director of Product Marketing and Solution Strategy, and Paarijat Bose, Customer Success Manager at Stibo Systems, to discuss sustainable sourcing and why accurate data matters. 

Key Takeaways:

• Sustainable sourcing involves understanding the provenance and environmental impact of products, ensuring compliance with regulations, and meeting sustainability goals.
• Data completeness and accuracy are crucial in meeting regulatory requirements and avoiding issues like greenwashing.
• Managing sustainability data requires a solid foundation of MDM to ensure data accuracy, stewardship, and semantic consistency.
• MDM solutions help companies collect, manage, and share sustainability data, enabling them to meet compliance requirements and achieve their sustainability goals.

Chapters:

00:00 - Introduction and Overview

01:07 - The Challenge of Collecting Data for Compliance and Reporting

02:31 - Data Accuracy and Completeness in the Supply Chain

05:23 - Regulations and the Demand for Transparent and Complete Data

08:41 - The Role of Master Data Management in Sustainability

15:51 - How Data Management Technology Solutions Help Achieve Sustainability Goals

21:02 - The Need to Start Early and Engage with Data Management Solutions

22:01 - Conclusion and Call to Action

Data provenance is essential for maintaining trust and integrity in data management. It involves tracking the origin of data and understanding how it has been processed and handled over time. By focusing on fundamental principles such as identity, timestamps, and the content of the data, organisations can ensure that their data remains accurate, consistent, and reliable.

Implementing data provenance does not require significant changes or large investments. Existing technologies and techniques can be seamlessly integrated to provide greater transparency and control over data. With data provenance, businesses can confidently manage their data, enhancing decision-making and fostering stakeholder trust.

In this episode, Jon Geater, Co-Chair of the Supply Chain Integrity Transparency and Trust (SCITT) Working Group, speaks to Paulina Rios Maya, Head of Industry Relations, about data provenance. 

Key Takeaways: 

• Data provenance is knowing where data comes from and how it has been handled, ensuring trust and integrity.
• The fundamental principles of data provenance include identity, timestamps, and the content of the data.
• Data provenance can be implemented by integrating existing technologies and techniques without significant changes or investments.
• Data provenance helps with compliance, such as GDPR, by providing a transparent record of data handling and demonstrating compliance with requests.

Chapters: 

00:00 - Introduction and Background

02:01 - Understanding Data Provenance

05:47 - Implementing Data Provenance

10:01 - Data Provenance and Compliance

13:50 - Success Stories and Industry Applications

18:10 - Conclusion and Call to Action

FME is a vital tool in disaster management and response. It enables the integration and transformation of geospatial data for real-time tracking of disasters and hazards. By ensuring accurate and timely data analysis, it provides essential decision support for disaster management professionals.

During the Maui wildfires, FME and the Pacific Disaster Centre were crucial in managing and analysing critical data, allowing for effective coordination and response. By facilitating seamless data sharing and collaboration among stakeholders, FME helps ensure that the correct information reaches the right people at the right time.

In this episode of the EM360 Podcast, Alejandro Leal, an Analyst at KuppingerCole, speaks to Jorma Rodieck, a GIS Specialist at the Pacific Disaster Centre, about the importance of FME. 

Key Takeaways:

• FME is an essential tool in disaster management and response, allowing for the integration and transformation of geospatial data.
• FME enables real-time data analysis and decision support for disaster management professionals.
• During the Maui wildfires, FME was instrumental in managing and analyzing critical data, providing a common operating picture for response efforts.
• FME ensures effective data sharing and collaboration among various stakeholders, enabling smooth interoperability between departments and agencies.

Chapters:

00:00 - Introduction and Background

02:35 - The Role of FME in Disaster Management

06:44 - Managing and Analyzing Critical Data with FME

10:34 - FME's Impact during the Maui Wildfires

11:59 - Ensuring Effective Data Sharing and Collaboration

15:20 - The Future of FME in the Pacific Disaster Center

18:15 - Conclusion

Open source real-time analytics offers unparalleled advantages, providing businesses with freedom and independence to maintain operations seamlessly, even if a vendor issue arises. However, the journey isn't without its challenges. Open source solutions can often be clunky and require specialised expertise to manage effectively. 

This is where DoubleCloud comes in, offering a managed platform that addresses these obstacles by handling crucial responsibilities such as backups, high availability, and security updates, allowing businesses to focus on leveraging their data.

In this podcast, Christina Stathopoulos speaks to Vladimir Borodin, Co-Founder and CEO of DoubleCloud, about open source strategies and the advantages of the DoubleCloud solution.  

Key Takeaways:

• DoubleCloud's managed platform helps overcome the challenges of open source, such as clunkiness and a lack of expertise.
• Successful customer use cases demonstrate the performance and cost benefits of DoubleCloud's solution.
• The transition phase to DoubleCloud's solution depends on the complexity of the application.
• Using open source whenever possible is recommended.

00:00 - Introduction and Background

02:29 - The Advantages of Open Source

04:21 - Challenges of Open Source

06:47 - The Power of Real-Time Analytics

09:11 - Success Stories: Improved Performance and Reduced Costs

12:54 - Navigating the Transition to DoubleCloud's Solution

15:14 - The Importance of Using Open Source

Privacy by Default and Design is a fundamental principle of the General Data Protection Regulation (GDPR). It prioritises transparency, user control, and data security from the outset. This approach ensures that privacy is integrated into systems and processes by default rather than as an afterthought. 

By embedding these practices, organisations enhance trust and accountability while meeting regulatory requirements. However, challenges such as resistance to change and the need for cultural transformation must be addressed to implement this principle effectively.

In this episode of the Don’t Panic It’s Just Data, Tudor Galos, Senior Privacy Consultant, speaks to Paulina Rios Maya, Head of Industry Relations, about the impact of privacy by default and design extend to user experience, where issues like consent fatigue and the necessity for user-friendly interfaces arise. 

Key Takeaways:

• Organisations face challenges in implementing privacy by default and design, including resistance to change and the need for cultural transformation.
• Privacy by default and design impact user experience, with issues like consent fatigue and the need for user-friendly interfaces.
• Regulations like GDPR and CCPA incorporate privacy by default and design principles, emphasising compliance and accountability.

Chapters:

00:00 - Introduction and Overview

01:00 - Core Principles of Privacy by Default and Design

02:19 - Difference from Traditional Privacy Practices

04:09 - Challenges in Implementing Privacy by Default and Design

05:33 - Impact of Privacy by Default on User Experience

08:14 - Alignment of Privacy by Default with Regulations

09:04 - Ensuring Compliance and Trust

11:24 - Implications of Emerging Technologies on Privacy

13:15 - Innovations in Privacy-Enhancing Technologies

15:50 - Conclusion