Data Archives - Software Engineering Daily

By Data Archives - Software Engineering Daily

Technology Tech News

What's Data Archives - Software Engineering Daily about?

Databases and data engineering episodes of Software Engineering Daily

Download our free app to listen on your phone

LAST EPISODE

Highly Scalable NoSQL with ...

09.07.2023

ScyllaDB is a fast and highly scalable NoSQL database designed to provide predictable performance at a massive cloud scale. It can handle millions of operations per second at a scale of gigabytes or petabytes. It’s also designed to be compatible ...

Data Archives - Software Engineering Daily episodes:

09.07.2023 Highly Scalable NoSQL with Dor Laor ScyllaDB is a fast and highly scalable NoSQL database designed to provide predictable performance at a massive cloud scale. It can handle millions of operations per second at a scale of gigabytes or petabytes. It’s also designed to be compatible ...
08.08.2023 Database Caching with Ben Hagan Database caching is a fundamental challenge in database management and there are hundreds of techniques to satisfy different caching scenarios. PolyScale is a fully automated database cache. It offers an innovative approach to database caching, leveraging AI and automated configuration ...
07.20.2023 Data-Centric AI with Alex Ratner Companies have high hopes for Machine learning and AI to support real-time product offerings, prevent fraud and drive innovation. But there was a catch – training models require labeled data that machines can digest. As data volumes increase, the opportunity ...
07.11.2023 Making Data-Driven Decisions with Soumyadeb Mitra RudderStack is a warehouse-native customer data platform (CDP) that helps businesses collect, unify, and activate customer data from all their different sources. In today’s episode, we’re talking to Soumyadeb Mitra, the founder and CEO of RudderStack. We discuss the importance ...
06.30.2023 Customer-facing Analytics with Tyler Wells The state of Data inside most companies is chaotic. It takes significant time and investment to tame this chaos. When you are a platform provider you are gathering tons of data from the developers using your platform. These developers building ...
06.12.2023 Data Reliability with Barr Moses and Lior Gavish As companies depend more on data to improve digital products and make informed decisions, it’s crucial that the data they use be accurate and reliable. MonteCarlo, the data reliability company, is the creator of the industry’s first end-to-end data observability ...
05.26.2023 Low-Code SQL on dbt Core with Raj Bains from Prophecy In this podcast episode, we take a look at the intricacies of low-code data pipelines with Raj Bains, the founder of Prophecy.io. Raj shares valuable insights into how performant low-codedata pipelines are revolutionizing industries and transforming everyday operations. Raj discusses ...
04.20.2023 Open-Source Embedding Database with Anton Troynikov Chroma is an open source embedding database that is designed to make it easy to build large language model applications by making knowledge, facts and skills pluggable. Anton Troynikov is the co-founder of Chroma and he is our guest today. ...
04.13.2023 Data Activation with Tejas Manohar Data Activation is the method of unlocking the knowledge sorted within your data warehouse, and making it actionable by your business users in the end tools that they use every day. In doing so, Data Activation helps bring data people ...
04.07.2023 Self-Service Data Culture with Stemma’s Mark Grover A data catalog provides an index into the data sets and schemas of a company.Data teams are growing in size, and more companies than ever have a data team, so the market for data catalog is larger than ever. Mark ...
04.06.2023 Streaming Analytics with Hojjat Jafarpour Streaming analytics refers to the process of analyzing real-time data that is generated continuously and rapidly from various sources, such as sensors, applications, social media, and other internet-connected devices. Streaming analytics platforms enable organizations to extract business value from data ...
04.03.2023 Turso: Globally Replicated SQLite with Glauber Costa Distributed databases are necessary for storing and managing data across multiple nodes in a network. They provide scalability, fault tolerance, improved performance, and cost savings. By distributing data across nodes, they allow for efficient processing of large amounts of data ...
03.20.2023 Observability Trends with John Hart DataSet is a log analytics platform provided by Sentinel One that helps DevOps, IT engineering, and security teams get answers from their data across all time periods, both live streaming and historical. It’s powered by a unique architecture that uses ...
03.10.2023 Data Investing and the MAD with Matt Turck There are many types of early stage funding available from friends and family to seed to series A. Some firms invest across a wide set of technologies and seek only to provide capital. Others are in it for the long ...
11.11.2022 Accessing Data at Scale with Justin Borgman The Presto/Trino project makes distributed querying easier across a variety of data sources. As the need for machine learning and other high volume data applications has increased, the need for support, tooling, and cloud infrastructure for Presto/Trino has increased with ...
11.07.2022 Building on the Data Cloud with Torsten Grabs Building and managing data-intensive applications has traditionally been costly and complex, and has placed an operational burden on developers to maintain as their organization scales. Todays’ developers, data scientists, and data engineers need a streamlined, single cloud data platform for ...
09.12.2022 Serverless Clickhouse for Developers with Jorge Sancha Data analytics technology and tools have seen significant improvements in the past decade. But, it can still take weeks to prototype, build and deploy new transformations and deployments, usually requiring considerable engineering resources. Plus, most data isn’t real-time. Instead, most ...
08.25.2022 Lakehouse Data Stack with Raj Bains Originally published on April 12, 2022. As companies move to Spark and a Lakehouse architecture, they are realizing that the data tools are lagging way behind. You need to be a programmer to effectively use Spark and Airflow. There are ...
08.18.2022 Data Infrastructure for Finance Data is becoming a bank’s biggest asset. These complex enterprises have a huge opportunity ahead – to transform themselves to become a trusted hub of a much broader data ecosystem that goes beyond the financial industry and helps to form ...
08.05.2022 Faking Data Using Tonic.ai with Ian Coe and Adam Kamor Ian Coe CEO Adam Kamor Head of Engineering Companies that gather data about their users have an ethical obligation and legal responsibility to protect the personally identifiable information in their dataset. Ideally, developers working on a software application wouldn’t need ...
07.28.2022 Couchbase with Ravi Mayuram Couchbase is a distributed NoSQL cloud database. Since its creation, Couchbase has expanded into edge computing, application services, and most recently, a database-as-a-service called Capella. Couchbase started as an in-memory cache and needed to be rearchitected to be a persistent ...
06.01.2022 Decodable Streaming with Eric Sammer Streaming data platforms like Kafka, Pulsar, and Kinesis are now common in mainstream enterprise architectures, providing low-latency real-time messaging for analytics and applications. However, stream processing – the act of filtering, transforming, or analyzing the data inside the messages – ...
05.14.2022 Data Delivery with Naqeeb Memon Data-as-a-service is a company category type that is not as common as API-as-a-service, software-as-a-service, or platform-as-a-service. In order to vend data, a data-as-a-service provider needs to define how that data will be priced, stored, and delivered to users: streaming over ...
05.11.2022 Data Labeling with Michael Malyuk Data labeling allows machine learning algorithms to find patterns among the data. There are a variety of data labeling platforms that enable humans to apply labels to this data and ready it for algorithms. Heartex is a data labeling platform ...
05.09.2022 Pinot and StarTree with Chinmay Soman Real-time analytics are difficult to achieve because large amounts of data must be integrated into a data set as that data streams in. As the world moved from batch analytics powered by Hadoop into a norm of “real-time” analytics, a ...
04.29.2022 Data Loss Prevention with Yasir Ali Data loss can occur when large data sources such as Slack or Google Drive get leaked. In order to detect and avoid leaks, a data asset graph can be built to understand the risks of a company environment. Polymer is ...
04.27.2022 Airbyte Engineering with Michel Tricot Data integration infrastructure is not easy to build. Moving large amounts of data from one place to another has historically required developers to build ad hoc integration points to move data between SaaS services, data lakes, and data warehouses. Today, ...
04.25.2022 Select Star with Shinji Kim Modern organizations eventually face data governance challenges. Keeping track of where data came from, what systems update it, in what ways updates can be made are just some of the issues to be tackled. Large organizations face additional challenges like ...
04.14.2022 Time Series IoT on InfluxDB with Brian Gilmore The solution many turn to for capturing their streaming data is InfluxDB. In this episode, I interview Brian Gilmore, Director of Product Management at InfluxData, about how real time applications achieve success built on top of InfluxDB. When most people ...
04.12.2022 Lakehouse Data Stack with Raj Bains As companies move to Spark and a Lakehouse architecture, they are realizing that the data tools are lagging way behind. You need to be a programmer to effectively use Spark and Airflow. There are some low-code ETL tools, but is ...
04.05.2022 Data Engineering Trends with Lior Gavish and James Densmore Lior Gavish James Densmore Data infrastructure is a fast-moving sector of the software market. As the volume of data has increased, so too has the quality of tooling to support data management and data engineering. In today’s show, we have ...
03.31.2022 PlanetScale Management with Sam Lambert Running a database company requires expertise in both technical and managerial skills. There are deeply technical engineering questions around query paths, scalability, and distributed systems. And there are complex managerial questions around developer productivity and task allocation. Sam Lambert is ...
03.29.2022 SingleStore with Jordan Tigani SingleStore is a multi-use, multi-model database designed for transactional and analytic workloads, as well as search and other domain specific applications. SingleStore is the evolution of the database company MemSQL, which sought to bring fast, in-memory SQL database technology to ...
03.19.2022 DuckDB with Hannes Muleisen DuckDB is a relational database management system with no external dependencies, with a simple system for deployment and integration into build processes. It enables complex queries in SQL with a large function library, and provides transactional guarantees through multi-version concurrency ...
03.16.2022 RudderStack Engineering with Soumaydeb Mitra Customer data pipelines power the backend of many successful web platforms. In a customer data pipeline, data is collected from sources such as mobile apps and cloud SaaS tools, transformed and munged using data engineering, stored in data warehouses, and ...
03.09.2022 Apache Hudi with Vinoth Chandar The data lake architecture has become broadly adopted in a relatively short period of time. In a nutshell, that means data in it’s raw format stored in cloud object storage. Modern software and data engineers have no shortage of options ...
02.25.2022 Data Catalog in Practice with Mark Grover A data catalog provides an index into the data sets and schemas of a company. Data teams are growing in size, and more companies than ever have a data team, so the market for data catalog is larger than ever. ...
02.23.2022 Splunk Platform with Spiros Xanthos Splunk is a monitoring and logging platform that has evolved over its 18 years of existence. In its modern focus on observability it is focused on open source and AIOps. Observability has evolved with the growth of Kubernetes, and Splunk’s ...
02.18.2022 Hex Collaborative Data Workspace with Barry McCardel and Caitlin Colgrove Barry McCardel Co-Founder and CEO at Hex Caitlin Colgrove Co-Founder and CTO at Hex In contrast to other IDEs, the notebook interface offers software developers a unique environment idealized for data professionals. Despite the growth in popularity, a surprising learning ...
02.17.2022 Data Quality Using Anomalo with Jeremy Stanley When writing code, test driven development is a common accepted methodology to ensure the development of high quality software. Your organization’s data, on the other hand, is an entirely different challenge. Data can be missing due to human error, a ...
01.31.2022 Scaling PlanetScale with Sugu Sougoumarane Database product companies typically have a few phases. First, the company will develop a technology with some kind of innovation such as speed, scalability, or durability. The company will offer support contracts around that technology for a period of time, ...
01.28.2022 Couchbase Architecture with Ravi Mayuram Couchbase is a distributed NoSQL cloud database. Since its creation, Couchbase has expanded into edge computing, application services, and most recently a database-as-a-service called Capella. Couchbase started as an in-memory cache and needed to be rearchitected to be a persistent ...
12.21.2021 Trifacta with Joe Hellerstein If you haven’t encountered a data quality problem, then you haven’t yet worked on a large enough project. Invariably, a gap exists between the state of raw data and what an analyst or machine learning engineer needs to solve their ...
12.10.2021 MemGraph with Dominik Tomicevic Relational databases have been a fixture of software applications for decades. They are highly tuned for performance and typically offer explicit guarantees like transactional consistency. More recently, there’s been a figurative cambrian explosion of other-than-relational databases. Simple key value stores ...
12.09.2021 Amplemarket with João Batalha The lifeblood of most companies is their sales departments. When you’re selling something other than a commodity, it’s typically necessary to carefully groom the onboarding experience for inbound future customers. Historically, companies approached this in a one-size-fits-all manner, giving all ...
11.24.2021 Metaplane with Kevin Hu Application observability is a fairly mature area. Engineering teams have a wide selection of tools they can choose to adopt and a significant amount of thought leadership and philosophy already exists giving guidance for managing your application. That application is ...
11.23.2021 Risk and Compliance with Terry O’Daniel Consumers are increasingly becoming aware of how detrimental it can be when companies mismanage data. This demand has fueled regulations, defined standards, and applied pressure to companies. Modern enterprises need to consider corporate risk management and regulatory compliance. In this ...
11.10.2021 #FREEZUCK \| ?masked…?… !(DOCTORS)!! Software Engineering Daily invites Owen Frank Davis, Paul Davis, Kyle Davis, and Robbie Davis for a joint interview on the subject of reproduction and teething, as well as Lisch fascitis. Aledade and Kubernetes are both inconsiderate ideas for navigation. They ...
11.10.2021 Scalable Streaming Video with Amit Mishra The internet is a layer cake of technologies and protocols. At a fundamental level, the internet runs on the TCP/IP protocol. It’s a packet based system. When your browser requests a file from a web server, that server chops up ...
11.08.2021 Observability Using Honeycomb.io with Christine Yen It does not matter if it runs on your machine. Your code must run in the production environment and it must do so performantly. For that, you need tooling to better understand your application’s behavior under different circumstances. In the ...

Older episodes

Data Archives - Software Engineering Daily

What's Data Archives - Software Engineering Daily about?

Download our free app to listen on your phone

Data Archives - Software Engineering Daily episodes:

Highly Scalable NoSQL with Dor Laor

Database Caching with Ben Hagan

Data-Centric AI with Alex Ratner

Making Data-Driven Decisions with Soumyadeb Mitra

Customer-facing Analytics with Tyler Wells

Data Reliability with Barr Moses and Lior Gavish

Low-Code SQL on dbt Core with Raj Bains from Prophecy

Open-Source Embedding Database with Anton Troynikov

Data Activation with Tejas Manohar

Self-Service Data Culture with Stemma’s Mark Grover

Streaming Analytics with Hojjat Jafarpour

Turso: Globally Replicated SQLite with Glauber Costa

Observability Trends with John Hart

Data Investing and the MAD with Matt Turck

Accessing Data at Scale with Justin Borgman

Building on the Data Cloud with Torsten Grabs

Serverless Clickhouse for Developers with Jorge Sancha

Lakehouse Data Stack with Raj Bains

Data Infrastructure for Finance

Faking Data Using Tonic.ai with Ian Coe and Adam Kamor

Couchbase with Ravi Mayuram

Decodable Streaming with Eric Sammer

Data Delivery with Naqeeb Memon

Data Labeling with Michael Malyuk

Pinot and StarTree with Chinmay Soman

Data Loss Prevention with Yasir Ali

Airbyte Engineering with Michel Tricot

Select Star with Shinji Kim

Time Series IoT on InfluxDB with Brian Gilmore

Lakehouse Data Stack with Raj Bains

Data Engineering Trends with Lior Gavish and James Densmore

PlanetScale Management with Sam Lambert

SingleStore with Jordan Tigani

DuckDB with Hannes Muleisen

RudderStack Engineering with Soumaydeb Mitra

Apache Hudi with Vinoth Chandar

Data Catalog in Practice with Mark Grover

Splunk Platform with Spiros Xanthos

Hex Collaborative Data Workspace with Barry McCardel and Caitlin Colgrove

Data Quality Using Anomalo with Jeremy Stanley

Scaling PlanetScale with Sugu Sougoumarane

Couchbase Architecture with Ravi Mayuram

Trifacta with Joe Hellerstein

MemGraph with Dominik Tomicevic

Amplemarket with João Batalha

Metaplane with Kevin Hu

Risk and Compliance with Terry O’Daniel

#FREEZUCK | ?masked…?… !(DOCTORS)!!

Scalable Streaming Video with Amit Mishra

Observability Using Honeycomb.io with Christine Yen