Database School

By Try Hard StudiosTechnology Education

Database School episodes

November 26, 2024 Moving from Redis to SQLite with Mike Buckbee
Want to learn more SQLite? Check out my SQLite course: https://highperformancesqlite.com
In this episode, I sit down with Mike Buckbee to dive into the nitty-gritty of web application firewalls and his journey from using Redis to SQLite in Wafris. We talk about database architecture, operational challenges, and the fascinating ways SQLite improves performance and usability in cybersecurity tools.
Get production ready SQLite with Turso: https://tur.so/af.
Follow Mike:
Twitter: https://twitter.com/mbuckbee
LinkedIn: https://www.linkedin.com/in/michaelbuckbee
Wafris website: https://wafris.org
Rearchitecting Redis to SQLite article: https://wafris.org/blog/rearchitecting-for-sqlite
Follow Aaron:
Twitter: https://twitter.com/aarondfrancis
LinkedIn: https://www.linkedin.com/in/aarondfrancis
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.
Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15
Database school audio only: https://databaseschool.transistor.fm
Chapters: 00:00 - Introduction and Guest Overview
01:06 - What is Wafris?
02:43 - Naming and Origins of Wafris
04:00 - Mike's Cybersecurity Background
07:17 - Challenges with Web Application Firewalls
10:01 - Wafris Architecture Overview
16:15 - Why Switch to SQLite?
18:01 - Handling IP Address Ranges
24:00 - Wild Redis Data Structures Explained
28:51 - Transitioning to SQLite
32:02 - Operational Advantages of SQLite
37:04 - How Wafris Leverages Threat Lists
40:13 - Performance Gains with SQLite
46:51 - Splitting Reads and Writes in the New Architecture
52:29 - Closing Thoughts and Where to Learn More
1 hr 10 min
October 14, 2024 Bootstrapping an email service provider (with Jesse Hanley)
Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com.
In this interview, I talk with Jesse Hanley, founder of Bento, about running a lean email service from Japan. We chat about the challenges of scaling infrastructure, managing databases, and maintaining a calm business while serving a global customer base.
Links Mentioned:
Bento: https://bentonow.com
Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15
Database school audio only: https://databaseschool.transistor.fm
Follow Jesse:
Twitter: https://twitter.com/jessethanley
Bento on Twitter: https://twitter.com/Bento
Follow Aaron:
Twitter: https://twitter.com/aarondfrancis
LinkedIn: https://www.linkedin.com/in/aarondfrancis
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.
Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15
Database school audio only: https://databaseschool.transistor.fm
Chapters:
00:00 - Introduction to Jesse Hanley
01:02 - Running Bento from Japan
01:48 - The Lean Team Structure at Bento
03:00 - Managing Support via Discord
05:01 - Benefits of Using Discord for Customer Support
06:45 - The Role of Community in Customer Feedback
09:01 - How Bento Gained Traction
13:00 - Bootstrapping Bento and Profitable Growth
16:00 - Running Your Own Mail Servers
19:03 - The Economics and Redundancy of Email Delivery
21:00 - Bento's Heroku Setup and Scaling Challenges
26:00 - Handling and Querying Massive Data in Bento
29:52 - Leveraging Elasticsearch for Data Queries
35:40 - Moving Toward Multi-Database Solutions
37:45 - Exploring Crunchy Data and Citus for Database Scaling
42:00 - Optimizing Bento for Performance and Scalability
54:02 - Jesse’s Advice on Building a Calm and Profitable Business
57:00 - How Bento Uses WebSockets and Background Jobs
1:00:00 - Optimizing Bento with Action Cable
1:02:25 - Avoiding N+1 Queries with WebSockets
1:04:50 - Scaling Redis and Postgres at Bento
1:09:00 - Jesse’s Approach to Managing Growth and Multiple Services
1:11:00 - Final Thoughts on Scaling and Optimizing Databases
1:13:10 - Advice for Aspiring Builders: Stay Patient and True to Your Vision
1:16:00 - Bento’s Unique Approach to Email Marketing and Transactional Emails
1:19:50 - Closing Thoughts and Where to Find Jesse Hanley Online
1 hr 22 min
October 07, 2024 Creating a Postgres platform with Monica & Tudor from Xata.io
Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com.
Production ready Postgres for teams that ship fast: https://xata.io In this interview, I talk with Monica Sarbu and Tudor Golubenco from Xata about their journey from Elastic to founding Xata. We deep dive on building a Postgres hosting platform, handling schema changes, and how they've made their free tier economical.
Links Mentioned:
Xata.io: https://xata.io/ The economics of a Postgres free tier:
https://xata.io/blog/postgres-free-tier
Follow Monica & Tudor:
Monica on Twitter: https://twitter.com/monicasarbu
Monica on LinkedIn: https://www.linkedin.com/in/monicasarbu
Tudor on Twitter: https://twitter.com/tudor_g
Tudor on LinkedIn: https://www.linkedin.com/in/tudorgolubenco/
Follow Aaron:
Twitter: https://twitter.com/aarondfrancis
LinkedIn: https://www.linkedin.com/in/aarondfrancis
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.
Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15
Database school audio only: https://databaseschool.transistor.fm
Chapters:
00:00 - Introduction
00:26 - What is Xata? Overview and Mission
01:32 - Open Source Projects: PG Roll and PG Stream
02:33 - Synchronizing Data: Postgres to Elastic Search
03:12 - Monica and Tudor's Background & Journey to Elastic
04:00 - Founding of Packetbeat: The Start of Open Source Monitoring
06:08 - Transition from Elastic to Starting Xata
07:00 - Launching a Nonprofit and Insights on Database Challenges
08:29 - The Idea Behind Xata: Simplifying Application Development
10:00 - Tudor Joins Xata: The Decision to Start Again
10:47 - The Technical Vision for Xata's Platform
12:06 - Founding Xata During the Pandemic 13:11 - Funding Journey: From Seed to Series A
15:07 - Building a Platform, Not Just a Hosted Database
17:20 - Introducing Postgres to Xata's Stack
20:19 - Navigating Postgres as a DBA
22:44 - Open Source Strategy & Community Building
27:48 - PG Stream Use Cases & Postgres Replication
32:08 - PG Roll for Zero Downtime Schema Changes
36:05 - Implementing Safe and Fast Schema Changes
39:49 - Blob Storage and Cloudflare Integration
45:11 - Xata's Unique Features: Serving Builders and Larger Teams
49:20 - Free Tier Economics and Why It Matters
56:04 - Working as a Husband-Wife Team
1 hr 2 min
September 24, 2024 Heroku's glory days & Postgres vs the world, w/ Craig Kerstiens
Want to learn more Postgres? Check out my Postgres course: https://masteringpostgres.com.
In this interview, I dive deep with Craig Kerstiens from Crunchy Data into the world of Postgres, covering its rise to prominence, scaling at Heroku, and the power of Postgres extensions. Craig also shares insights on database sharding, the future of Postgres, and why developers love working with it.
Follow Craig:
Twitter: https://twitter.com/craigkerstiens
Crunchy Data Blog: https://www.crunchydata.com/blog
Follow Aaron:
Twitter: https://twitter.com/aarondfrancis
LinkedIn: https://www.linkedin.com/in/aarondfrancis
Website: https://aaronfrancis.com - find articles, podcasts, courses, and more.
Chapters:
00:00 - Introduction: Welcome to Database School
00:20 - Guest Introduction: Craig Kerstiens and Crunchy Data
01:40 - Craig's Journey from Heroku to Crunchy Data
02:55 - Scaling Postgres at Heroku
04:50 - Mastering Postgres Course Announcement
05:30 - The Importance of Postgres at Heroku
07:50 - The Value of Live SQL with Data Clips
09:25 - Data Clips for Business Intelligence and Real-Time Analytics
11:05 - Heroku’s Unique Company Culture and How Data Clips Came to Be
12:30 - Postgres Extensions and Marketplace
14:00 - Citus: Scaling Postgres for Multi-Tenant Applications
15:40 - The Challenges of Sharding in Databases
18:00 - Managing Large Databases and Sharding Keys with Citus
24:00 - The Evolution of Postgres and Its Growing Popularity
31:00 - Postgres for Developers and the Importance of Extensions
35:00 - Extensions as Proving Grounds for Core Postgres Features
37:50 - Building an Extension Marketplace for Postgres
41:00 - Postgres as a Data Platform and Developer Flexibility
46:00 - Why Developers Love Postgres: Stability, Extensions, and Ownership
51:00 - DuckDB: A Fascinating New Database Approach
53:30 - Crunchy Data: What They Offer and Why It Matters
58:30 - Expanding Postgres with DuckDB for Data Warehousing
01:00:00 - Wrapping Up: Where to Find Craig and Crunchy Data
1 hr 3 min
August 08, 2024 Ruby on Rails + SQLite with Stephen Margheim
Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com Get production ready SQLite with Turso: https://tur.so/af.
In this interview, I talk to Stephen Margheim about his work with SQLite and Ruby on Rails.
Links:
Database school on YouTube: https://www.youtube.com/playlist?list=PLI72dgeNJtzqElnNB6sQoAn2R-F3Vqm15
Database school audio only: https://databaseschool.transistor.fm
Aaron on Twitter: https://twitter.com/aarondfrancis
Stephen on Twitter: https://twitter.com/fractaledmind
Stephen's blog: https://fractaledmind.github.io/
Stephen's book: https://fractaledmind.gumroad.com/l/sqlite-on-rails
Aaron's conference talk: https://www.youtube.com/watch?v=2YaEtaXYVtI
1 hr 44 min
June 20, 2024 Migrating from Postgres to SQLite with Kent C. Dodds
Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af. In this interview, I talk to Kent C. Dodds about SQLite, LiteFS and the React ecosystem.
Kent: https://twitter.com/kentcdodds
EpicWeb: https://www.epicweb.dev
The Epic Stack: https://www.epicweb.dev/epic-stack
Fly.io: https://fly.io
LiteFS: https://fly.io/docs/litefs
Litestream: https://litestream.io
52 min
June 14, 2024 Production SQLite with Turso and libSQL
Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com
Get production ready SQLite with Turso: https://tur.so/af.
In this interview I talk to Glauber Costa, CEO of Turso.
1 hr 41 min
June 13, 2024 Offline-first, multiplayer SQLite
Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af.
In this interview I talk to Carl Sverre about his new project: SQLSync. It's an offline-first, collaborative wrapper around SQLite. We cover event sourcing, conflict resolution, VFSes, and more! Carl: https://twitter.com/carlsverre PartyKit: https://www.partykit.io SQLSync: https://sqlsync.dev Carl's new company: https://orbitinghail.dev ------- 00:00 Intro and Background 01:56 What is SQLSync 02:30 Amplify 05:08 SQLSync Use Case 07:35 Multiplayer Explained 09:41 Durable Objects 12:00 Compare to PartyKit 13:08 Local First 22:46 SQLSync Terminology 24:28 SQLSync Replication Flow 27:33 Virtual File System 33:51 Transactions in WASM 39:41 Sync to Coordinator 43:22 Conflict Resolution as Business Logic 52:03 Sync to Clients 1:01:12 Goals for SQLSync 1:04:14 Scaling Limitations 1:07:30 Graft Storage Engine 1:14:47 Graft as a SQLite Extension 1:17:08 What's Next -----
1 hr 27 min
June 13, 2024 Distributed SQLite with Litestream and LiteFS
Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af.
Ben and Aaron discuss replication and backups in SQLite, Litestream and LiteFS, and future mad scientist projects Ben is working on. • Ben Johnson on Twitter: https://x.com/benbjohnson • Litestream: https://litestream.io/ • LiteFS: https://fly.io/docs/litefs/
58 min
June 13, 2024 DHH discusses SQLite (and Stoicism)
Want to learn more about SQLite? Check out the full course: https://highperformancesqlite.com. Get production ready SQLite with Turso: https://tur.so/af. DHH and Aaron discuss modern SQLite, the one-person framework, conceptual compression, stoicism, and ONCE.com's newest product: Workbook.
54 min