In this episode of The CTO Podcast, Lucas and Luna dive into the technical and organizational challenges behind GitHub's migration of over 100 million repositories to a new Git storage engine. They explore why GitHub needed to move away from the traditional filesystem-based storage, the design of their new custom engine called 'GitV2,' and how they maintained zero downtime during the multi-year rollout. Lucas shares specifics on the data structures used, the migration strategy (shard-by-shard with canary testing), and the performance gains achieved: 40% faster clone times and 30% reduction in storage footprint. Luna asks about the trade-offs: how did they handle edge cases like partial clones or large monorepos? The conversation also touches on the cultural side — getting engineering buy-in for a rewrite that touched every team, and the metrics that mattered most. A must-listen for anyone leading large-scale infrastructure changes.

#GitHub #GitV2 #StorageEngine #Infrastructure #Migration #Scalability #Git #Repository #ZeroDowntime #CTOPodcast #FexingoBusiness #BusinessPodcast #TechLeadership #Engineering #DataStructures #Performance #Monorepo #CloudStorage

Keep every episode free: buymeacoffee.com/fexingo

In this episode of The CTO Podcast, Lucas and Luna dive into the technical architecture behind Dropbox's sync engine, which handles file operations for over 700 million users across every major platform. They explore the shift from a two-way sync model to a block-level, content-addressable system, and how Dropbox rebuilt its core to handle conflicts between millions of devices simultaneously. Specific numbers: 1.2 billion daily file operations, 350 million conflict events per day, and a median sync latency under 200 milliseconds. The hosts break down the trade-offs between local-first design and cloud consistency, the role of CRDTs in resolving merge conflicts, and why the team chose to rewrite the engine in Rust after a decade of C++. Along the way, they touch on how the engineering org structured the migration without downtime for users, and what lessons apply to any team building distributed storage at scale. A concrete case study for anyone who builds or manages data-intensive systems.

#Dropbox #SyncEngine #BlockLevelSync #ContentAddressableStorage #ConflictResolution #CRDT #RustProgramming #DistributedSystems #LocalFirst #CloudConsistency #FileSync #EngineeringOrg #TeamTopologies #StorageArchitecture #TechnicalLeadership #BusinessAndTechnology #FexingoBusiness #BusinessPodcast

Keep every episode free: buymeacoffee.com/fexingo

Lucas and Luna dig into how Skyscanner, the travel meta-search giant, moved 300 microservices from a synchronous REST model to an event-driven architecture over two years. They cover the concrete trigger (a 2022 outage caused by cascading HTTP failures), the decision to adopt Apache Kafka as the backbone, the strangler fig pattern used to migrate incrementally, and the key metric: a 60 percent reduction in p99 latency for price searches. The hosts also discuss the organizational challenges — how Skyscanner reorganized engineering teams around business events rather than service boundaries, and the surprising lesson that the hardest part wasn't the tech but the data contracts. This is a practical look at a real-world event-driven migration at scale.

#Skyscanner #EventDrivenArchitecture #ApacheKafka #Microservices #TechMigration #SystemDesign #LatencyReduction #DistributedSystems #EngineeringOrg #StranglerFig #DataContracts #TravelTech #Scalability #Architecture #BusinessAndTechnology #FexingoBusiness #BusinessPodcast #CTOPodcast

Keep every episode free: buymeacoffee.com/fexingo

Lucas and Luna unpack how Palantir redesigned its Foundry ontology to scale from prototype to production across federal agencies. They focus on the architectural shift from a monolithic object model to a modular, policy-enforced ontology layer that can handle classified, multi-tenant government data. Specific numbers: 5,000 concurrent operators at U.S. Army's Project TITAN, 10x reduction in data integration time using their new virtual object pattern. They also touch on the operational challenges of rolling out updates to production systems running live battlefield logistics.

#Palantir #Foundry #Ontology #GovernmentTech #DataArchitecture #ScalingInfrastructure #ModularArchitecture #AI #DefenseTech #ProjectTITAN #BusinessAndTechnology #FexingoBusiness #BusinessPodcast #TechLeadership #EngineeringOrg #ArchitecturePatterns #DataIntegration #PolicyEnforcement

Keep every episode free: buymeacoffee.com/fexingo

Lucas and Luna dive into how Netflix rebuilt its content delivery network to serve over 300 million subscribers across 190 countries. They explore the shift from a third-party CDN to Netflix's own Open Connect CDN, the caching strategy that stores popular titles on ISP servers, and the engineering trade-offs between latency, cost, and reliability. Lucas explains why Netflix pre-positions content during off-peak hours and how adaptive bitrate streaming works under the hood. Luna brings up the challenge of handling live events like the recent Jake Paul vs. Mike Tyson fight, which pushed the infrastructure to its limits. The episode also touches on how Netflix added P2P-style caching for smart TVs and why the team chose FreeBSD over Linux for its caching appliances. By the end, you'll understand why Netflix accounts for nearly 15% of all downstream internet traffic globally.

#Netflix #CDN #ContentDelivery #Streaming #OpenConnect #AdaptiveBitrate #FreeBSD #P2PCaching #EdgeComputing #LatencyOptimization #LiveStreaming #ISP #Caching #Bandwidth #Engineering #Business #Technology #FexingoBusiness

Keep every episode free: buymeacoffee.com/fexingo

In this episode, Lucas and Luna dive into the architectural overhaul Coinbase undertook to scale its blockchain node infrastructure from supporting a handful of cryptocurrencies to over 200 networks. They explore the specific challenges of maintaining consensus across Ethereum, Solana, and Polygon nodes, the migration from monolithic to microservices-based node management, and how the team reduced latency by 40% while cutting infrastructure costs by 30%. Lucas breaks down the trade-offs between full nodes and light clients, the role of WebSocket-based event streaming for real-time transaction monitoring, and why the company ultimately built its own node orchestration platform rather than relying on third-party providers. Luna questions the decision to keep node operations in-house versus using infrastructure-as-a-service, and they discuss the operational burden of chain reorganizations and state snapshots. The episode also covers the impact of Ethereum's transition to proof-of-stake on node requirements and how Coinbase prepared for the merge without downtime. A must-listen for engineers and architects working on decentralized infrastructure at scale.

#Coinbase #Blockchain #NodeInfrastructure #Ethereum #Solana #Polygon #ProofOfStake #Microservices #WebSocket #EventStreaming #InfrastructureAsCode #Orchestration #Scaling #Crypto #TechnicalLeadership #BusinessAndTechnology #FexingoBusiness #BusinessPodcast

Keep every episode free: buymeacoffee.com/fexingo

In this episode, Lucas and Luna dive into Shopify's 2025 overhaul of its checkout engine, which reduced average payment time from 18 seconds to under 4 seconds. They explore the architectural choices — from server-side rendering to edge-computed state — that made one-click checkout possible across 2.7 million merchants. Lucas explains how Shopify decoupled payment processing from the storefront, adopted WebAssembly for client-side validation, and used a global edge network to precompute checkout state. Luna questions the trade-offs, including the complexity of supporting 100+ payment gateways and the challenge of maintaining PCI compliance at scale. The episode also touches on the impact on conversion rates, with early data showing a 6.2% lift in completed purchases. A focused case study in high-stakes web performance.

#Shopify #Checkout #OneClick #WebPerformance #EdgeComputing #WebAssembly #PaymentProcessing #PCICompliance #ConversionOptimization #ServerSideRendering #Ecommerce #TechArchitecture #CTO #Engineering #FexingoBusiness #BusinessPodcast #Scale #StateManagement

Keep every episode free: buymeacoffee.com/fexingo

In this episode, Lucas and Luna dive into Stripe's latest architectural overhaul: rebuilding its core accounting and tax-computation engine to handle real-time sales-tax, VAT, and GST across more than 130 jurisdictions. They trace the engineering decisions behind moving from a batch nightly ledger to a streaming event-sourced system capable of recalculating tax lines mid-transaction without blocking checkout. Key numbers: Stripe processes over $1 trillion in payments annually, and the new engine runs 47,000 tax rules on average per transaction in under 12 milliseconds. Lucas explains the trade-off between eventual consistency and audit-grade accuracy, and why they chose Apache Kafka plus a custom FSM over off-the-shelf ERP middleware. Luna pushes back on the cost of maintaining 130+ rule sets and asks whether Stripe should have opened a public tax-engine API earlier. The episode ends with a reflection on whether tax compliance is the next infrastructure layer that every fintech will need to build or buy.

#Stripe #TaxCompliance #AccountingEngine #RealTimeTax #EventSourcing #ApacheKafka #FintechArchitecture #GlobalPayments #VAT #SalesTax #StreamingLedger #TechInfrastructure #BusinessAndTechnology #CTOPodcast #EngineeringOrg #SystemDesign #FexingoBusiness #BusinessPodcast

Keep every episode free: buymeacoffee.com/fexingo

In this episode of The CTO Podcast, hosts Lucas and Luna dive into Stripe's architectural journey from a simple payment API to a global infrastructure handling payments in over 100 countries and 135 currencies. They explore how Stripe tackled regulatory complexity, latency, and reliability at scale — from its early days of processing a few thousand transactions to now handling billions of dollars annually. The conversation covers Stripe's core system design, including its use of idempotency keys, event-driven architecture, and a multi-region deployment strategy. Lucas shares insights from Stripe's engineering blog and talks about the trade-offs they made: choosing consistency over availability in payment processing, and building a custom database layer to handle financial transactions. Luna questions how Stripe manages compliance across jurisdictions, and Lucas explains their approach to modular compliance and local data residency. The episode wraps with a reflection on whether Stripe's bet on developer experience over traditional sales-driven growth was the right call.

#PaymentInfrastructure #Stripe #GlobalPayments #FinancialTechnology #CTO #EngineeringOrg #SystemArchitecture #API #EventDrivenArchitecture #Idempotency #MultiRegionDeployment #Compliance #Latency #Reliability #TechLeadership #FexingoBusiness #BusinessPodcast #BusinessAndTechnology

Keep every episode free: buymeacoffee.com/fexingo

Episode 79 of The CTO Podcast dives into the engineering behind Datadog's core pipeline. Hosts Lucas and Luna unpack how Datadog re-architected its ingestion, processing, and storage layers to handle over 100 trillion events per day by mid-2026. They explore the shift from a monolithic intake to a sharded, stream-oriented architecture, the decision to build custom compression rather than use off-the-shelf codecs, and how the team maintained sub-second query latencies while scaling throughput by 10x over three years. Along the way, they discuss tradeoffs between consistency and availability, the role of probabilistic data structures for sampling, and why Datadog eventually rewrote parts of its query engine in Rust. This episode offers a concrete look at what it takes to keep observability observant when the data never stops growing. Perfect for engineering leaders and senior architects wrestling with scale.

#Datadog #Observability #DataPipeline #Architecture #Engineering #Scalability #StreamProcessing #Compression #Rust #QueryEngine #APM #Telemetry #CloudInfrastructure #BigData #SRE #BusinessAndTechnology #FexingoBusiness #BusinessPodcast

Keep every episode free: buymeacoffee.com/fexingo