Data on Kubernetes Community

Data on Kubernetes Community

By Data on Kubernetes CommunityTechnology
Download on the App Store

Data on Kubernetes Community episodes

  • Dok Talks #120 - A Gentle Introduction to Building Data Intensive Applications // Joe Karlsson

    https://go.dok.community/slack

    https://dok.community

    ABSTRACT OF THE TALK

    We all know that data intensive applications have had explosive growth in the past decade. Data now drives significant portions of our lives, from making sense of IoT swarm data to detecting fraudulent transactions at your bank. As software developers, we all have unprecedented opportunities to build data applications that generate value from these massive datasets.

    Join Bart Farrell and Joe Karlsson for this talk as we discuss gotchas and best practices of building deploying and scaling data intensive apps.

    KEY TAKE-AWAYS FROM THE TALK

    Build a data-intensive application from scratch using only SQL.

    We will discuss gotchas and best practices of building deploying and scaling a key-value store.

    BIO

    Joe Karlsson (He/They) is a Database Engineer turned Developer Advocate (and massive data nerd) currently working at SingleStore. He empowers developers to think creatively when building applications with a massive amount of data, through demos, blogs, videos, or whatever else developers need. Joe's career has taken him from building out database best practices and demos for MongoDB, architecting and building one largest eCommerce websites in North America at Best Buy, and teaching at one of the most highly-rated software development boot camps on Earth. Joe is also a TEDx Speaker, film buff, and avid [TikToker]

    1 hr 2 min
  • Dok Talks #119 - Cloud-Native Data Pipelines // Hakan Lofcali

    https://go.dok.community/slack

    https://dok.community

    ABSTRACT OF THE TALK

    This talk walks you through our stack, architecture, and processes. We develop tools to deploy and run data-driven applications in a cloud-native environment. We will give a whirlwind tour on developing a Java Quarkus application, a CICD stack powered by GitHub Actions / ArgoCD, building and deploying containerized Kafka Streams applications at runtime with Jib container builder. Having introduced the above common understanding, we will give a high-level overview of how we utilize modern Kubernetes and Cloud tooling to manage multiple clusters in different organizations together with our customers.

    BIO

    DataCater commoditizes data pipeline development lifecycle by applying software engineering and cloud native practices to data work. Hakan is a Software / Data Engineer and CTO of DataCater. He worked and built his knowledge around Software, Data Engineering, and Cloud-Native Computing in severely different environments. From early start-up to hyper-scaler AWS. From sports media companies to highly regulated FSI enterprises. The experiences gained, problems encountered, and solutions found led to him co-founding DataCater to enhance tooling in the Data space.

    54 min
  • Dok Talks #118 - Troubleshooting ClickHouse Performance // Shiv Lyer

    https://go.dok.community/slack

    https://dok.community

    ABSTRACT OF THE TALK

    This talk is about how I use several tools, technologies and processes to troubleshoot ClicHouse Performance. I will be talking about multiple Linux Toolkits, Trace Profilers like DTrace, BPF etc. and also ClickHouse System Tables. This talk also covers best practices/checklist / run-book for building "High Performance ClickHouse Infrastructure Operations"

    BIO

    Open Source Database Systems Geek in MySQL, MariaDB, PostgreSQL and ClickHouse with core expertise in performance, scalability, high availability and database reliability engineering, Shiv currently is the founder and principal of MinervaDB Inc., an enterprise-class 24*7 Consultative Support and Managed Services Provider for MySQL, MariaDB and PostgreSQL.

    Shiv also is the Founder and Principal of ChistaDATA Inc., an independent 24*7 Consultative Support and Managed Service Provider for ClickHouse.

    Shiv in the past worked for companies like MySQL AB, SUN Microsystems, AOL, eBay, PayPal, PalominoDB and Percona. Shiv also is a frequent speaker in open source conferences worldwide.

    KEY TAKE-AWAYS FROM THE TALK

    Troubleshooting ClickHouse Performance intuitively

    1 hr 3 min
  • Dok Talks #117 - Why you should care about data mesh // Luke Feeney

    https://go.dok.community/slack

    https://dok.community

    ABSTRACT OF THE TALK

    Data mesh is a new approach for designing modern data architectures by embracing organizational constructs as well as technological aspects, data management, governance, etc. The idea is that data should be easily accessible and interconnected across the entire business. This talk will look at the concept of data mesh architecture. It will discuss implementing data mesh architecture in organizations and will relate data mesh to updates at TerminusDB.

    BIO

    Co-founder of TerminusDB, the open source document graph database.

    KEY TAKE-AWAYS FROM THE TALK

    • Data mesh
    • TerminusDB
    • Document graphs
    • Git for data

      • https://terminusdb.com/blog/

      59 min
    • Dok Specials - Ask Patrick and Jeff Anything About Data on Kubernetes // Patrick McFadin & Jeff Carpenter

      https://go.dok.community/slack

      https://dok.community/

      ABSTRACT OF THE TALK

      Patrick is a Data on Kubernetes Community veteran. He did the very first session "Is k8s even ready for data?" in July 2020 and has seen the growth of the community since then.

      Jeff Carpenter is a Software Engineer at Datastax where he works on the Stargate.io project.

      If you have questions you want to be answered in the session, please feel free to message Bart on Slack.

      1 hr 3 min
    • Dok Talks #116 - Nebula Graph: Open Source Distributed Graph Database // Wey (Siwei) Gu

      https://go.dok.community/slack

      https://dok.community/

      ABSTRACT OF THE TALK

      • Nebula Graph Demystified
      • Graph on K8s
      • Know-How of Graph Database

        • BIO

        Open Source believer, builder, singer and Graph Magic advocate(to scale the magic to help wizards)

        https://siwei.io/en/about/

        KEY TAKE-AWAYS FROM THE TALK

        • Why& How graph db would help real life problems
        • Arch and Design the Nebula Graph Database and the Intro. of the Project
        • Implementation of the Nebula K8s operator
        • Graph Database Know How in actions on:
        • Building an intelligent Voice Robot
        • MetaData governance and Lineage
        • Building a corporation shareholding relations system
          • 1 hr 8 min
        • Dok Special - Show me the money: The business side of DoK // Evan Powell, Brian Schechter & Misha Herscu

          https://go.dok.community/slack

          https://dok.community/

          ABSTRACT OF THE TALK

          Running stateful workloads on Kubernetes isn't just a technical question. Without keeping the business value it provides in mind, it becomes a moot point.

          In order to drive these conversations forward, we'll be joined by Melissa Logan (Director at the DoKC), Evan Powell (Adviser/investor who was instrumental in launching the DoKC), Brian Schecther (Partner at Primary Venture Partners).

          KEY TAKE-AWAYS FROM THE TALK

          - What are the economic drivers of Data on Kubernetes adoption?

          - What are the business or economic drivers in the way of Data on Kubernetes adoption?

          - How will Data on Kubernetes evolve in the coming years given other open source trends?

          58 min
        • Dok Talks #115 - What More Can I Learn From My OpenTelemetry Traces? // John Pruitt

          https://go.dok.community/slack

          https://dok.community/

          ABSTRACT OF THE TALK

          Of the three observability data types supported by OpenTelemetry (metrics, logs, and traces) the latter is the one with most potential. Tracing gives users insights into how requests are processed by microservices in a modern, cloud-native architecture.

          Jaeger and Grafana can visualize a single trace, showing how an individual request traversed your entire system. This helps for distributed debugging and analysis, but using traces only this way is limiting.

          What if you stored tracing data in a SQL database? You could ask global questions about your system. You could find slow communication paths, where the error rate spiked since the last deployment, or where the request rate suddenly dropped. Thus, tracing can be used proactively to help you spot issues before your customers do.

          This talk will show you how to do all the above by ingesting OpenTelemetry traces into a PostgreSQL/TimescaleDB database, and building custom dashboards using SQL to make the most out of your tracing data.

          BIO

          John Pruitt is a software engineer at Timescale. His work focuses on database/SQL development for the Promscale open-source observability tool, and currently on adding support for OpenTelemetry tracing. Prior to joining Timescale, John grew the DBA team at Shipt. Most of the balance of his career was spent building custom time-series applications in the energy industry and leading data warehousing efforts at regional banks.

          KEY TAKE-AWAYS FROM THE TALK

          - What is distributed tracing
          - Why viewing individual traces is of limited value
          - How SQL can be used to analyze and visualize traces
          - What insights can be unlocked using SQL against traces

          1 hr 1 min

        About Data on Kubernetes Community

        From the publisher's feed

        The Data on Kubernetes Community (DoKC) is where users go to run data on Kubernetes. We facilitate the creation and sharing of best practices to help users advance in their DoK journey. Here you can…

        More shows like Data on Kubernetes Community

        All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

        All-In with Chamath, Jason, Sacks & Friedberg

        10,141 Listeners