CISO Tradecraft®

#118 - Data Engineering (with Gal Shpantzer)

Listen Later

Our systems generate fantastic amounts of information, but do we have a complete understanding of how we collect, analyze, manage, store, and retrieve possibly petabytes a day? Gal Shpantzer has been doing InfoSec for over 20 years and has managed some huge data engineering projects, and offers a lot of actionable insights in this CISO Tradecraft episode.

Gal's LinkedIn Page - https://www.linkedin.com/in/riskmanagement/

Gal's Twitter Page - https://twitter.com/Shpantzer

Full Transcript - https://docs.google.com/document/d/14RXnsVttvKlRi6VL94BTrItCjOAjgGem/

Chapters

  • 00:00 Introduction
  • 02:00 How do you Architect Big Data Data Infrastructure
  • 03:33 Are you taking a look at Ransomware?
  • 06:11 Web Scale Technologies are used mostly in Marketing & Fraud Detection
  • 08:11 Data Engineering - The Mindset Shift
  • 10:51 The Iron Triangle of Data Engineering
  • 13:55 Can I Outsource My Logging Pipeline to a Vendor
  • 15:37 Kafka & Flink - Data Engineering in the Pipeline
  • 18:12 Streaming Analytics & Kafka
  • 22:08 How to Enable Data Science Analytics with Streaming Analytics
  • 26:33 Streaming Analytics
  • 30:25 Data Engineering - Is there a Security Log
  • 32:30 Streaming Analytics is a Weird Thing
  • 35:50 How to Get a Handle on a Big Data Pipeline
  • 39:11 Data Engineering Hacks for Big Data Analytics
    • ...more
    View all episodesView all episodes
    Download on the App Store
    CISO Tradecraft®By CISO Tradecraft®
    • 4.8
    • 4.8
    • 4.8
    • 4.8
    • 4.8

    4.8

    48 ratings

    More shows like CISO Tradecraft®

    View all
    Security Now (Audio) by TWiT

    Security Now (Audio)

    1,986 Listeners

    Risky Business by Patrick Gray

    Risky Business

    364 Listeners

    SANS Internet Stormcenter Daily Cyber Security Podcast (Stormcast) by Johannes B. Ullrich

    SANS Internet Stormcenter Daily Cyber Security Podcast (Stormcast)

    639 Listeners

    Defensive Security Podcast - Malware, Hacking, Cyber Security & Infosec by Jerry Bell and Andrew Kalat

    Defensive Security Podcast - Malware, Hacking, Cyber Security & Infosec

    369 Listeners

    CyberWire Daily by N2K Networks

    CyberWire Daily

    1,016 Listeners

    Smashing Security by Graham Cluley

    Smashing Security

    316 Listeners

    Click Here by Recorded Future News

    Click Here

    407 Listeners

    Darknet Diaries by Jack Rhysider

    Darknet Diaries

    7,956 Listeners

    Cybersecurity Today by Jim Love

    Cybersecurity Today

    164 Listeners

    CISO Series Podcast by David Spark, Mike Johnson, and Andy Ellis

    CISO Series Podcast

    189 Listeners

    Hacking Humans by N2K Networks

    Hacking Humans

    312 Listeners

    Defense in Depth by David Spark, Steve Zalewski, Geoff Belknap

    Defense in Depth

    76 Listeners

    Cyber Security Headlines by CISO Series

    Cyber Security Headlines

    128 Listeners

    Risky Bulletin by risky.biz

    Risky Bulletin

    43 Listeners

    The Pragmatic Engineer by Gergely Orosz

    The Pragmatic Engineer

    62 Listeners