CISO Tradecraft®

#118 - Data Engineering (with Gal Shpantzer)

Listen Later

Our systems generate fantastic amounts of information, but do we have a complete understanding of how we collect, analyze, manage, store, and retrieve possibly petabytes a day? Gal Shpantzer has been doing InfoSec for over 20 years and has managed some huge data engineering projects, and offers a lot of actionable insights in this CISO Tradecraft episode.

Gal's LinkedIn Page - https://www.linkedin.com/in/riskmanagement/

Gal's Twitter Page - https://twitter.com/Shpantzer

Full Transcript - https://docs.google.com/document/d/14RXnsVttvKlRi6VL94BTrItCjOAjgGem/

Chapters

  • 00:00 Introduction
  • 02:00 How do you Architect Big Data Data Infrastructure
  • 03:33 Are you taking a look at Ransomware?
  • 06:11 Web Scale Technologies are used mostly in Marketing & Fraud Detection
  • 08:11 Data Engineering - The Mindset Shift
  • 10:51 The Iron Triangle of Data Engineering
  • 13:55 Can I Outsource My Logging Pipeline to a Vendor
  • 15:37 Kafka & Flink - Data Engineering in the Pipeline
  • 18:12 Streaming Analytics & Kafka
  • 22:08 How to Enable Data Science Analytics with Streaming Analytics
  • 26:33 Streaming Analytics
  • 30:25 Data Engineering - Is there a Security Log
  • 32:30 Streaming Analytics is a Weird Thing
  • 35:50 How to Get a Handle on a Big Data Pipeline
  • 39:11 Data Engineering Hacks for Big Data Analytics
    • ...more
    View all episodesView all episodes
    Download on the App Store
    CISO Tradecraft®By CISO Tradecraft®
    • 4.8
    • 4.8
    • 4.8
    • 4.8
    • 4.8

    4.8

    48 ratings

    More shows like CISO Tradecraft®

    View all
    Risky Business by Patrick Gray

    Risky Business

    363 Listeners

    SANS Internet Stormcenter Daily Cyber Security Podcast (Stormcast) by Johannes B. Ullrich

    SANS Internet Stormcenter Daily Cyber Security Podcast (Stormcast)

    633 Listeners

    Defensive Security Podcast - Malware, Hacking, Cyber Security & Infosec by Jerry Bell and Andrew Kalat

    Defensive Security Podcast - Malware, Hacking, Cyber Security & Infosec

    371 Listeners

    Hacked by Hacked

    Hacked

    175 Listeners

    CyberWire Daily by N2K Networks

    CyberWire Daily

    1,009 Listeners

    Smashing Security by Graham Cluley & Carole Theriault

    Smashing Security

    313 Listeners

    Click Here by Recorded Future News

    Click Here

    385 Listeners

    Malicious Life by Malicious Life

    Malicious Life

    926 Listeners

    Darknet Diaries by Jack Rhysider

    Darknet Diaries

    7,830 Listeners

    Cybersecurity Today by Jim Love

    Cybersecurity Today

    141 Listeners

    CISO Series Podcast by David Spark, Mike Johnson, and Andy Ellis

    CISO Series Podcast

    187 Listeners

    Hacking Humans by N2K Networks

    Hacking Humans

    308 Listeners

    Defense in Depth by David Spark, Steve Zalewski, Geoff Belknap

    Defense in Depth

    72 Listeners

    Cyber Security Headlines by CISO Series

    Cyber Security Headlines

    120 Listeners

    Risky Bulletin by risky.biz

    Risky Bulletin

    33 Listeners