Meta Tech Podcast

Bento is Meta’s internal distribution of Jupyter Notebooks, an open-source web-based computing platform. Host Pascal is joined by Steve who worked with his team on building many features on top of Jupyter, including scheduled notebooks, sharing with colleagues and running notebooks without a remote server component by leveraging Webassembly in the browser.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Scheduling Jupyter Notebooks at Meta: https://engineering.fb.com/2023/08/29/security/scheduling-jupyter-notebooks-meta/

• Serverless Jupyter Notebooks at Meta: https://engineering.fb.com/2024/06/10/data-infrastructure/serverless-jupyter-notebooks-bento-meta/

• Jupyter Notebooks: https://jupyter.org/ 

Timestamps

• Intro 0:06

• Who is Steve? 1:49

• What are Jupyter and Bento? 2:48

• Who is Bento for? 3:40

• Internal-only Bento features 4:42

• Scheduled notebooks 11:39

• Integrating with existing batch jobs 17:10

• The case for serverless notebooks 20:59

• Enter wasm 24:29

• Upgrade paths from serverless to server 26:29

• Bringing more Python libraries to the browser 30:21

• Adding magick(s) 31:52

• DataFrame magic and AI 36:41

• What's next? 38:29

• Outro 43:17

We don’t know when but at some point in the future we will face what researchers call a "Quantum Apocalypse". This is when quantum computers will be able to break many of our existing encryption algorithms. To keep Meta’a users safe even from attacks that don’t even exist today, Sheran and Rafael are working on post-quantum-ready encryption. Tune in to learn about the various challenges and trade offs that this work brings with it.  

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Post-quantum readiness for TLS at Meta: https://engineering.fb.com/2024/05/22/security/post-quantum-readiness-tls-pqr-meta/ 

• Fizz TLS implementation: https://github.com/facebookincubator/fizz 

• liboqs: https://github.com/open-quantum-safe/liboqs 

• NIST Post-Quantum Cryptography Submissions: https://csrc.nist.gov/Projects/post-quantum-cryptography/post-quantum-cryptography-standardization/round-3-submissions 

Timestamps

• Intro 0:06

• Meta Open Source 101 1:10

• Intros 1:49

• Sheran Intro 2:31

• Rafael Intro 3:37

• Then Quantum Apocalypse 5:24

• Why symmetric and asymmetric algos behave differently 8:10

• Why invest in tomorrow's problems? 9:21

• First deployment target 14:17

• Choosing an algorithm 18:06

• Choosing the right parameters 19:51

• Performance costs and wins 21:28

• Stack 23:33

• Challenges 25:26

• What's next for PQC? 30:38

• Working with NIST 32:59

• Outro 34:30

• Outtakes 35:43

After sitting in one too many Zoom meetings looking at flat images of 3D models, mechanical engineers Ed, Jason, Fan, and Raghavan decided that they could do better, taught themselves how to code and started to build Caddy - a CAD app for mixed reality. Tune in to episode 64 to hear their story.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Caddy video: https://heycaddy.net/

• Caddy on the Quest Store: https://www.meta.com/en-gb/experiences/24212682218375897/ 

• @Scale conference on YouTube: https://www.youtube.com/channel/UCd9I8ZkgoR1d7GeSj_wi_LQ 

• MLow @Scale talk: https://www.youtube.com/watch?v=3ypsZUNRjI4

• MLow blog post: https://engineering.fb.com/2024/06/13/web/mlow-metas-low-bitrate-audio-codec/ 

• Faster Incident Response with GenAI @Scale talk: https://www.youtube.com/watch?v=rpe7eAR90Ko

• Llama 3: https://llama.meta.com/llama3/

• Meta Unity SDKs: https://developer.oculus.com/documentation/unity/

• Prisms VR: https://www.prismsvr.com/ 

Timestamps

• Intro 0:06

• Ed Intro 2:12

• Raghavan Intro 3:15

• Fan Intro 3:44

• Jason Intro 4:16

• What is Caddy? 4:49

• Why build Caddy? 6:52

• Discovery of hand-based interactions 11:46

• Supported import formats 14:09

• Learning to code 18:09

• Time to Caddy MVP 27:48

• Off-the-shelf components 29:04

• Outgrowing the initial vision 32:48

• AI in Caddy 43:25

• Challenges building Caddy 52:38

• What's next? 55:40

• How to get in touch? 56:56

• Excitement in MR 57:38

• Outro 1:03:35

Aida was part of one of the first Rust teams here at Meta. One of the biggest challenges was interacting with the large amount of existing C++. With the release of cxx, safe interop between C++ and even async Rust has become a lot easier.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Aida’s talk at Rust Nation: https://youtu.be/tsEuA9S5q9Q

• cxx: https://crates.io/crates/cxx

• Sapling: https://sapling-scm.com/

Timestamps

• Intro 0:06

• Aida Intro 2:06

• Rust in Meta Source Control 2:50

• State of Rust at Meta 10:11

• bindgen 13:25

• cxx vs bindgen 17:49

• async Rust and C++ 19:04

• Dealing with Lifetimes 28:19

• Fixing Memory Leaks 31:25

• Thread safety with Send and Sync 33:48

• A Magic Wand for Async Rust 39:52

• Outro 43:04

• Outtakes 43:50

The basic version of Threads for web was built in just under three months by two engineers, mirroring the nimble engineering practices we talked about on this podcast before when it came to launching Threads for Android and iOS. In this episode, Pascal is joined by Ally and Kevin, two engineers on the Threads Web team. They talk about how shared infrastructure with other Meta web properties allows them to move fast and how they manage to balance the need to ship new features with the desire to craft delightful experiences for their users. 

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Threads: https://threads.net

• StyleX: https://stylexjs.com/ 

• FlowJS: https://flow.org/ 

• Introducing Meta Llama 3: https://ai.meta.com/blog/meta-llama-3/

• Building custom silicon for the future of AI: https://www.metacareers.com/life/building-custom-silicon-for-the-future-of-ai

• Building Meta’s GenAI Infrastructure: https://engineering.fb.com/2024/03/12/data-center-engineering/building-metas-genai-infrastructure/ 

Timestamps

• Intro 0:06

• Intro Ally and Kevin 1:44

• Why focus on Web? 2:48

• Kevin's contributions 4:42

• Focus on craft 6:18

• Editing Threads 7:34

• Ally's contributions 10:40

• Prioritising delight and shipping features 12:02

• Launching Threads Web 13:30

• Shared Infra 16:13

• Tech Stack 19:15

• The DevX of Meta www 23:51

• Challenges 30:57

• Favourite bit of polish 34:32

• Outtakes 39:18

Every day, trillions of image download requests are made from Meta’s family of apps. Zuzanna works on the Media Platform Team that owns the entire flow from serving images from the CDN to displaying the pixels on your phone. One of the project she and her team recently worked on was rolling out HDR images to Instagram and Threads and in this episode’s interview, Zuzanna tells show host Pascal how they partnered with large phone manufacturers to develop and roll out the new feature.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Fresco: https://frescolib.org/ 

Timestamps

• Intro 0:06

• Intro Zuza 1:44

• Image Infra Team 3:23

• The scale of images at Meta 5:10

• Measuring quality 10:01

• HDR photos 12:13

• HDR file formats 19:02

• HDR photo availability today 22:34

• Partnering with phone vendors 30:40

• Why photos after videos? 32:27

• Outro 36:22

Distributing binaries and toolchains to developers is a pain but DotSlash makes it a breeze. Instead of committing large, platform-specific executables to your repository, DotSlash combines a fast Rust program with a JSON manifest prefixed with a #! to transparently fetch and execute the binary you need. Tune in to our interview with Andres and Michael to learn more.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Simple Precision Time Protocol at Meta: https://engineering.fb.com/2024/02/07/production-engineering/simple-precision-time-protocol-sptp-meta/ 

• Meta Time libraries on GitHub: https://github.com/facebook/time 

• DotSlash - Simplified executable deployment: https://engineering.fb.com/2024/02/06/developer-tools/dotslash-simplified-executable-deployment/ 

• DotSlash website: https://dotslash-cli.com/ 

• DotSlash on GitHub: https://github.com/facebook/dotslash 

Timestamps

• Intro 0:05

• Intro Andres 2:30

• Intro Michael 3:39

• Andres's Projects at Meta 3:54

• Michael's Projects at Meta 5:00

• What is DotSlash? 5:30

• DotSlash vs LFS 6:04

• DotSlash vs buck2 run 7:08

• Where is DotSlash used at Meta? 8:45

• How does DotSlash work? 9:37

• DotSlash on Windows 13:15

• How DotSlash is built 16:21

• Bundling the rust toolchain 17:14

• Automated DotSlash file generation 20:33

• DotSlash and remote execution 24:53

• Storage providers 26:27

• Why open-source? 30:05

• Limitations 34:17

• Cache Eviction 36:59

• Outro 39:22

• Bloopers 40:15

For the second time in just a few months, we are talking Python on the Meta Tech Podcast. Python 3.12 features a whole range of new features, many of which were contributed by Meta. Carl and Itamar join Pascal to talk about their contributions to the latest release, including new hooks that allow for custom JITs like Cinder, Immortal Objects, improvements to the type system, faster comprehensions and much more. In their discussion, they talk not just about how and why those features were built but also the process of upstreaming and engaging with the community. 

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• “Lazy is the new fast: How Lazy Imports and Cinder accelerate machine learning at Meta” - https://engineering.fb.com/2024/01/18/developer-tools/lazy-imports-cinder-machine-learning-meta/

• “How Meta built the infrastructure for Threads” - https://engineering.fb.com/2023/12/19/core-infra/how-meta-built-the-infrastructure-for-threads/

• Cinder on GitHub - https://github.com/facebookincubator/cinder

• “Meta contributes new features to Python 3.12” - https://engineering.fb.com/2023/10/05/developer-tools/python-312-meta-new-features/

Timestamps

• Intro 0:06

• Carl Intro 2:09

• Itamar Intro 3:27

• Teams and Missions 5:10

• Python 3

• Faster Coroutines 8:57

• Code Watchers and JIT Hooks 12:10

• When to upstream 13:53

• How to upstream to CPython 16:19

• History of Cinder 21:35

• Why not upstream Cinder? 25:48

• Cinder hooks in CPython 29:34

• Free Threading 34:10

• Outro 37:08

For this last episode of 2024, Pascal talks with Devi, an AI research director at Meta. They talk about the history of AI at Meta, some of the basic terms, how Meta's approach to developing and using AI differs notably from other companies and what the future has in store.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Meta AI Blog: https://ai.meta.com/

• Purple Llama: https://ai.meta.com/blog/purple-llama-open-trust-safety-generative-ai/

• AI Alliance: https://ai.meta.com/blog/ai-alliance/

• Audiobox: https://ai.meta.com/blog/audiobox-generating-audio-voice-natural-language-prompts/

• Emu Video and Emu Edit: https://ai.meta.com/blog/emu-text-to-video-generation-image-editing-research/

• Meta AI Agents: https://about.fb.com/news/2023/09/introducing-ai-powered-assistants-characters-and-creative-tools/

Timestamps

• Intro 0:00

• Introduction Devi 2:27

• AI vs ML 4:00

• History of AI at Meta 6:03

• Deep learning and LLMs 9:32

• LLMs vs GenAI 11:42

• Multi-modal models 12:21

• Meta's AI agents 14:33

• Meta's open approach to AI 16:53

• Image and video generation and editing 22:28

• Most exciting future AI developments 27:17

• Outro 28:57

We’re jumping into our time machine and going back to 2018 for an interview with Will B. about the various twists and turns that led to the creation of Instagram Stories. We will be back with a fresh interview next month.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don’t forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

Links

• Rebound: https://github.com/facebookarchive/rebound
• Origami Studio: https://origami.design/

Timestamps

• Intro 0:06

• Will Bailey 1:14

• Early FB iOS app 7:16

• Release Trains 11:52

• The End of HTML5 13:29

• Migration to Native 16:05

• Facebook Home 17:02

• Design Collaboration 22:03

• Instagram 26:33

• Slingshot 27:57

• Instagram for Android 29:54

• Instagram Stories 35:37

• Rebound 41:25

• Outro 44:41