Machine Learning Street Talk (MLST)

By Machine Learning Street Talk

Technology

What's Machine Learning Street Talk (MLST) about?

Welcome! We at MLST are inspired by scientists and each week we have a hard-hitting discussion with the leading thinkers in the AI space. Street Talk is ridiculously technical and we believe strongly in diversity of thought in AI, covering all the main ideas in the field, avoiding hype where possible.

MLST is run by Dr. Tim Scarfe and Dr. Keith Duggar, and with regular appearances from Dr. Yannic Kilcher.

Download our free app to listen on your phone

LAST EPISODE

MLST #78 - Prof. NOAM CHOMS...

07.08.2022

Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/ESrGqhf5CB In this special edition episode, we have a conversation with Prof. Noam Chomsky, the father of modern linguistics and the most important intellectual of the 20th century. With a career spanning the better part of a ...

Machine Learning Street Talk (MLST) episodes:

07.08.2022 MLST #78 - Prof. NOAM CHOMSKY (Special Edition) Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/ESrGqhf5CB In this special edition episode, we have a conversation with Prof. Noam Chomsky, the father of modern linguistics and the most important intellectual of the 20th century. With a career spanning the better part of a ...
06.16.2022 #77 - Vitaliy Chiley (Cerebras) Vitaliy Chiley is a Machine Learning Research Engineer at the next-generation computing hardware company Cerebras Systems. We spoke about how DL workloads including sparse workloads can run faster on Cerebras hardware. [00:00:00] Housekeeping [00:01:08] Preamble [00:01:50] Vitaliy Chiley Introduction [00:03:11] ...
06.09.2022 #76 - LUKAS BIEWALD (Weights and Biases CEO) Check out Weights and Biases here! https://wandb.me/MLST Lukas Biewald is an entrepreneur living in San Francisco. He was the founder and CEO of Figure Eight an Internet company that collects training data for machine learning. In 2018, he founded Weights ...
04.29.2022 #75 - Emergence [Special Edition] with Dr. DANIELE GRATTAROLA An emergent behavior or emergent property can appear when a number of simple entities operate in an environment, forming more complex behaviours as a collective. If emergence happens over disparate size scales, then the reason is usually a causal relation ...
04.14.2022 #74 Dr. ANDREW LAMPINEN - Symbolic behaviour in AI [UNPLUGGED] Please note that in this interview Dr. Lampinen was expressing his personal opinions and they do not necessarily represent those of DeepMind. Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/ESrGqhf5CB YT version: https://youtu.be/yPMtSXXn4OY Dr. Andrew Lampinen is a Senior Research Scientist at DeepMind, and ...
04.07.2022 #73 - YASAMAN RAZEGHI & Prof. SAMEER SINGH - NLP benchmarks Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/ESrGqhf5CB YT version: https://youtu.be/RzGaI7vXrkk This week we speak with Yasaman Razeghi and Prof. Sameer Singh from UC Urvine. Yasaman recently published a paper called Impact of Pretraining Term Frequencies on Few-Shot Reasoning where she demonstrated comprehensively that ...
03.29.2022 #72 Prof. KEN STANLEY 2.0 - On Art and Subjectivity [UNPLUGGED] YT version: https://youtu.be/DxBZORM9F-8 Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/ESrGqhf5CB Prof. Ken Stanley argued in his book that our world has become saturated with objectives. The process of setting an objective, attempting to achieve it, and measuring progress along the way has become ...
03.25.2022 #71 - ZAK JOST (Graph Neural Networks + Geometric DL) [UNPLUGGED] Special discount link for Zak's GNN course - https://bit.ly/3uqmYVq Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/ESrGqhf5CB YT version: https://youtu.be/jAGIuobLp60 (there are lots of helper graphics there, recommended if poss) Want to sponsor MLST!? Let us know on Linkedin / Twitter. [00:00:00] Preamble [00:03:12] ...
03.19.2022 #70 - LETITIA PARCALABESCU - Symbolics, Linguistics [UNPLUGGED] Today we are having a discussion with Letitia Parcalabescu from the AI Coffee Break youtube channel! We discuss linguistics, symbolic AI and our respective Youtube channels. Make sure you subscribe to her channel! In the first 15 minutes Tim dissects ...
03.12.2022 #69 DR. THOMAS LUX - Interpolation of Sparse High-Dimensional Data Today we are speaking with Dr. Thomas Lux, a research scientist at Meta in Silicon Valley. In some sense, all of supervised machine learning can be framed through the lens of geometry. All training data exists as points in euclidean ...
03.07.2022 #68 DR. WALID SABA 2.0 - Natural Language Understanding [UNPLUGGED] Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/HNnAwSduud YT version: https://youtu.be/pMtk-iUaEuQ Dr. Walid Saba is an old-school polymath. He has a background in cognitive psychology, linguistics, philosophy, computer science and logic and he’s is now a Senior Scientist at Sorcero. Walid is perhaps the ...
03.02.2022 #67 Prof. KARL FRISTON 2.0 We engage in a bit of epistemic foraging with Prof. Karl Friston! In this show; we discuss the free energy principle in detail, also emergence, cognition, consciousness and Karl's burden of knowledge! YT: https://youtu.be/xKQ-F2-o8uM Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/HNnAwSduud [00:00:00] Introduction ...
02.28.2022 #66 ALEXANDER MATTICK - [Unplugged / Community Edition] We have a chat with Alexander Mattick aka ZickZack from Yannic's Discord community. Alex is one of the leading voices in that community and has an impressive technical depth. Don't forget MLST has now started it's own Discord server too, ...
02.26.2022 #65 Prof. PEDRO DOMINGOS [Unplugged] Note: there are no politics discussed in this show and please do not interpret this show as any kind of a political statement from us. We have decided not to discuss politics on MLST anymore due to its divisive nature. ...
02.24.2022 #64 Prof. Gary Marcus 3.0 Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/HNnAwSduud YT: https://www.youtube.com/watch?v=ZDY2nhkPZxw We have a chat with Prof. Gary Marcus about everything which is currently top of mind for him, consciousness [00:00:00] Gary intro [00:01:25] Slightly conscious [00:24:59] Abstract, compositional models [00:32:46] Spline theory of NNs ...
02.22.2022 #063 - Prof. YOSHUA BENGIO - GFlowNets, Consciousness & Causality We are now sponsored by Weights and Biases! Please visit our sponsor link: http://wandb.me/MLST Patreon: https://www.patreon.com/mlst For Yoshua Bengio, GFlowNets are the most exciting thing on the horizon of Machine Learning today. He believes they can solve previously intractable problems ...
02.03.2022 #062 - Dr. Guy Emerson - Linguistics, Distributional Semantics Dr. Guy Emerson is a computational linguist and obtained his Ph.D from Cambridge university where he is now a research fellow and lecturer. On panel we also have myself, Dr. Tim Scarfe, as well as Dr. Keith Duggar and the ...
01.04.2022 061: Interpolation, Extrapolation and Linearisation (Prof. Yann LeCun, Dr. Randall Balestriero) We are now sponsored by Weights and Biases! Please visit our sponsor link: http://wandb.me/MLST Patreon: https://www.patreon.com/mlst Yann LeCun thinks that it's specious to say neural network models are interpolating because in high dimensions, everything is extrapolation. Recently Dr. Randall Balestriero, ...
10.31.2021 Siraj Raval - Stories about YouTube, Plagiarism, and the Dangers of Fame (Interview) Yannic has a conversation with Siraj Raval about his journey on YouTube, and the perils of fame. Siraj Raval was a famous ML youtuber who was caught plagiarising his content and having a catastrophic fall from grace. OUTLINE: 0:00 - ...
09.19.2021 #60 Geometric Deep Learning Blueprint (Special Edition) Patreon: https://www.patreon.com/mlst The last decade has witnessed an experimental revolution in data science and machine learning, epitomised by deep learning methods. Many high-dimensional learning tasks previously thought to be beyond reach -- such as computer vision, playing Go, or protein ...
09.03.2021 #59 - Jeff Hawkins (Thousand Brains Theory) Patreon: https://www.patreon.com/mlst The ultimate goal of neuroscience is to learn how the human brain gives rise to human intelligence and what it means to be intelligent. Understanding how the brain works is considered one of humanity’s greatest challenges. Jeff Hawkins ...
08.11.2021 #58 Dr. Ben Goertzel - Artificial General Intelligence The field of Artificial Intelligence was founded in the mid 1950s with the aim of constructing “thinking machines” - that is to say, computer systems with human-like general intelligence. Think of humanoid robots that not only look but act and ...
07.25.2021 #57 - Prof. Melanie Mitchell - Why AI is harder than we think Since its beginning in the 1950s, the field of artificial intelligence has vacillated between periods of optimistic predictions and massive investment and periods of disappointment, loss of confidence, and reduced funding. Even with today’s seemingly fast pace of AI breakthroughs, ...
07.08.2021 #56 - Dr. Walid Saba, Gadi Singer, Prof. J. Mark Bishop (Panel discussion) It has been over three decades since the statistical revolution overtook AI by a storm and over two decades since deep learning (DL) helped usher the latest resurgence of artificial intelligence (AI). However, the disappointing progress in conversational agents, NLU, ...
06.21.2021 #55 Self-Supervised Vision Models (Dr. Ishan Misra - FAIR). Dr. Ishan Misra is a Research Scientist at Facebook AI Research where he works on Computer Vision and Machine Learning. His main research interest is reducing the need for human supervision, and indeed, human knowledge in visual learning systems. He ...
06.04.2021 #54 Gary Marcus and Luis Lamb - Neurosymbolic models Professor Gary Marcus is a scientist, best-selling author, and entrepreneur. He is Founder and CEO of Robust.AI, and was Founder and CEO of Geometric Intelligence, a machine learning company acquired by Uber in 2016. Gary said in his recent next ...
05.19.2021 #53 Quantum Natural Language Processing - Prof. Bob Coecke (Oxford) Bob Coercke is a celebrated physicist, he's been a Physics and Quantum professor at Oxford University for the last 20 years. He is particularly interested in Structure which is to say, Logic, Order, and Category Theory. He is well known ...
05.01.2021 #52 - Unadversarial Examples (Hadi Salman, MIT) Performing reliably on unseen or shifting data distributions is a difficult challenge for modern vision systems, even slight corruptions or transformations of images are enough to slash the accuracy of state-of-the-art classifiers. When an adversary is allowed to modify an ...
04.16.2021 #51 Francois Chollet - Intelligence and Generalisation In today's show we are joined by Francois Chollet, I have been inspired by Francois ever since I read his Deep Learning with Python book and started using the Keras library which he invented many, many years ago. Francois has ...
04.04.2021 #50 Christian Szegedy - Formal Reasoning, Program Synthesis Dr. Christian Szegedy from Google Research is a deep learning heavyweight. He invented adversarial examples, one of the first object detection algorithms, the inceptionnet architecture, and co-invented batchnorm. He thinks that if you bet on computers and software in 1990 ...
03.23.2021 #49 - Meta-Gradients in RL - Dr. Tom Zahavy (DeepMind) The race is on, we are on a collective mission to understand and create artificial general intelligence. Dr. Tom Zahavy, a Research Scientist at DeepMind thinks that reinforcement learning is the most general learning framework that we have today, and ...
03.16.2021 #48 Machine Learning Security - Andy Smith First episode in a series we are doing on ML DevOps. Starting with the thing which nobody seems to be talking about enough, security! We chat with cyber security expert Andy Smith about threat modelling and trust boundaries for an ...
03.14.2021 047 Interpretable Machine Learning - Christoph Molnar Christoph Molnar is one of the main people to know in the space of interpretable ML. In 2018 he released the first version of his incredible online book, interpretable machine learning. Interpretability is often a deciding factor when a machine ...
03.06.2021 #046 The Great ML Stagnation (Mark Saroufim and Dr. Mathew Salvaris) Academics think of themselves as trailblazers, explorers — seekers of the truth. Any fundamental discovery involves a significant degree of risk. If an idea is guaranteed to work then it moves from the realm of research to engineering. Unfortunately, this ...
02.28.2021 #045 Microsoft's Platform for Reinforcement Learning (Bonsai) Microsoft has an interesting strategy with their new “autonomous systems” technology also known as Project Bonsai. They want to create an interface to abstract away the complexity and esoterica of deep reinforcement learning. They want to fuse together expert knowledge ...
02.25.2021 #044 - Data-efficient Image Transformers (Hugo Touvron) Today we are going to talk about the *Data-efficient image Transformers paper or (DeiT) which Hugo is the primary author of. One of the recipes of success for vision models since the DL revolution began has been the availability of ...
02.19.2021 #043 Prof J. Mark Bishop - Artificial Intelligence Is Stupid and Causal Reasoning won't fix it. Professor Mark Bishop does not think that computers can be conscious or have phenomenological states of consciousness unless we are willing to accept panpsychism which is idea that mentality is fundamental and ubiquitous in the natural world, or put simply, ...
02.11.2021 #042 - Pedro Domingos - Ethics and Cancel Culture Today we have professor Pedro Domingos and we are going to talk about activism in machine learning, cancel culture, AI ethics and kernels. In Pedro's book the master algorithm, he segmented the AI community into 5 distinct tribes with 5 ...
02.03.2021 #041 - Biologically Plausible Neural Networks - Dr. Simon Stringer Dr. Simon Stringer. Obtained his Ph.D in mathematical state space control theory and has been a Senior Research Fellow at Oxford University for over 27 years. Simon is the director of the the Oxford Centre for Theoretical Neuroscience and Artificial ...
01.31.2021 #040 - Adversarial Examples (Dr. Nicholas Carlini, Dr. Wieland Brendel, Florian Tramèr) Adversarial examples have attracted significant attention in machine learning, but the reasons for their existence and pervasiveness remain unclear. there's good reason to believe neural networks look at very different features than we would have expected. As articulated in the ...
01.23.2021 #039 - Lena Voita - NLP ena Voita is a Ph.D. student at the University of Edinburgh and University of Amsterdam. Previously, She was a research scientist at Yandex Research and worked closely with the Yandex Translate team. She still teaches NLP at the Yandex School ...
01.20.2021 #038 - Professor Kenneth Stanley - Why Greatness Cannot Be Planned Professor Kenneth Stanley is currently a research science manager at OpenAI in San Fransisco. We've Been dreaming about getting Kenneth on the show since the very begininning of Machine Learning Street Talk. Some of you might recall that our first ...
01.11.2021 #037 - Tour De Bayesian with Connor Tann Connor Tan is a physicist and senior data scientist working for a multinational energy company where he co-founded and leads a data science team. He holds a first-class degree in experimental and theoretical physics from Cambridge university. With a master's ...
01.03.2021 #036 - Max Welling: Quantum, Manifolds & Symmetries in ML Today we had a fantastic conversation with Professor Max Welling, VP of Technology, Qualcomm Technologies Netherlands B.V. Max is a strong believer in the power of data and computation and its relevance to artificial intelligence. There is a fundamental blank ...
12.27.2020 #035 Christmas Community Edition! Welcome to the Christmas special community edition of MLST! We discuss some recent and interesting papers from Pedro Domingos (are NNs kernel machines?), Deepmind (can NNs out-reason symbolic machines?), Anna Rodgers - When BERT Plays The Lottery, All Tickets Are ...
12.20.2020 #034 Eray Özkural- AGI, Simulations & Safety Dr. Eray Ozkural is an AGI researcher from Turkey, he is the founder of Celestial Intellect Cybernetics. Eray is extremely critical of Max Tegmark, Nick Bostrom and MIRI founder Elizier Yodokovsky and their views on AI safety. Eray thinks that ...
12.13.2020 #033 Prof. Karl Friston - The Free Energy Principle This week Dr. Tim Scarfe, Dr. Keith Duggar and Connor Leahy chat with Prof. Karl Friston. Professor Friston is a British neuroscientist at University College London and an authority on brain imaging. In 2016 he was ranked the most influential ...
12.06.2020 #032- Simon Kornblith / GoogleAI - SimCLR and Paper Haul! This week Dr. Tim Scarfe, Sayak Paul and Yannic Kilcher speak with Dr. Simon Kornblith from Google Brain (Ph.D from MIT). Simon is trying to understand how neural nets do what they do. Simon was the second author on the ...
11.28.2020 #031 WE GOT ACCESS TO GPT-3! (With Gary Marcus, Walid Saba and Connor Leahy) In this special edition, Dr. Tim Scarfe, Yannic Kilcher and Keith Duggar speak with Gary Marcus and Connor Leahy about GPT-3. We have all had a significant amount of time to experiment with GPT-3 and show you demos of it ...
11.20.2020 #030 Multi-Armed Bandits and Pure-Exploration (Wouter M. Koolen) This week Dr. Tim Scarfe, Dr. Keith Duggar and Yannic Kilcher discuss multi-arm bandits and pure exploration with Dr. Wouter M. Koolen, Senior Researcher, Machine Learning group, Centrum Wiskunde & Informatica. Wouter specialises in machine learning theory, game theory, information ...

Older episodes