In this conversation, Neil Ashton interviews Prof. Johannes Brandstetter, a physicist turned machine learning expert, about his journey from academia to industry, focusing on the application of machine learning in engineering and computational fluid dynamics (CFD). They discuss the Aurora project, the challenges of integrating machine learning with engineering, and the importance of data in training models. Johannes shares insights on the use of transformers in modeling, the significance of resolution independence, and the role of open-source practices in advancing the field. The conversation also touches on the challenges of founding a startup and the need for multidisciplinary collaboration in tackling complex engineering problems.

Links: 

Github: https://brandstetter-johannes.github.io
Emmi AI: https://www.emmi.ai
Google scholar: https://scholar.google.com/citations?user=KiRvOHcAAAAJ&hl=de

AB-UPT transform paper: https://arxiv.org/abs/2502.09692

Chapters

00:00 Introduction to Johannes Brandstetter
07:10 The Aurora Project and Key Learnings
11:15 Machine Learning in Engineering and CFD
17:19 Challenges with Mesh Graph Networks
20:16 Transformers in Physics Modeling
31:14 Tokenization in CFD with Transformers
39:58 Challenges in High-Dimensional Meshes
41:08 Inference Time and Mesh Generation
41:36 Neural Operators and CAD Geometry
45:59 Anchor Tokens and Scaling in CFD
48:40 Data Dependency and Multi-Fidelity Models
50:32 The Role of Physics in Machine Learning
54:28 Temporal Modeling in Engineering Simulations
56:58 Learning from Temporal Dynamics
1:00:58 Stability in Rollout Predictions
1:03:48 Multidisciplinary Approaches in Engineering
1:05:18 The Startup Journey and Lessons Learned

In this episode of the Neil Ashton podcast, Professor Russell Cummings shares his extensive journey through the fields of aerodynamics, computational fluid dynamics and hypersonics. He discusses his early inspirations, his early days at University and the Hughes Aircraft Company - a key time during this life. He also talks about  the cyclical nature of hypersonics research, and the challenges faced in computational fluid dynamics (CFD). Prof. Cummings emphasizes the importance of perseverance in engineering careers and the need for collaboration between experimental and computational methods. He also shares insights on the role of AI in hypersonics and offers valuable advice for aspiring engineers.

Prof. Russ Cummings graduated from California Polytechnic State University (Cal Poly) with a B.S. and M.S. in Aeronautical Engineering, before receiving his Ph.D. in Aerospace Engineering from the University of Southern California; he also received a B.A. in music from Cal Poly. He is currently Professor of Aeronautics at the U.S. Air Force Academy and Director of the Hypersonic Vehicle Simulation Institute. Prior to this he was Professor of Aerospace Engineering at Cal Poly, where he also served as department chairman for four years. He also worked at Hughes Aircraft Company, and completed a National Research Council postdoctoral research fellowship at NASA Ames Research Center, working on the computation of high angle-of-attack flowfields. He is a Fellow of the Royal Aeronautical Society and the American Institute of Aeronautics and Astronautics.

Distribution Statement A: approved for public release, PA# USAFA-DF-2025-652. The views expressed in this interview are those of the author and do not necessarily reflect the official policy or position of the United States Air Force Academy, the Air Force, the Department of Defense, or the U.S. Government.

Links

Aerodynamics for engineers: https://www.cambridge.org/us/universitypress/subjects/engineering/aerospace-engineering/aerodynamics-engineers-7th-edition?format=HB&isbn=9781009501309
RAeS Lanchester Named Lecture 2024: Frederick W. Lanchester and 'Aerodynamics' https://www.youtube.com/watch?app=desktop&v=lApNzYaZOmk&t=884s 
NASA at 50 (Prof Cummings is in the picture): https://images.nasa.gov/details/ARC-1989-AC89-0276-6 

Chapters

00:00 Introduction to the Podcast and Guest
04:56 Professor Russell Cummings: A Journey Through Engineering
31:14 The Evolution of Hypersonics Research
58:26 The Role of AI in Hypersonics and CFD
01:37:55 Advice for Aspiring Engineers

In this episode of the Neil Ashton podcast, Professor Mike Giles shares his extensive journey through the fields of computational fluid dynamics (CFD), computational finance and HPC. He discusses his early academic influences, his early days at Cambridge, internships at Rolls-Royce, his transition to MIT and Oxford where he made significant contributions to high-performance computing and numerical analysis. The conversation highlights his hands-on approach to research and teaching, as well as his pioneering work in Monte Carlo methods and GPU computing. This conversation explores the journey of a mathematician and engineer from MIT to Rolls-Royce and then to Oxford, highlighting the evolution of computational engineering, the development of the Hydra code, and the transition from CFD to financial applications.  In this conversation, the speaker reflects on their journey through burnout, career transitions, and the evolution of their work in computational finance and numerical analysis. They discuss the challenges of managing large software projects, the shift from Hydra code development to finance, and the integration of advanced methodologies in their work. The conversation also touches on the role of high-performance computing, the impact of AI on research, and advice for the next generation of students pursuing careers in mathematics and programming.

Links:
https://people.maths.ox.ac.uk/gilesm/

Chapters

00:00 Introduction 
06:25 Professor Mike Giles: A Journey Through CFD and Finance
17:30 Early Academic Influences and Career Path
29:34 Transition to MIT and Early Research
40:01 High-Performance Computing and Its Impact
41:30 Navigating Between MIT and Rolls-Royce
44:54 The Evolution of Research at MIT
48:47 Transitioning to Oxford and the Role of Rolls-Royce
51:07 The Genesis of the Hydra Code
01:00:47 The Role of Conferences in Engineering
01:10:58 The Shift from CFD to Financial Applications
01:21:30 Navigating Burnout and Career Transitions
01:24:04 Shifting Focus: From Hydrocode to Computational Finance
01:29:30 Bridging Mathematics and Finance: Methodologies and Techniques
01:35:09 The Role of High-Performance Computing in Modern Research
01:39:20 AI's Impact on Research and Future Directions
01:54:00 Advice for the Next Generation: Pursuing Passion and Skills

In this episode of the Neil Ashton podcast, the discussion revolves around foundational models in fluid dynamics, particularly in the context of computational fluid dynamics (CFD). Neil shares insights from a recent panel discussion and explores the potential of AI in predicting fluid behavior. He discusses the evolution of AI in CFD, the challenges of data availability, and the differing adoption rates between industries. The episode concludes with predictions about the future of foundational models and their impact on the engineering landscape.

Chapters

00:00 Introduction to the Podcast and Topic
01:09 Foundational Models in Fluid Dynamics
10:09 The Evolution of AI in CFD
19:52 Future Predictions and Industry Dynamics

In this episode of the Neil Ashton podcast,  Neil discusses the intersection of cycling and engineering with Kurt Bergin-Taylor, head of innovation at Tudor Pro Cycling. They explore how technology and science are transforming cycling into a more competitive and innovative sport, akin to Formula One. The conversation covers various aspects of cycling, including the importance of aerodynamics, nutrition, and the holistic approach to rider performance. Kurt shares insights from his academic background and experiences in professional cycling, emphasizing the need for tailored training and the integration of technology in enhancing performance. They discuss the future of cycling innovation, emphasizing the importance of individualization in gear, collaborative relationships with partners, and the evolving mindset of young cyclists. Kurt highlights the significance of data and AI in optimizing performance and strategies in cycling, while also addressing the need for viewer engagement in the sport. Finally Kurt shares valuable advice for aspiring engineers looking to enter the cycling industry, stressing the importance of mentorship and practical experience.

Chapters

00:00 Introduction to the Podcast and Themes
04:55 Kurt Bergin-Taylor: Background and Role at Tudor Pro Cycling
10:08 The Structure and Dynamics of a Pro Cycling Team
12:59 Innovation in Cycling: Aerodynamics, Thermal Management, and Safety
19:14 Nutrition, Training, and Performance in Cycling
29:18 Future Innovations in Cycling Equipment and Systems
30:42 Understanding Individualization in Cycling Gear
34:30 Collaborative Innovation in Cycling Equipment
38:20 The Evolving Mindset of Young Cyclists
42:28 Enhancing Viewer Engagement in Cycling
46:24 The Future of Data and AI in Cycling
50:05 Advice for Aspiring Engineers in Cycling

Takeaways

- Cycling is increasingly influenced by technology and engineering.
- Tudor Pro Cycling is focused on long-term performance and innovation.
- Aerodynamics plays a crucial role in cycling performance.
- Thermal management is essential for riders in extreme conditions.
- Nutrition has dramatically improved in cycling over the last decade.
- Training methodologies must be tailored to individual riders.
- The relationship between power output and speed is complex.
- Safety innovations are critical as speeds increase in cycling.
- Understanding the whole system of rider and equipment is vital.
- Professional cyclists have different recovery capabilities compared to amateurs. Individualization in cycling gear is crucial for performance.
- Collaborative innovation with partners enhances product development.
- Young cyclists are more educated but sometimes overlook tactical aspects.
- Data-driven insights are essential for optimizing race strategies.
- Viewer engagement can be improved through real-time data sharing.
- AI and machine learning are emerging tools in cycling optimization.
- Mentorship is vital for aspiring professionals in the cycling industry.
- Practical experience and initiative can open doors in professional sports.
- Cycling offers a holistic approach to engineering and performance.
- The cycling industry is growing, providing more opportunities for engineers.

A short episode to give a brief update on what I've been doing and to say sorry for not putting out episodes recently. I've joined NVIIDA as a Distinguished CAE Architect and have been rather busy! New episodes will be coming soon! Listen to the episode to learn more. 

In this episode of the Neil Ashton podcast, Neil discusses career advice for aspiring engineers, focusing on the differences between various types of companies, job roles, and the growing importance of software skills in the engineering field. The conversation highlights the pros and cons of working in large enterprises, startups, and consulting firms, as well as the diverse career paths available beyond traditional engineering roles. In this conversation, Neil discusses the evolving landscape of engineering careers, particularly focusing on the increasing relevance of software development and the tech sector. He highlights the diverse career paths available within tech, including software development, product management, and solution architecture, as well as the growing importance of AI in engineering. Neil emphasizes the opportunities for engineers to transition into tech roles and the need for a strong understanding of the tech ecosystem to navigate career decisions effectively.

Chapters

00:00 Introduction to Engineering Careers
03:01 Exploring Company Types in Engineering
06:05 Understanding Job Roles in Engineering
09:00 The Shift Towards Software in Engineering
11:52 Diverse Career Paths Beyond Traditional Engineering
14:47 The Role of Consulting in Engineering
18:03 Navigating the Job Market in Engineering
20:57 The Importance of Software Skills in Engineering
24:03 Conclusion and Future Trends in Engineering Careers
30:08 The Rise of Software Development in Engineering
31:59 The Tech Sector's Growing Relevance to Engineers
36:41 Career Paths in Tech: Software Development and Management
44:27 Understanding Product Management in Tech
48:15 The Role of Solution Architects in Tech
52:04 Consulting and Support Roles in Tech
55:54 AI's Impact on Engineering and Software Development

#careers #engineering #tech #sde #amazon #aws #google #jobs

In this episode of the Neil Ashton podcast, Professor Michael Mahoney discusses the intersection of machine learning, mathematics, and computer science. The conversation covers topics such as randomized linear algebra, foundational models for science, and the debate between physics-informed and data-driven approaches. Prof. Mahoney shares insights on the relevance of his research, the potential of using randomness in algorithms, and the evolving landscape of machine learning in scientific disciplines. He also discusses the evolution and practical applications of randomized linear algebra in machine learning, emphasizing the importance of randomness and data availability. He explores the tension between traditional scientific methods and modern machine learning approaches, highlighting the need for collaboration across disciplines. Prof Mahoney also addresses the challenges of data licensing and the commercial viability of machine learning solutions, offering insights for aspiring researchers in the field.

Prof. Mahoney website: https://www.stat.berkeley.edu/~mmahoney/
Google scholar: https://scholar.google.com/citations?user=QXyvv94AAAAJ&hl=en
Youtube version: https://youtu.be/lk4lvKQsqWU

Chapters

00:00 Introduction to the Podcast and Guest
05:51 Understanding Randomized Linear Algebra
19:09 Foundational Models for Science
32:29 Physics-Informed vs Data-Driven Approaches
38:36 The Practical Application of Randomized Linear Algebra
39:32 Creative Destruction in Linear Algebra and Machine Learning
40:32 The Role of Randomness in Scientific Machine Learning
41:56 Identifying Commonalities Across Scientific Domains
42:52 The Horizontal vs. Vertical Application of Machine Learning
44:19 The Challenge of Common Architectures in Science
46:31 Data Availability and Licensing Issues
50:04 The Future of Foundation Models in Science
54:21 The Commercial Viability of Machine Learning Solutions
58:05 Emerging Opportunities in Scientific Machine Learning
01:00:24 Navigating Academia and Industry in Machine Learning
01:11:15 Advice for Aspiring Scientific Machine Learning Researchers

Keywords

machine learning, randomized linear algebra, foundational models, physics-informed neural networks, data-driven science, computational efficiency, academic advice, numerical methods, AI in science, engineering, Randomized Linear Algebra, Machine Learning, Scientific Computing, Data Availability, Foundation Models, Academia, Industry, Research, Algorithms, Innovation

In this episode of the Neil Ashton Podcast, Dr. Prith Banerjee, CTO of Ansys, shares his extensive journey from academia to the corporate world, discussing the interplay between academia and industry, the role of startups in innovation, and the transformative potential of AI and ML in simulation. He emphasizes the importance of solving real-world problems and the need for collaboration between academia, startups, and large corporations to foster disruptive innovation. He discusses innovative business models for data sharing, the intersection of data-driven and physics-informed approaches, the role of open source in AI innovation, the potential of foundational models in computer-aided engineering (CAE), the future of quantum computing in simulation, and offers advice for aspiring innovators and entrepreneurs. He emphasizes the importance of collaboration, data governance, and the need for interdisciplinary approaches to solve complex problems in engineering and technology.

Dr. Banerjee's book - The Innovation factory: https://www.amazon.com/Innovation-Factory-Prith-Banerjee-PH/dp/B0B7LZPDZW

Youtube version of this episode: https://youtu.be/9Ic5xgJt6BQ

Chapters

00:00 Introduction to the Podcast and Guest
05:18 Dr. Prith Banerjee's Journey: From Academia to CTO
09:10 The Role of Academia, Startups, and Industry
17:22 Advice for Startups: Motivation and Market Sizing
24:04 The Impact of AI and ML on Simulation
35:07 Future of AI in Physics and Simulation
36:10 The Power of Data in AI Models
40:33 Incentivizing Data Sharing for Better Models
42:55 Physics-Driven vs Data-Driven Approaches
47:30 The Role of Open Source in AI Innovation
52:06 Foundational Models and Simulation Data
58:22 The Future of CAE and Quantum Computing
01:06:29 Advice for Aspiring Innovators

Keywords

Neil Ashton, Prith Banerjee, CAE, AI, ML, simulation, academia, startups, industry, innovation, AI, data sharing, physics-driven, open source, foundational models, quantum computing, CAE, simulation, innovation, engineering

In this episode of the Neil Ashton podcast, Peter Coen from NASA discusses the evolution and future of supersonic travel, focusing on the challenges faced by the Concorde, the technological hurdles of modern supersonic aircraft, and the innovative NASA Quesst mission (and X-59 demonstrator) that aims to provide crucial data to rewrite the aviation noise regulations. The conversation delves into the history of supersonic flight, the impact of sonic booms, and the regulatory landscape that will shape the future of aviation. In this conversation, Peter discusses the complexities of supersonic flight, focusing on the physics of shockwaves, innovative design strategies to mitigate sonic booms, and advancements in pilot visibility technology. He emphasizes the importance of human factors in aircraft design and the role of simulation in the development process. The discussion also covers the challenges of engine technology for commercial supersonic travel, the potential for hypersonic passenger travel, and the future of battery technology in aviation. Finally, Peter offers career advice for aspiring professionals in the aeronautics field.

Links
NASA Quesst mission: https://www.nasa.gov/mission/quesst/
AIAA Low-Boom Prediction Workshop: https://lbpw.larc.nasa.gov
X-59 (Lockheed Martin website): https://www.lockheedmartin.com/en-us/products/x-59-quiet-supersonic.html

Chapters

00:00 Introduction to Supersonic Travel
04:05 The History of Supersonic Flight
09:56 Challenges Faced by Concorde
16:02 Technological Challenges of Supersonic Travel
25:48 NASA's X-59 and the Quest Mission
33:45 Future of Supersonic Travel and Regulations
38:04 Understanding Shockwaves in Supersonic Flight
40:02 Design Innovations for Sonic Boom Reduction
43:16 Advancements in Pilot Visibility Technology
46:27 Human Factors in Aircraft Design
48:23 The Role of Simulation in Aircraft Development
51:42 Engine Noise and Its Impact on Supersonic Travel
54:31 The Future of Commercial Supersonic Travel
57:13 Challenges in Engine Technology for Supersonic Aircraft
01:00:17 The Intersection of Military and Supersonic Travel
01:02:09 Exploring Hypersonic Passenger Travel
01:06:39 The Future of Battery Technology in Aviation
01:09:09 Career Advice for Aspiring Aeronautics Professionals

Keywords

supersonic travel, Concorde, NASA, X-59, sonic boom, aviation technology, hypersonic flight, aerospace engineering, aircraft design, noise regulations, supersonic flight, sonic boom, aircraft design, pilot technology, simulation, engine noise, commercial aviation, hypersonic travel, battery technology, aeronautics careers, Peter Coen