Software Engineering Daily

Software Engineering Daily

By Software Engineering DailyNewsTechnologyTech News
Download on the App Store

All Software Engineering Daily episodes

  • Data Science at Monsanto with Tim Williamson

    “Nothing’s cool unless you call it ‘as a service.’ ”

    Monsanto is a company that is known for its chemical and biological engineering. It is less well known for its data science and software engineering teams. Tim Williamson is a data scientist at Monsanto, and on today’s show he talked about how he and a small group of engineers at Monsanto dramatically shifted the culture around data science-driven genetic engineering.

    In this episode, Tim explains how useful graph databases are for modeling the genetic lineages, and talks about how Monsanto manages simulations and experiments on their genomics software pipeline. Tim also talks about how just a few engineers can create a cultural shift within a large company like Monsanto using the leverage allowed by software.

    Questions
    • Why is data science important to Monsanto?
    • How will data science be used in the future to improve food production?
    • What are a genomics pipeline and a breeding cycle?
    • Can you use simulations to improve genetic predictions?
    • Why are graph databases useful for Monsanto?
    • What is ancestry-as-a-service?
    • Are there any agri-tech companies or products that are really exciting to you?
    • Is it realistic or desirable to move to a meat-free nutrition model?
    • Links
      • Graphs Are Feeding The World
      • YHat Show on SEDaily
      • Monsanto
      • Genetic Imputation
      • In vitro meat
      • Tim on Twitter
      • The post Data Science at Monsanto with Tim Williamson appeared first on Software Engineering Daily.

        55 min
      • Deep Learning and Keras with François Chollet

        “I definitely think we can try to abstract away the first principles of intelligence and then try to go from these principles to an intelligent machine that might look nothing like the brain.”

        Keras is a minimalist, highly modular neural networks library, written in Python and capable of running on top of either TensorFlow or Theano. It was developed with a focus on enabling fast experimentation. In this episode, François discusses the state of deep learning, and explains why the field is experiencing a cambrian explosion that eventually may taper off. He explains the need for Keras and why its simplicity and ease makes it a useful deep learning library for developers to experiment and build with.

        François Chollet is the author of Keras and the founder of Wysp, learning platform for artists. He currently works for Google as a deep learning engineer and researcher.

        Questions
        • Do you try to design intelligent machines using the human brain as a blueprint?
        • How has the structure of software engineering teams changed to accommodate the addition of machine learning?
        • What are the best practices for deploying machine learning systems developed in production by data scientists?
        • Why do neural network developers need to be able to perform fast experimentation?
        • Why is modularity important to a deep learning library?
        • How does Keras interface with the GPU?
        • What are the interesting trends you notice in machine learning?
        • Links
          • Keras
          • Theano
          • Tensor Flow
          • Directed Acylical Graph
          • Lasagne
          • RDD
          • François on Twitter
          • The post Deep Learning and Keras with François Chollet appeared first on Software Engineering Daily.

            52 min
          • Machine Learning for Businesses with Joshua Bloom

            “You’ve got software engineers who are interested in machine learning, and think what they need to do is just bring in another module and then that will solve their problem. It’s particularly important for those people to understand that this is a different type of beast.”

            Machine learning is something that many business are starting to tack onto their existing processes. Yet, to add machine learning capabilities after the fact is often a fool’s errand. Joshua argues that machine learning cannot be an afterthought, but rather must be custom developed to suit the specific problem or question that each company is trying to answer. His company, Wise.io, tackles this challenge of helping business build ground up machine learning applications that generate accurate predictions for use in an array of business processes.

            Joshua Bloom is the cofounder and CTO of Wise.io. He is also an astrophysicist, and a professor of astronomy at UC Berkeley.

            Questions
            • What is a machine learning system?
            • What is the broader impact of this improved ease of use of machine learning algorithms?
            • How do you think data scientists are stratified?
            • What does Wiseio do?
            • How do you abstract away machine learning implementations at large organizations with enterprise software systems?
            • What is it about machine learning systems that give rise to weak contracts between abstraction levels?
            • Links
              • Josh Bloom: Keynote – A Systems View of Machine Learning
              • Machine Learning: The High Interest Credit Card of Technical Debt
              • Machine Learning and Technical Debt with D. Sculley
              • Wise.io
              • Joshua on Wikipedia
              • Joshua on Twitter
              • The post Machine Learning for Businesses with Joshua Bloom appeared first on Software Engineering Daily.

                56 min
              • TensorFlow with Greg Corrado

                “You don’t mind if failures slow things down, but its very important that failures do not stop forward progress.”

                TensorFlow is an open source machine learning library intended to bring large-scale, distributed machine learning and deep learning to everyone. Google recently released the framework to the public as a second-generation API, having learned from the successes and failures of DistBelief.

                Greg Corrado is a senior research scientist and tech lead at Google, where he focuses on the research areas of machine intelligence, machine perception and natural language processing.

                Questions
                • From the end-user’s point of view, how does Smart Reply work?
                • How can teams blend research and engineering to make better products?
                • How did the DistBelief project shape Tensor Flow?
                • How does Tensor Flow differ from streaming frameworks that are more generalized like Spark or Storm?
                • Why would I want to do machine learning on my phone?
                • How is Tensor Flow fault tolerant?
                • What are things the open source community should dive into in Tensor Flow, to fix and improve it?
                • Links
                  • TensorFlow
                  • Computer, respond to this email.
                  • Bridging Data Science and Engineering with Greg Lamp
                  • Greg’s Research Page
                  • Sponsors

                    Hired.com is the job marketplace for software engineers. Go to hired.com/softwareengineeringdaily to get a $600 bonus upon landing a job through Hired.

                    Digital Ocean is the simplest cloud hosting provider. Use promo code SEDAILY for $10 in free credit.

                    The post TensorFlow with Greg Corrado appeared first on Software Engineering Daily.

                    41 min
                  • Data Science at Spotify with Boxun Zhang

                    “I normally try to sit together or very close to a product team or engineering team. And by doing so, I get very close to the source of all kinds of challenging problems.”

                    Spotify is a streaming music service that uses data science and machine learning to implement product features such as recommendation systems and music categorization, but also to answer internal questions.

                    Boxun Zhang is a data scientist at Spotify where he focuses on understanding user behavior within the product.

                    Questions
                    • What is the overlap between distributed systems and data science?
                    • How has Spotify’s big data architecture evolved over time?
                    • As a data scientist do you need to understand this big data architecture well?
                    • What were the benefits for starting to use Kafka?
                    • What kinds of data science problems do you tackle at Spotify?
                    • Could you describe what a random forest is?
                    • Why are there so many streaming systems, and what do you use at Spotify?
                    • How will data science change moving towards the future?
                    • Links
                      • The Evolution of Big Data at Spotify
                      • Luigi
                      • Project Jupyter
                      • XGBoost
                      • Automatic Statistician
                      • Skytree
                      • Sponsors

                        Hired.com is the job marketplace for software engineers. Go to hired.com/softwareengineeringdaily to get a $600 bonus upon landing a job through Hired.

                        Digital Ocean is the simplest cloud hosting provider. Use promo code SEDAILY for $10 in free credit.

                        The post Data Science at Spotify with Boxun Zhang appeared first on Software Engineering Daily.

                        56 min
                      • Learning Machines with Richard Golden

                        “When I was a graduate student, I was sitting in the office of my advisor in electrical engineering and he said, ‘Look out that window – you see a Volkswagon, I see a realization of a random variable.’ ”

                        Richard Golden is the host of Learning Machines 101, a podcast that covers artificial intelligence and machine learning topics. Dr. Golden is also a full-time Professor of Cognitive Science and Electrical Engineering at UT Dallas.

                        Questions
                        • What is machine learning?
                        • What are the fundamental concepts to build artificial intelligence?
                        • How do you define a rule in the domain of machine learning?
                        • How can a machine learning system estimate the probability of something it has not seen?
                        • Could you explain how ML could be applied to real world healthcare scenarios?
                        • What is a neural network?
                        • What is the difference between natural and artificial intelligence?
                        • Links
                          • Bayesian Model Averaging
                          • Frequentist Model Averaging
                          • McCulloch-Pitts Formal Neurons
                          • Dr. Golden’s Professor Page
                          • Sponsors

                            Hired.com is the job marketplace for software engineers. Go to hired.com/softwareengineeringdaily to get a $600 bonus upon landing a job through Hired.

                            Digital Ocean is the simplest cloud hosting provider. Use promo code SEDAILY for $10 in free credit.

                            The post Learning Machines with Richard Golden appeared first on Software Engineering Daily.

                            56 min
                          • Machine Learning and Technical Debt with D. Sculley

                            “Changing anything changes everything.”

                            Technical debt, referring to the compounding cost of changes to software architecture, can be especially challenging in machine learning systems.

                            D. Sculley is a software engineer at Google, focusing on machine learning, data mining, and information retrieval. He recently co-authored the paper Machine Learning: The High Interest Credit Card of Technical Debt.

                            Questions
                            • How do you define technical debt?
                            • Why does technical debt tend to compound like financial debt?
                            • Is machine learning the marriage of hard-coded software logic and constantly changing external data?
                            • What types of anti-patterns should be avoided by machine learning engineers?
                            • What is a decision threshold in a machine learning system?
                            • What advice would you give to organizations that are building their prototypes and product systems in different languages?
                            • Links
                              • Technical Debt
                              • Adapter pattern and glue code
                              • D’s research page
                              • Sponsors

                                Hired.com is the job marketplace for software engineers. Go to hired.com/softwareengineeringdaily to get a $600 bonus upon landing a job through Hired.

                                Digital Ocean is the simplest cloud hosting provider. Use promo code SEDAILY for $10 in free credit.

                                The post Machine Learning and Technical Debt with D. Sculley appeared first on Software Engineering Daily.

                                32 min
                              • Bridging Data Science and Engineering with Greg Lamp

                                Current infrastructure makes it difficult for data scientists to share analytical models with the software engineers who need to integrate them.

                                Yhat is an enterprise software company tackling the challenge of how data science gets done. Their products enable companies and users to easily deploy data science environments and translate analytical models into production code.

                                Greg Lamp is the Co-founder and CTO of Yhat and previously worked as a product manager in financial services. Yhat was part of the Y Combinator winter 2015 class.

                                Questions
                                • At a software company, what is the typical relationship between data scientists and software engineers?
                                • Does Yhat turn data scientists into HTTP endpoints?
                                • What was the most counterintuitive advice you received at Y-Combinator?
                                • What is the moonshot goal for Yhat?
                                • Is it easier to teach data science to an engineer or engineering to a data scientist?
                                • Links
                                  • Yhat’s Products
                                  • Yhat Blog
                                  • Greg’s Website
                                  • Beer Recommender Talk
                                  • The post Bridging Data Science and Engineering with Greg Lamp appeared first on Software Engineering Daily.

                                    48 min
                                  • Kaggle with Ben Hamner

                                    Data science competitions are an effective way to crowdsource the best solutions for challenging datasets.

                                    Kaggle is a platform for data scientists to collaborate and compete on machine learning problems with the opportunity to win money from the competitions’ sponsors.

                                    Ben Hamner is the co-founder and CTO of Kaggle.

                                    Questions
                                    • What is Kaggle?
                                    • How does the experience of an individual competitor compare to the experience of a data science team?
                                    • What is Kaggle’s tech stack?
                                    • Do companies collect too much data?
                                    • How do you use machine learning to convert neural patterns into control signals?
                                    • Links
                                      • Kaggle
                                      • Kaggle Scripts
                                      • Ben Hamner on Quora
                                      • Ben Hamner on Twitter
                                      • The post Kaggle with Ben Hamner appeared first on Software Engineering Daily.

                                        50 min
                                      • Teaching Data Science with Vik Paruchuri

                                        There is a need for more data scientists to make sense of the vast amounts of data we produce and store.

                                        Dataquest is an in-browser platform for learning data science that is tackling this problem.

                                        Vik Paruchuri is the founder of Dataquest. He was previously a machine learning engineer at EdX and before that a U.S. diplomat.

                                        Questions
                                        • What is data science?
                                        • How does data science compare to software engineering?
                                        • How does someone new to data science go about starting off at Kaggle?
                                        • In machine learning, there is unsupervised learning and supervised learning. Could you contrast these two?
                                        • What are the biggest world problems that will be solved with data science?
                                        • Links
                                          • Dataquest
                                          • How to actually learn data science
                                          • Kaggle
                                          • The post Teaching Data Science with Vik Paruchuri appeared first on Software Engineering Daily.

                                            45 min