Software Engineering Daily

Software Engineering Daily

By Software Engineering DailyNewsTechnologyTech News
Download on the App Store

All Software Engineering Daily episodes

  • PANCAKE STACK Data Engineering with Chris Fregly

    Data engineering is the software engineering that enables data scientists to work effectively. In today’s episode, we explore the different sides of data engineering–the data science algorithms that need to be processed and the implementation of software architectures that enable those algorithms to run smoothly.

    The PANCAKE STACK is a 12-letter acronym that Chris Fregly gave to a collection of data engineering technologies including Presto, Cassandra, Kafka, Elastic Search, and Spark. In his current life, Chris travels around the world giving workshops on how to deploy and use the PANCAKE STACK. Before that, he was an engineer at Netflix, where he received an Emmy for Streaming Engineering Excellence.

    The post PANCAKE STACK Data Engineering with Chris Fregly appeared first on Software Engineering Daily.

    55 min
  • Scikit-learn with Andreas Mueller

    Scikit-learn is a set of machine learning tools in Python that provides easy-to-use interfaces for building predictive models. In a previous episode with Per Harald Borgen about Machine Learning For Sales, he illustrated how easy it is to get up and running and productive with scikit-learn, even if you are not a machine learning expert.

    Srini Kadamati hosts today’s show and interviews Andreas Mueller, a core committer to scikit-learn. Srini and Andreas discuss the background and implementation of scikit-learn and walk through some prototypical workflows for using it.

    The post Scikit-learn with Andreas Mueller appeared first on Software Engineering Daily.

    32 min
  • Music Deep Learning with Feynman Liang

    Machine learning can be used to generate music. In the case of Feynman Liang’s research project BachBot, the machine learning model is seeded with the music of famous composer Bach. The music that BachBot creates sounds remarkably similar to Bach, although it has been generated by an algorithm, not by a human.

     

    BachBot is a research project on computational creativity. Feynman Liang created BachBot using Python machine learning tools to build a long-short term memory model. Our conversation explores artificial intelligence, music, and his approach to this research project.

    The post Music Deep Learning with Feynman Liang appeared first on Software Engineering Daily.

    45 min
  • Automated Content with Robbie Allen

    You have probably read a news article that was written by a machine. When earnings reports come out, or a series of sports events like the Olympics occurs, there are so many small stories that need to be written that a news organization like the Associated Press would have to use all of its resources to write enough content to cover it all.

     

    Wordsmith is a tool for automated content generation, and today’s guest Robbie Allen is the CEO of Automated Insights, the company that makes Wordsmith. He talks today about the wide range of uses for automated content, as well as how to engineer a product that takes data from a spreadsheet and turns it into a human-readable sentence.

    Robbie is also speaking at the O’Reilly Artificial Intelligence Conference in New York, September 26-27.

    The post Automated Content with Robbie Allen appeared first on Software Engineering Daily.

    49 min
  • Artificial Intelligence with Oren Etzioni

    Research in artificial intelligence takes place mostly at universities and large corporations, but both of these types of institutions have constraints that cause the research to proceed a certain way. In a university, basic research might be hindered by lack of funding. At a big corporation, the researcher might be encouraged to study a domain that is not squarely in the interest of public good–such as targeted advertising.

     

    Oren Etzioni is the CEO of the Allen Institute for Artificial Intelligence, and in this episode we discuss AI research–from the doomful premonitions of Nick Bostrom to the unbridled optimism of Ray Kurzweil, as well as the realities of how AI research actually proceeds. Projects at the Allen Institute are defined and structured to solve problems in an intelligent, scalable fashion, so that engineering can proceed steadily from the local maxima of a problem domain to the global maxima. The Allen Institute seeks to bridge the gap by providing ample funding for open source AI research for the common good.

     

    Oren is also speaking at the O’Reilly Artificial Intelligence Conference in New York, September 26-27.

    The post Artificial Intelligence with Oren Etzioni appeared first on Software Engineering Daily.

    1 hr 2 min
  • TensorFlow in Practice with Rajat Monga

    TensorFlow is Google’s open source machine learning library. Rajat Monga is the engineering director for TensorFlow. In this episode, we cover how to use TensorFlow, including an example of how to build a machine learning model to identify whether a picture contains a cat or not.

    TensorFlow was built with the mission of simplifying the process of deploying a machine learning model from research to production, so we also talk about that, as well as how TensorFlow can be used effectively in combination with Google’s open-source cluster manager, Kubernetes.

    The post TensorFlow in Practice with Rajat Monga appeared first on Software Engineering Daily.

    43 min
  • Data Validation with Dan Morris

    Data Validation is the process of ensuring that data is accurate. In many software domains, an application is pulling in large quantities of data from external sources. That data will eventually be exposed to users, and it needs to be correct.

    Radius Intelligence is a company that aggregates data on small businesses. In order to ensure that business addresses and phone numbers are correct, Radius uses human data validation to ensure that their machine-gathered data is correct. On today’s episode, Srini Kadamati interviews Dan Morris about human data validation, and how it fits into a machine learning pipeline.

    The post Data Validation with Dan Morris appeared first on Software Engineering Daily.

    41 min
  • Machine Learning for Sales with Per Harald Borgen

    Machine learning has become simplified. Similar to how Ruby on Rails made web development approachable, scikit-learn takes away much of the frustrating aspects of machine learning, and lets the developer focus on building functionality with high-level APIs.

     

    Per Harald Borgen is a developer at Xeneta. He started programming fairly recently, but has already built a machine learning application that cuts down on the time his sales team has to spend qualifying leads. What I found most interesting about this episode was that machine learning gets used by a single developer to solve a simple business problem and deliver solid value. This is in contrast to how many of us think about machine learning–as an intimidating domain that requires a large team to build anything meaningful.

    The post Machine Learning for Sales with Per Harald Borgen appeared first on Software Engineering Daily.

    43 min
  • Phone Spam with Truecaller CTO Umut Alp

    The war against spam has been going on for decades. Email spam blockers and ad blockers help protect us from unwanted messages in our communication and browsing experience. These spam prevention tools are powered by machine learning, which catches most of the emails and ads that we don’t want to see. TrueCaller is a company that is bringing this quality of spam detection to our phone call systems.

    Umut Alp is the CTO of TrueCaller, and he joins the show today to break down the engineering problems of preventing telephone call spam. Users of TrueCaller install it on their phones, and the software allows users to report when they have received a spam call. Using this reporting mechanism, and other learning algorithms, TrueCaller is able to learn what types of calls it should block from being accepted by your phone. Today on Software Engineering Daily, we discuss cell phone spam prevention.

    The post Phone Spam with Truecaller CTO Umut Alp appeared first on Software Engineering Daily.

    53 min
  • Machine Learning in Healthcare with David Kale

    “Building a model to predict disease and deploying that in the wild – the bar for success is much higher there than, say, deciding what ad to show you.”

    Diagnosing illness today requires the trained eye of a doctor. With machine learning, we might someday be able to diagnose illness using only a data set. Today on Software Engineering Daily, we are joined by David Kale, a researcher at the intersection of machine learning and clinical data. We discuss the machine learning and research techniques he is using to diagnose illnesses using neural networks, and we also talk about the challenges of performing data science in hospitals, where the data is mostly confidential. David will also be presenting at Strata + Hadoop World in San Jose. We’re partnering with O’Reilly to support this conference – if you want to go to Strata, you can save 20% off a ticket with our code PCSED.

    Questions
    • What kind of work does a data scientist at a children’s hospital do?
    • Where is machine learning actually improving healthcare?
    • What types of data are present in the intensive care unit?
    • Can you give me an example of how you used an LSTM to make a prediction?
    • What were the results of your recurrent neural network experiments?
    • Do you think that deep learning is overhyped right now?
    • Links
      • Learning to Diagnose with LSTM Recurrent Neural Networks
      • Strata+Hadoop World
      • Lasagne
      • Theano
      • Torch
      • Deep Learning for Java
      • Recurrent neural network
      • David’s research page
      • The post Machine Learning in Healthcare with David Kale appeared first on Software Engineering Daily.

        58 min