XGBoost is an open-source software library which has won several Machine Learning competitions in Kaggle. It is based on the principles of gradient boosting, which is based on the ideas of the Leo Breiman, the creator of Random Forest. The theory behind gradient boosting was later formalized by Jerome H. Friedman. Gradient boosting combines weak learners just as Random Forest. XGBoost is an engineering implementation which includes a clever penalization of trees and a proportional shrinking of leaf nodes.

14 XGBoost: The Winner of Many Competitions

Machine Learning with Coffee is a podcast where we are going to be sharing ideas about Machine Learning and related areas such as: artificial intelligence, business intelligence, business analytics, data mining and Big data. The objective is to promote a healthy discussion on the current state of this fascinating world of Machine Learning. We will be sharing our experience, sharing tricks, talking about latest developments and interviewing experts, all these on a very laid back, friendly manner. So, what are you waiting for? Grab a coffee and join us.

Technology

Tech News

Podcasting

Gadgets

Software How-To

Business

Investing

Careers

Management & Marketing

Business News

Shopping

News

We introduce the concept of a perceptron as the basic component of a neural network. We talk about how important is to understand the concept of backpropagation applied to a single neuron.

20 Perceptron: Machine Learning Begins

We discuss Independent Component Analysis as one of the most popular and robust techniques to decompose mixed signals. ICA has important applications in audio processing, video, EEG and in many datasets, which present very high multicollinearity. 

19 ICA: Independent Component Analysis

We present 3 clustering algorithms which will help us detect anomalies: DBSCAN, Gaussian Mixture Models and K-means. These 3 algorithms are very popular and basic but have passed the test of time. All these algorithms have many variations which try to overcome some of the disadvantages of the original implementation.

17 Anomaly Detection: Clustering

Anomaly detection is not something recent, techniques have been around for decades. Control charts are graphs with solid mathematical and statistical foundations which monitor how a process changes over time. They implement control limits which automatically flag anomalies in a process in real-time. Depending on the problem at hand, control charts might be a better alternative to more sophisticated machine learning approaches for anomaly detection. 

16 Anomaly Detection: Control Charts

Adaboost is one of the classic machine learning algorithms. Just like Random Forest and XGBoost, Adaboost belongs to the ensemble models, in other words, it aggregates the results of simpler classifiers to make robust predictions. The main different of Adaboost is that it is an adaptive algorithm, which means that it learns from the misclassified instances of previous models, assigning more weights to those errors and focusing its attention on those instances in the next round.

14 XGBoost: The Winner of Many Competitions

Download our free app to listen on your phone