Open source Fluentd has emerged as an open source data collector for massive amounts of log data from often many different sources — in a way that is especially useful for cloud native deployments on Kubernetes.

As one of the developers, Eduardo Silva, principal engineer at Arm and part of the Fluentd development team at Treasure Data, described how and why Fluentd’s utility is becoming even more important to keep up with the demands of scaling data in today’s cloud native world. He discussed that and other benefits the data collector offers during a podcast hosted by Alex Williams, founder and editor-in-chief of The New Stack, recorded at KubeCon + CloudNativeCon 2018 in Shanghai.

The main benefit for Fluentd is how any production environment can have access to comprehensive data analysis about applications, whether they are running on standard servers or on distributed systems with Kubernetes, Silva said. This data might include error information, warnings or general information about how an application is running. This information is provided in the form of messages, called logging, about how they are operating.

Watch on YouTube: https://youtu.be/fgaJKykG_ng