Kate Stewart | Sean Goggins | Georg Link

Linode

[00:02:40] We start off on the topic of looking at metrics that are useful for identifying what’s going on in a Software Configuration Management system. David tells us what it is and if there’s a difference between building software and deploying it. Also, figuring out which components you’re going to bring in, to your overall system.

[00:07:55] Kate wants to know how much do the hidden dependencies play a role in risk of using Open Source and using projects, and do we see things people aren’t expecting? Sean asks if there are high profile cases where folks did not manage those dependencies terribly well and bad things happened.

[00:14:09] Sean wants to know what kind of metric might help to identify that kind of programmer error that results in malicious code being introduced into a project and are there other ways that we could measure the existence of that phenomenon? CII Best Practices Badge is talked about here.

[00:16:38] Kate mentions a survey that came out late last year of the most popular software that came out recently, and there’s some top packages that were identified through the analysis that had come from the scanners and everything else. Of those packages, how many of them have badges? Frank tells us the analysis he did and the results (report linked below).

[00:19:45] Sean talks about things he’s observed when it comes to packages and dependencies and which ones are more popular in the course of the project. He wonders if anyone on the panel has started thinking about how do we assess things that are within a repository and what challenges does that pose from a metrics perspective?

[00:23:34] License Risk on a project is discussed here by Kate and David.

[00:28:09] Sean wants to know if he’s creating an Open Source software project and he Googles “Open Source Software licenses,” is he in a pretty safe space or are there other Open Source licenses that are pretending that they’re Open Source? David tells us where to look to find out.

[00:29:32] Frank tells us what kinds of metrics or pieces of what they’ve talked about as being significant in both economic impacts and the future of work.

[00:33:53] Sean wants to know in regard to Frank’s survey, what kinds of things he is looking to measure that we can’t with trace data from a repo.

[00:36:39] Georg asks Frank if he’s has some early insights that might be interesting with the survey.

[00:39:02] David and Frank tell us places you can check out to learn more.

Frank Nagle Twitter

Special Guests: David A. Wheeler and Frank Nagle.

Support CHAOSScast

Venia Logan | Matt Broberg

Linode

[00:02:23] Matt and Venia explain what a Vanity Metric is.

[00:06:41] Matt wants to know what is the opposite of a Vanity Metric?

[00:10:46] Matt and Venia talk about how having a community strategy is so essential to understanding why we are using metrics.

[00:12:27] Matt brings up being in the hot seat of being Community Manager and an uncomfortable moment he had. Venia tells us a powerful story she encountered in her background with the LGBTQ.

[00:19:35] Matt shares ones of his favorite quotes and then he asks Venia what’s the risk of measuring, especially with vanity metrics, where you provide an incentive for things that we don’t necessarily want to incentivize?

[00:20:25] Venia tells us what GDPR (General Data Protection Regulation) is and she highly recommends a lawyer, Suzanne Dibble, who has extensively covered GDPR.

[00:24:20] Matt and Venia talk about places to start if people are looking for advice and what are things that are vanity looking but could end of being valuable.

[00:30:37] Venia talks about communities being socio-cultural in nature and therefore they must be measured social scientifically.

[0036:31] Matt and Venia give their takeaways from today’s conversation that you can hold onto when it comes to the idea of vanity metrics.

CHAOSS

Matt Broberg Twitter

Venia Logan Twitter

MeasurementMarketing.io-Chris Mercer

GDPR (General Data Protection Regulation)

Suzanne Dibble-GDPR

Support CHAOSScast

Georg Link | Venia Logan | Don Marti | Nicole Huesman | Daniel Izquierdo

Linode

[00:02:56] Ruth tells us all about herself, her background, as well as what Mautic is and what they do.

[00:04:41] Ruth shares with us what she’s doing with the metrics platform and how that has informed her work.

[00:06:31] Nicole mentions Ruth’s blog and she recently launched a community health dashboard. Since within the CHAOSS project they work with different metrics around community health, she wonders which metrics does she find most useful and not as useful? She also explains how these metrics have affected her work since she’s made changes to the community over the last year.

[00:09:27] Ruth tells us what her plan is moving forward to balance contributors with users of the platform who might be non-coding. Venia asks Ruth if she finds that you have to balance the demand of users using the platform but who can’t contribute with the amount of people contributing to the program? Are these viewed as two separate but inner connected communities or do you treat them as one large community?

[00:11:52] Don wonders if Ruth sees a lot people who are active in both maintaining a plugin and then also contributing to core or perhaps being a maintainer on a plugin and then also a core contributor?

[00:13:42] Daniel asks if Ruth if she has had any feedback from the community about privacy issues. She also explains how Mautic is handling the general PR of policy limiting what we can do as marketers.

[00:18:18] With all these challenges and the features that the software needs to provide, Georg wants to know if this is something that the community takes up. Also, since Ruth said there’s a lot of education that needs to happen on how to use the tool properly, how does that get into the community?

[00:20:38] Ruth talks about documentation and Mautic participating in a Google Season of Docs.

[00:23:07] Nicole brings up something interesting Ruth brought up in her blog about a project that brings together contributors and makes them experts in a particular area of contribution where they’re contributing to features of a project.

[00:25:56] Ruth fills us in on the community health report and the way she’s done it to inform people how to do it their own communities to great health and community empowerment. She also tells us if she uses a lot of qualitative data processes when building the report and what the conversations look like between the community members who read the report.

[00:30:25] The topic of KPI’s and metrics being monitored is discussed here.

[00:33:10] Integrating privacy tools and the challenge marketers face with the number of tools they have in their stack is discussed.

Ruth Cheesley Twitter

Ruth Cheesley Bio

Ruth Cheesley Linkedin

Mautic.org

Mautic Community Handbook

CHAOSS

Keybase

Hellobot

The NEW Low-Maintenance Garden by Valerie Easton

Savannah-GitHub

Suzanne Dibble-GDPR

Brandeis University announces commitment to open source movement

Special Guest: Ruth Cheesley.

Support CHAOSScast

Venia Logan | Nicole Huesman | Brian Proffitt

Jono Bacon

Linode

[00:02:16] Jono gives us an introduction what he does and how he got into his job.

[00:03:48] Nicole asks Jono what are some of the key strategies he’s used over the years to propel his career in community management and community strategy?

[00:07:10] Venia wants to know how Jono ended up managing the role of community manager as he went through his early days.

[00:09:52] Brian wants to know how Jono views the science part of the community health aspect of it and how has that evolved his experience, like early pioneer days to where we are now.

[00:16:15] Jono talks about things that worry him with data and how in recent years we’ve become data fetishists. He also talks about Earl Madman Muntz who ran a TV factory and he needed to reduce costs. Great story here. 

[00:21:38] Jono explains why he’s a fan of aggregate evaluation of the value. He talks about a model he developed over the years called the Community Participation Lifecycle.

[00:25:00] Brian asks Jono what he feels is the least understood aspect of being a Community Manager.

[00:33:20] Venia wonders where Jono sees this phenomenon of open source community management moving forward as it permeates the closed economic spheres.

[00:36:35] As we look at the CHAOSS project, Nicole wonders what role does Jono see the CHAOSS project playing in helping us understand the metrics of healthy communities and what would he like to see from the CHAOSS project.

Jono Bacon

Jono Bacon Twitter

People Powered: How Communities Can Supercharge Your Business, Brand, and Teams by Jono Bacon

Earl “Madman” Muntz

CHAOSS

Special Guest: Jono Bacon.

Support CHAOSScast

Georg Link | Brian Proffitt | Nicole Huesman

Chris Aniszczyk

Linode

[00:02:19] When we talk about community health, Chris tells us what comes to mind for him in the context of CNCF. He also tells us what his role is at CNCF.

[00:06:03] Brian is curious to how Chris has adapted his metrics or if he’s adapted his metrics to compensate for the fact that he is in such an explosive mode of growth and has he made adjustments for that.

[00:10:40] Chris talks about CNCF being a vendor neutral organization.

[00:13:12] Nicole wants to know of all the different things Chris is measuring, are there a few that rise to the surface as either the most important or some things that have been aha moments or surprises for him.

[00:15:43] Chris talks about how the view of diversity and inclusion is within the Cloud Native Community and some of the investments that he’s making there.

[00:21:58] Nicole asks Chris to talk about the wonderful people working in the Cloud Native community. He discusses what percentage of men and women CNCF is comprised of and how they are part of the Linux Foundation.

[00:26:28] Georg wants to know how CNCF does metrics for the governing board, technical committee, the project, SIG (Special Interest Group) for the working groups, or do they even go at that level. Also, DevStats provide metrics and how does that play into this. He also explains the annual report and how it all fits together.

[00:31:27] Brian is curious to know from Chris how CNCF began their journey with metrics and where was the start?

[00:34:15] Chris tells us how he views the roll of the CHAOSS project and what he would like to see from the CHAOSS project.

[00:37:29] Chris tells us about the work he does at the TODO Group, which is a network of Open Source Program offices.

[00:42:00] Chris gives us some advice for anyone starting out their open source program office journey.

Chris Aniszczyk Twitter

Chris Aniszczyk Linkedin

Chris Aniszczyk Website

Cloud Native Computing Foundation (CNCF)

Project Health Table DevStats

Code Together Podcast-Nicole Huesman

Rick Riordan Books

13TH-Netflix

White Fragility by Robin DiAngelo

TODO Group Survey

CNCF Annual Report 2019

CNCF Survey Data-GitHub

Special Guest: Chris Aniszczyk.

Support CHAOSScast

Dawn Foster | Matt Germonprez | Sean Goggins | Georg Link | Don Marti

Linode

[00:02:43] Georg explains Open Source, Open Source Community, and Open Source Community Health.

[00:04:25] The rest of the panelists give their opinions on Open Source Community Health.

[00:08:04] Dawn talks about OpenSSL, which is an Open Source project that is in use by almost every single big company in the world but maintained by only a couple of people who could barely afford to do it.

[00:08:45] Don wonders if Open Source Metrics would have helped companies address the OpenSSL situation before it became a headline problem? Sean and Dawn give their opinions.

[00:10:00] Since Sean mentions sustainability, Georg asks Sean where’s the distinction between health and sustainability or is that the same thing?

[00:11:47] Matt wants to know when you’re looking at a software community how much do you differentiate between looking at the community purely from a using the software perspective versus looking at the community from, I would like to contribute to this community?

[00:15:24] We talk about the different working groups here and we talk about other ways that we can conceptualize other areas of community health.

[00:17:10] Dawn makes a point to say when we talk about working groups, what we’re really talking about coming up with definitions for metrics and anyone can contribute. Don talks about different categories in which he thinks of metrics.

[00:20:43] Sean asks Don if there are a lot of job postings for a particular technology? Does the fact there may be many jobs for Kubernetes right now and does that influence how many people participate in that project? How do people decide what to contribute to?

[00:24:30] Sean wants to know from Dawn what are some of the things VMWare concentrates on and she lets us know.

[00:29:08] The panellists talk about the different ways we can get insights to Open Source Community Health.

[00:37:16] Don clarifies what he means when he says, “projects site each other.”

[00:38:25] If you are interested in getting involved in CHAOSS find out here.

CHAOSS

Neon Tetra

Picnic Backpack

Augur Slackbot

California Consumer Privacy Act (CCPA)

OpenSSL

Support CHAOSScast

Matt Broberg | Venia Logan | Sean Goggins | Georg Link

Linode

[00:02:33] We start here with learning about what measurement tools exist in the CHAOSS project.

[00:07:06] Georg gives us some context on how Bitergia, GrimoireLab, Bitergia Analytics, and CHAOSS all relate to each other.

[00:09:01] Manrique fills us in on why Open Source is relevant to what they’re doing with Bitergia and GrimoireLab.

[00:10:37] Since Venia is the co-creator of one of the metrics, Matt is wondering when she looks at the GrimoireLab tool chain, how does that add value to what she’s looking to achieve with it?

[00:12:41] Ray has a question for Manrique and Georg and wonders what have they benefited from joining CHAOSS and what have they been able to gain from being a part of a larger community? Also, have there been other benefits that they have gained from working with other software communities related to metrics?

[00:16:04] Venia mentions how she wants to applaud Bitergia for how much they advertise CHAOSS and Bitergia being completely separate entities and she explains.

[00:17:55] What is the goal of using GrimoireLab and what are some examples of people using it right now?

[00:22:56] Ray tells us how he uses GrimoireLab. Also, Venia gives us her thoughts on dashboarding.

[00:32:22] Sean is curious to know what kinds of choices are made in the design of the GrimoireLab technology to prohibit, prevent, or create some of transparency around anything that might be used to measure and individual? Also, since Git Log stores his identifying information organically, how do they handle that technically? Manrique answers these questions.

[00:00:00] Matt asks Valerio if he has any stories or ideas that come to mind on how he chose to write the software that would be interesting to somebody that may not be as deep in the code as him?

[00:39:12] Valerio is a mentor for Google Summer of Code participants and he’s going to tell us a little about what that is.

Manrique Lopez Twitter

Valerio Cosentino Twitter

Ray Paik Twitter

GrimoireLab

Bitergia

Google Summer of Code

“Incorporating The Digital Commons”-Benjamin Birkinbine

MeasurementMarketing.io-Chris Mercer

“The Tyranny of Metrics”-Jerry Z. Muller

PlaidML

Fedora 32

GrimoireLab Install Blog Post

GrimoireLab’s Project Hero’s Journey Story

GitHub Docker composer

Cauldron

CHAOSScon Europe 2020

CHAOSS Community Participate

Special Guests: Jose Manrique López de la Fuente, Ray Paik, and Valerio Cosentino.

Support CHAOSScast

Matt Broberg | Dawn Foster | Matt Germonprez | Georg Link

Linode

[00:02:23] Sean and Gabe explain what Augur is and how Augur is an integral part of the CHAOSS project.

Special Guests: Carter Landis and Gabe Heim.

Support CHAOSScast

Dawn Foster | Matt Broberg | Georg Link

Linode

Welcome to this episode of CHAOSSCast! Today, we have special guests, Venia Logan and Dylan Marcy of SociallyConstructed.Online. They are here to do some introspection on the process CHAOSS follows for defining metrics and to demonstrate this using the Social Currency Metric System (SCMS). It is a very interesting topic and if you don’t know much about SCMS, then this podcast is definitely worth a listen.

[00:04:00] Venia and Dylan introduce themselves, who they are, what they do, and brought them to CHAOSS.

[00:09:55] Venia and Dylan share how they came about to develop the initiation of the social currency metric system.

[00:14:54] Matt wants to know what it looks like to use SCMS (Social Currency Metric System) and Dylan explains.

[00:18:03] Georg wants to know what the sentiment is and what are these comments that they are talking about. Are they issue comments in open source, issue trackers, emails, slack messages? What is the qualitative data? Dylan and Venia explain.

[00:22:24] What role does sentiment analysis play into this whole system? Dylan and Venia have great responses.

[00:28:11] Matt B. is curious to know if the dashboard is a choose your own adventure dashboard or is it a tool chain, like a set of dashboards that are predefined? Venia loves this question and explains.

[00:33:18] Venia explains the very purpose of the Social Currency Metric System and Matt has an Aha moment .

[00:39:01] Georg wants to know how did Venia and Dylan get from having this very frustrated situation with SCMS talking about they need to do something, and now they have a metric in the CHAOSS project. What was this process for them? Venia responds with “Magic” and explains. Dylan gives a response as well.

[00:43:07] Dylan lets us know there’s a video to check out on sociallyconstructed.online that has tips, tricks, and tutorials.

Special Guest: Dylan Marcy.

Support CHAOSScast

Georg Link | Matt Broberg | Dawn Foster | Matt Germonprez

Linode

Welcome to the very first CHAOSS Podcast! In this podcast, we will share use cases and experiences with measuring open source community health. There will be elevating conversations about metrics, analytics, and software from the Community Health Analytics Open Source Software or CHAOSS Project. It’s new, and new is always good. And hey, it’s got that new podcast smell ☺. Since this is the first episode, we’ll be finding out more about our panelists. Kick back, relax, and take a listen.

[00:01:15] Dawn Foster has been in the industry for more than 20 years and she’s been working on Open Source software most of that time. She is currently at VMware where she is Open Source Community Strategy Lead. She started getting passionate about the open source software communities back in the early 2000’s when she was at Intel. Her interest in open source metrics really came out of feeling a need to justify her own existence.

[00:04:14] Georg Link started his open source journey with a project at openoffice.org. This experience of having a resilient healthy community that can go do its own thing fascinated him. Now he is working as Director of Sales for Bitergia, which is a company out of Spain, that provides metrics and analytics for a software development project and open source projects for the last eight years.

[00:05:44] Matt Broberg’s story with metrics is that he fell in love with community management early on. He was in tech support at a large storage vendor and in there he found out that he can build these communities of people that he truly enjoyed working with. Six years ago, he got a job focusing on open source. He fell in love with the ability for people to solve their own problem. He is currently the Technical Editor of Opensource.com. He is very excited to get this podcast off the ground!

[00:08:42] Matt Germonprez is a Professor at the University of Nebraska-Omaha in the College of Information-Science and Technology. It started for him with a class he was having with a seminar session that was on open source. He had a former student give a guest talk virtually about open source and he explained about corporate engagement with open source and it blew his mind. They both ended up writing a grant to the National Science Foundation that got funded to explore the changing nature of open source work. They worked on this project for about 5 years and they got to explore why and how companies are engaged.

[00:12:20] Matt G. tells us what the CHAOSS Project is and why it exists.

[00:14:12] Is CHAOSS an Acronym or a Backronym? It’s a great story!

[00:16:30] Dawn tells us the structure of CHAOSS and her involvement with it.

[00:19:26] Matt B. tells us what is was like to come to the CHAOSS Project and what is his experience getting engaged since he came last the project.

[00:22:12] Matt G. tells us we don’t have all the answers, but we work with anybody that wants to contribute to help find those answers of understanding community health better. Also, why did we start this podcast? Find out here ☺.

CHAOSS

Auger

Awesome Zoom Backgrounds

Interview with Jono Bacon and Jessica Deen

Chan Zuckerberg Initiative

Dawn Foster Twitter

Matt Germonprez Twitter

Georg Link Twitter

Matt Broberg Twitter

Support CHAOSScast