Lunchtime BABLing with Dr. Shea Brown

We welcomed back AI auditor and consultant Jiahao Chen to discuss all things responsible AI!

Check out Jiahao at: https://responsibleai.tech/ Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!

In this episode Shea reviews the new rules for NYC's Local Law No. 144, which requires bias audits of automated employment decision tools.

The date for enforcement has been pushed back to July 5th, 2023 to give time for companies to seek independent auditors (which is still a requirement).

Sign up for our new "AI & Algorithm Auditor Certification Program" starting May 8th!

https://courses.babl.ai/p/ai-and-algorithm-auditor-certification?affcode=616760_7ts3gujl Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!

This week on Lunchtime BABLing, we discuss:

1: The power, hype, and dangers of large language models like ChatGPT.

2: The recent open letter asking for a moratorium on AI research.

3: In context learning of large language models the problems for auditing.

4: NIST's AI Risk Management Framework and its influence on public policy like California's ASSEMBLY BILL NO. 331.

5: Updates on The Algorithmic Bias Lab's new training program for AI auditors.

https://babl.ai

https://courses.babl.ai/?affcode=616760_7ts3gujl Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!

This week we discuss our recent report "The Current State of AI Governance", which is the culmination of a year-long research project looking into the effectiveness of AI governance controls.

Full report here: https://babl.ai/wp-content/uploads/2023/03/AI-Governance-Report.pdf

We also discuss our new training program, the "AI & Algorithm Auditor Certificate Program", which starts in May 2023. This program has courses and certifications in 5 key areas necessary for AI auditing and Responsible AI in general:

1: Algorithms, AI, & Machine Learning

2: Algorithmic Risk & Impact Assessments

3: AI Governance & Risk Management

4: Bias, Accuracy, & the Statistics of AI Testing

5: Algorithm Auditing & Assurance

Early pricing can be found here: https://courses.babl.ai/?affcode=616760_7ts3gujl

BABL AI: https://babl.ai Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!

On this week's Lunchtime BABLing (#19) we talk with Jiahao Chen; data scientist, researcher, and founder of Responsible Artificial Intelligence LLC.

We discuss the evolving debate around large language models (LLMs) and their derivatives (ChatGPT, Bard, Bing AI Chatbot, etc.), including:

1: Do systems like ChatGPT reason?

2: How do businesses know whether LLMs are useful (and safe) for them to use in a product or business process?

3: What kinds of gaurdrails are needed for the ethical use of LLMs (includes pompt engineering).

4: Black-box vs. Whitebox testing of LLMs for algorithm auditing.

5: Classical assessments of intelligence and their applicability to LLMs.

6: Re-thinking education and assessment in the age of AI.

Jiahao Chen Twitter: https://twitter.com/acidflask

Responsible AI LLC: https://responsibleai.tech/ Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!

You need way more than "five skills" to be an AI auditor, but there are five areas of study that auditors need basic competency in if they want to do the kinds of audits that BABL AI performs.

This is part of our weekly webinar/podcast that went very long so we've cut out a lot of the Q&A, which covered a lot of questions that we'll address in future videos, like:

What kind of training do I need to become an AI or algorithm auditor?

Do I need technical knowledge of machine learning to do AI ethics? Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!

On this week's Lunchtime BABLing, Shea goes over the difference between a direct engagement audit vs. an attestation engagement audit and give examples from our criteria-based attestation audit for NYC Local Law No. 144. Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!

In this Q&A session, Shea talks about strategies for applying the skills you already have to the emerging field of AI ethics, governance, and policy consulting? This is a follow-up to our first webinar on the topic. Questions include:

1. Do I need an advanced degree to work in responsible AI?

2. How do I know what topics to focus on?

3. Do I need programming skills to work in responsible AI?

4. Where can I find training in AI ethics? Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!

In this episode of Lunchtime BABLing, we discuss the emergence of new standards for AI Risk Management, as well as regulatory requirements involving AI risk management, including:

1: NIST AI Risk Management Framework

2: ISO/IEC 23894:2023 - Information technology — Artificial intelligence — Guidance on risk management

3: Colorados SB21-169 - Protecting Consumers from Unfair Discrimination in Insurance Practices

4: Risk Management in the [EU] Artificial Intelligence Act

5: BABL AI Cheat Sheet on AI Governance Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!

Today on Lunchtime BABLing, Shea talks with the Chief Data Science Officer at Harver, Dr. Frida Polli. Prior to being at Harver, Frida was the founder and CEO of pymetrics; we talk about:

✅ How AI is being used in hiring,

✅ What it takes to use it responsibly,

✅ Her own journey through this space, and

✅ Reflections on upcoming regulations, including the recent New York City Local Law 144 and the EU AI Act.

Frida: https://www.linkedin.com/in/frida-polli-phd-03a1855/

Harver: https://harver.com/ Check out the babl.ai website for more stuff on AI Governance and

Responsible AI!