September 14, 2023

Podcast #122: Navigating The AI Landscape: Real-World Insights And Challenges

51 minutes

This week Brian sits down with our own AI expert, Jordan Ranous, to discuss and speculate on the challenges facing enterprises and small businesses as they try to get a grip on the hot topic of the decade, Artificial Intelligence. If you have been following StorageReview, then you are aware of some of the tests, reviews, and trials we have been exploring in our lab. Jordan is engaged in almost all AI content posted on our site.

Jordan is an experienced AI technologist with a background working with financial institutions. Brian always offers his guests some tough questions, and Jordan gets the same treatment. AI is such a hot topic, and the buzz in the industry just keeps getting louder, generating more questions than answers. Jordan has a rare talent of being an expert in AI and being able to articulate answers that can be easily understood.

This is the first podcast that we’re actually integrating live with our Discord community so they can interact and ask questions on topics we are hitting at that moment.

If it’s AI-related, Brian and Jordan talk about it. It is certainly worth watching the podcast in its entirety, but if you would like to hop around, we have the time-stamped transcript below.

Join the Discord to participate in future pods in real-time.

00:00 Introduction

Setting the stage for the live event

Invited the StorageReveiw Discord community

Exploring AI in the lab

Hands-on

Recapping Flash Memory Summit (FMS

AI Vision Demo

SR Sloths stole the show

AI does not have a universal definition

Generative AI tools

ChatGPT

Dall-E

Generative AI vs AGI (artificial general intelligence)

Computer Vision

A subset of broader AI

Object recognition

Image Datasets

05:00 Finetuning the model

Business Intelligence

Categorizing images

Identifying brands rather than just shapes

Self-checkout

Loss Prevention

Creating the Datasets

Training data

Install disparity between enterprise and small retail shops

Tools for AI

Leveraging the right tools for the job

Implementation challenges

Creating chatbots for various industries

10:00 Chatbots for customer service

Chatbot is programmed to fix the problem, not initiate transferring the call

Pressing zero doesn’t do anything

Creating higher frustration for customers

Catching AI doing something it shouldn’t

AI has the potential to hyperextend in any direction

Keep an eye on your AI model to keep it honest and focused

Quality data means quality results

15:00 Security is paramount

Inherent biases in AI

Training data collection is critical

Gather a diverse group to build the training data

Proper finetuning

Be careful of the persona you create

Doom server demo

AI’s talking trash

AI gamers fighting each other and making disparaging jokes

AI understood the assignment and acted upon it

Ethics

Enterprises might be reluctant to provide too much information

Know where it should go

And where it might go

The fear of the unknown

20:00 Active Directory for access levels

Keeping data secure and available to appropriate teams

Call centers probably do not need access to proprietary marketing material

NeMo Guardrails

How questions are asked or how to prompt the question

Hiring Prompt Engineers

Support tools

Democratizing the toolset

25:00 What’s the on-ramp for small businesses

Set up internally

Create solid prompts

Do the simple stuff first

Ease into the technology

Understand how it works

Understand limitations

Use an AI model to analyze CRM data

Help with sales forecasts

Analyzing the sales funnel

Use built-in tools

Not every business needs a custom model

30:00 What’s a good starting point

Fund IT for AI APIs

Consume available tools

Employ a paid version of ChatGPT4

Monitor billing

API provides additional freedom

35:00 What about the hardware

Workstations with GPUs

Keep GPUs busy

Parallelize

Rack space consideration

Liquid or Air cooled

TBs of storage

GPUs take slots that might have been used for storage

How much power can a rack support

40:00 Dell’s latest CPU servers

Fast, shared storage

Software

SSDs

E1.S

Inferencing cards

Ultra-high-speed servers and workstations

45:00 Where cloud can benefit AI

OVH

Cloud is a valuable resource

Hourly billing

50:00 Wrap-up

<span data-mce-type="bookmark" style="display: inline-block; width: 0px; overflow: hidden; line-height: 0;" class="mce_SELRES_start"></span> Podcast video

StorageReview Discord

Dell XE9680 Review

Subscribe to our podcast:

iTunes

Spotify

Google Play

Engage with StorageReview

The post Podcast #122: Navigating The AI Landscape: Real-World Insights And Challenges appeared first on StorageReview.com.

...more

View all episodes

By StorageReview.com

4.3

1010 ratings