Azure & DevOps Podcast

Per Kops: Architecture of Ollama and Local LLMs - Episode 342


Listen Later

Per is an experienced software architect and developer with more than 19 years of experience in designing, developing, and testing software. He is currently serving as a Distinguished software developer at Delegate, a Microsoft Partner in Denmark.

 

Topics of Discussion:

[3:02] More about Per’s background in nearly two decades in .NET and Azure consulting.

[6:11] The concept of a boutique consultant.

[7:00] Founding ATC-Net to share common .NET libraries and avoid duplicative coding.

[10:02] Building trust with customers by open-sourcing “generic” components.

[11:50] Creating a connector to run Olama (local LLMs) with Semantic Kernel.

[20:08] Why Per “fell in love” with Semantic Kernel’s abstraction layers and extension possibilities.

[21:44] The role of vector stores (like Azure Cognitive Search) in retrieval-augmented generation.

[24:33] What do we mean by “vector” in the AI space?

[26:39] What is a “text chunker”?

[31:43] Azure AI search.

[34:07] Finding the right tool for the right task.

 

Mentioned in this Episode:

Clear Measure Way

Architect Forum

Software Engineer Forum

Programming with Palermo — New Video Podcast! Email us at [email protected].

Clear Measure, Inc. (Sponsor)

.NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo

atc-net GitHub

Per Kops LinkedIn

Per Kops GitHub

 

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

...more
View all episodesView all episodes
Download on the App Store

Azure & DevOps PodcastBy Jeffrey Palermo

  • 4.6
  • 4.6
  • 4.6
  • 4.6
  • 4.6

4.6

22 ratings


More shows like Azure & DevOps Podcast

View all
Software Engineering Radio by se-radio@computer.org

Software Engineering Radio

271 Listeners

Hanselminutes with Scott Hanselman by Scott Hanselman

Hanselminutes with Scott Hanselman

379 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

291 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

624 Listeners

Risky Business by Patrick Gray

Risky Business

373 Listeners

The Cloudcast by Massive Studios

The Cloudcast

155 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

588 Listeners

Python Bytes by Michael Kennedy and Brian Okken

Python Bytes

214 Listeners

Data Engineering Podcast by Tobias Macey

Data Engineering Podcast

146 Listeners

Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

Syntax - Tasty Web Development Treats

984 Listeners

Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

Kubernetes Podcast from Google

182 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

203 Listeners

.NET Rocks! by Carl Franklin and Richard Campbell

.NET Rocks!

245 Listeners

The Stack Overflow Podcast by The Stack Overflow Podcast

The Stack Overflow Podcast

62 Listeners

The Real Python Podcast by Real Python

The Real Python Podcast

142 Listeners