Azure & DevOps Podcast

Per Kops: Architecture of Ollama and Local LLMs - Episode 342


Listen Later

Per is an experienced software architect and developer with more than 19 years of experience in designing, developing, and testing software. He is currently serving as a Distinguished software developer at Delegate, a Microsoft Partner in Denmark.

 

Topics of Discussion:

[3:02] More about Per’s background in nearly two decades in .NET and Azure consulting.

[6:11] The concept of a boutique consultant.

[7:00] Founding ATC-Net to share common .NET libraries and avoid duplicative coding.

[10:02] Building trust with customers by open-sourcing “generic” components.

[11:50] Creating a connector to run Olama (local LLMs) with Semantic Kernel.

[20:08] Why Per “fell in love” with Semantic Kernel’s abstraction layers and extension possibilities.

[21:44] The role of vector stores (like Azure Cognitive Search) in retrieval-augmented generation.

[24:33] What do we mean by “vector” in the AI space?

[26:39] What is a “text chunker”?

[31:43] Azure AI search.

[34:07] Finding the right tool for the right task.

 

Mentioned in this Episode:

Clear Measure Way

Architect Forum

Software Engineer Forum

Programming with Palermo — New Video Podcast! Email us at [email protected].

Clear Measure, Inc. (Sponsor)

.NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo

atc-net GitHub

Per Kops LinkedIn

Per Kops GitHub

 

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

...more
View all episodesView all episodes
Download on the App Store

Azure & DevOps PodcastBy Jeffrey Palermo

  • 4.5
  • 4.5
  • 4.5
  • 4.5
  • 4.5

4.5

20 ratings


More shows like Azure & DevOps Podcast

View all
Hanselminutes with Scott Hanselman by Scott Hanselman

Hanselminutes with Scott Hanselman

379 Listeners

Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

Software Engineering Radio - the podcast for professional software developers

263 Listeners

.NET Rocks! by Carl Franklin and Richard Campbell

.NET Rocks!

245 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

285 Listeners

The Cloudcast by Massive Studios

The Cloudcast

153 Listeners

Thoughtworks Technology Podcast by Thoughtworks

Thoughtworks Technology Podcast

43 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

585 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

629 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

200 Listeners

Data Engineering Podcast by Tobias Macey

Data Engineering Podcast

140 Listeners

Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

Syntax - Tasty Web Development Treats

987 Listeners

Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

Kubernetes Podcast from Google

184 Listeners

The Stack Overflow Podcast by The Stack Overflow Podcast

The Stack Overflow Podcast

63 Listeners

The Real Python Podcast by Real Python

The Real Python Podcast

137 Listeners

The Pragmatic Engineer by Gergely Orosz

The Pragmatic Engineer

47 Listeners