The DAS crew kicked off the podcast by defining hallucinations - when large language models like ChatGPT convincingly provide false information. They shared amusing anecdotes of AI assistants like Claude and Pi continuing to insist they could complete impossible tasks.

The key reasons behind hallucinations were discussed:

The hosts then covered prompt drift - when model responses veer off the initial prompt topic. Reasons discussed:

Breaking prompts into smaller, simpler pieces can help reduce drift

Continuously evaluating production prompts is key to catch drift

Consider both short term drift in conversations and long term drift in automated systems.

The overarching advice was keeping prompts simple, specific, and continuously evaluated as key to reducing harmful hallucinations and prompt drift.