(some buggy audio in this one, from MoE rather than Mixtral lol)
Mixtral: The best open model, MoE trade-offs, release lessons, Mistral raises $400mil, Google's loss, vibes vs marketing
We have an amazing open mixture of experts model for the holidays!

Full post: https://www.interconnects.ai/p/mixtral

Direct vs. RL methods for preferences, more RLHF models, and hard truths in open RLHF work. We have more questions than answers.
Read the full post here. 

Synthetic data is the accelerator of the next phase of AI — what it is and what it means.

For the post, see it here: https://www.interconnects.ai/p/llm-synthetic-data