With the lack of transparency in Apple's review, an ethical benchmark of Apple Intelligence against rivals like Gemini and ChatGPT reveals key weaknesses in handling misinformation and a notable potential for real-world bias.

As Apple Intelligence becomes deeply integrated into everyday computing, a comprehensive, transparent ethical evaluation of its foundation model is necessary. While Apple has published their own review, it lacks transparency and fails to address critical ethical considerations.

To fill this gap, this talk systematically benchmarks Apple Intelligence against leading AI models including Google Gemini, OpenAI ChatGPT, and DeepSeek across multiple ethical dimensions. We see significant variations in content moderation approaches; from ChatGPT's strict moral filters to DeepSeek's political content suppression; and uncover where Apple's model stands in this landscape.

The presentation reveals how Apple Intelligence fails catastrophically in the domain of misinformation compared to the other models, while also demonstrating concerning potential for bias in real-world applications when asking the model through a direct conversational agent.

And, as a little treat, we will take a short look at how Apple’s image generation measures up in these ethical evaluations as well.

https://creativecommons.org/licenses/by-sa/4.0/

about this event: https://talks.mrmcd.net/2025/talk/E8DZPF/