The September 24 2025 paper introduces EmbeddingGemma, a novel, lightweight text embedding model developed by Google DeepMind, built upon the Gemma 3 language model family. The paper details the innovative training methodology, which involves encoder-decoder initialization and geometric embedding distillation from larger models like Gemini Embedding, alongside a "spread-out" regularizer and model souping for improved expressiveness and generalizability. Through extensive evaluation on the Massive Text Embedding Benchmark (MTEB), the 308M-parameter model is shown to achieve state-of-the-art performance among models under 500M parameters across multilingual, English, and code tasks, often rivaling models double its size, thus offering an exceptional performance-to-cost ratio suitable for low-latency, on-device applications. Ablation studies support the design choices, concluding that the encoder-decoder initialization and mean pooling provide the strongest foundation for high-quality embeddings. Source: https://arxiv.org/pdf/2509.20354