Sign up to save your podcasts
Or
Share Unembedding Matrices as Feature Lenses for Embeddings
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Unembedding Matrices as Feature Lenses for Embeddings
This episode explores why decoder-style language models can generate fluent text yet still underperform dedicated embedding models when asked for zero-shot sentence vectors, despite embeddings being critical infrastructure for search, retrieval-augmented generation, clustering, and recommendation. It examines the paper’s main argument that the problem is not just bad pooling or prompting, but a deeper geometric bias: sentence representations appear overly aligned with frequent, low-information tokens, which becomes visible when they are projected through the model’s unembedding matrix. It also digs into the debate over whether decoder models mainly suffer from poor extraction recipes or from genuinely weaker embedding spaces, using concrete details from the authors’ code such as prompt-based summarization, last-token pooling, and custom truncation. A listener would find it interesting because the discussion connects mechanistic interpretability to real embedding-system design, and even suggests why filtering or reducing dimensions could improve both quality and efficiency.
Sources:
1. Your UnEmbedding Matrix is Secretly a Feature Lens for Text Embeddings — Songhao Wu, Zhongxin Chen, Yuxuan Liu, Heng Cui, Cong Li, Rui Yan, 2026
http://arxiv.org/abs/2606.07502
2. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks — Nils Reimers, Iryna Gurevych, 2019
https://arxiv.org/abs/1908.10084
3. BEIR: A Heterogeneous Benchmark for Zero-shot Evaluation of Information Retrieval Models — Nandan Thakur, Nils Reimers, Andreas Ruckle, Abhishek Srivastava, Iryna Gurevych, 2021
https://arxiv.org/abs/2104.08663
4. MTEB: Massive Text Embedding Benchmark — Niklas Muennighoff, Nouamane Tazi, Loic Magne, Nils Reimers, 2022
https://arxiv.org/abs/2210.07316
5. LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders — Parishad BehnamGhader, Vaibhav Adlakha, Marius Mosbach, Dzmitry Bahdanau, Nicolas Chapados, Siva Reddy, 2024
https://arxiv.org/abs/2404.05961
6. Indexing by Latent Semantic Analysis — Scott Deerwester, Susan T. Dumais, George W. Furnas, Thomas K. Landauer, Richard Harshman, 1990
https://www.cs.csustan.edu/~mmartin/LDS/Deerwester-et-al.pdf
7. All-but-the-Top: Simple and Effective Postprocessing for Word Representations — Jiaqi Mu, Suma Bhat, Pramod Viswanath, 2018
https://arxiv.org/abs/1702.01417
8. Whitening Sentence Representations for Better Semantics and Faster Retrieval — Jianlin Su, Jiarun Cao, Weijie Liu, Yangyiwen Ou, 2021
https://arxiv.org/abs/2103.15316
9. Matryoshka Representation Learning — Aditya Kusupati, Gantavya Bhatt, Aniket Rege, Matthew Wallingford, Aditya Sinha, Vivek Ramanujan, William Howard-Snyder, Kaifeng Chen, Sham Kakade, Prateek Jain, Ali Farhadi, 2022
https://arxiv.org/abs/2205.13147
10. Scaling Sentence Embeddings with Large Language Models — Ting Jiang, Shaohan Huang, Zhongzhi Luan, Deqing Wang, Fuzhen Zhuang, 2023
https://scholar.google.com/scholar?q=Scaling+Sentence+Embeddings+with+Large+Language+Models
11. Improving Text Embeddings with Large Language Models — Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei, 2024
https://scholar.google.com/scholar?q=Improving+Text+Embeddings+with+Large+Language+Models
12. Eliciting Latent Predictions from Transformers with the Tuned Lens — Nora Belrose, Zach Furman, Logan Smith, Danny Halawi, Igor Ostrovsky, Lev McKinney, Stella Biderman, Jacob Steinhardt, 2023
https://scholar.google.com/scholar?q=Eliciting+Latent+Predictions+from+Transformers+with+the+Tuned+Lens
13. Ditto: A Simple and Efficient Approach to Improve Sentence Embeddings — Qian Chen, Wen Wang, Qinglin Zhang, Siqi Zheng, Chong Deng, Hai Yu, Jiaqing Liu, Yukun Ma, Chong Zhang, 2023
https://scholar.google.com/scholar?q=Ditto%3A+A+Simple+and+Efficient+Approach+to+Improve+Sentence+Embeddings
14. Is anisotropy really the cause of BERT embeddings not being semantic? — Alejandro Fuster Baggetto, Victor Fresno, 2022
https://scholar.google.com/scholar?q=Is+anisotropy+really+the+cause+of+BERT+embeddings+not+being+semantic%3F
15. Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing — Richard Diehl Martinez et al., 2024
https://arxiv.org/abs/2410.11462
16. Anisotropy Is Inherent to Self-Attention in Transformers — Nathan Godey, Eric de la Clergerie, Benoit Sagot, 2024
https://arxiv.org/abs/2401.12143
17. Indic-TunedLens: Interpreting Multilingual Models in Indian Languages — Mihir Panchal et al., 2026
https://arxiv.org/abs/2602.15038
18. KV-Embedding: Training-free Text Embedding via Internal KV Re-routing in Decoder-only LLMs — Yixuan Tang, Yi Yang, 2026
https://arxiv.org/abs/2601.01046
19. Causal2Vec: Improving Decoder-only LLMs as Embedding Models through a Contextual Token — Ailiang Lin et al., 2025
https://arxiv.org/abs/2507.23386
20. On the Theoretical Limitations of Embedding-Based Retrieval — Orion Weller et al., 2025
https://arxiv.org/abs/2508.21038
21. AI Post Transformers: Why Transformers Fail at Counting — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-05-08-why-transformers-fail-at-counting-137924.mp3
22. AI Post Transformers: Neural Chameleons and Evading Activation Monitors — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-04-14-neural-chameleons-and-evading-activation-bc470e.mp3
23. AI Post Transformers: TurboQuant: Online Vector Quantization with Near-optimal Distortion Rate — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-03-25-turboquant-online-vector-quantiz-1967b7.mp3
Interactive Visualization: Unembedding Matrices as Feature Lenses for Embeddings
View all episodes
By mcgrofThis episode explores why decoder-style language models can generate fluent text yet still underperform dedicated embedding models when asked for zero-shot sentence vectors, despite embeddings being critical infrastructure for search, retrieval-augmented generation, clustering, and recommendation. It examines the paper’s main argument that the problem is not just bad pooling or prompting, but a deeper geometric bias: sentence representations appear overly aligned with frequent, low-information tokens, which becomes visible when they are projected through the model’s unembedding matrix. It also digs into the debate over whether decoder models mainly suffer from poor extraction recipes or from genuinely weaker embedding spaces, using concrete details from the authors’ code such as prompt-based summarization, last-token pooling, and custom truncation. A listener would find it interesting because the discussion connects mechanistic interpretability to real embedding-system design, and even suggests why filtering or reducing dimensions could improve both quality and efficiency.
Sources:
1. Your UnEmbedding Matrix is Secretly a Feature Lens for Text Embeddings — Songhao Wu, Zhongxin Chen, Yuxuan Liu, Heng Cui, Cong Li, Rui Yan, 2026
http://arxiv.org/abs/2606.07502
2. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks — Nils Reimers, Iryna Gurevych, 2019
https://arxiv.org/abs/1908.10084
3. BEIR: A Heterogeneous Benchmark for Zero-shot Evaluation of Information Retrieval Models — Nandan Thakur, Nils Reimers, Andreas Ruckle, Abhishek Srivastava, Iryna Gurevych, 2021
https://arxiv.org/abs/2104.08663
4. MTEB: Massive Text Embedding Benchmark — Niklas Muennighoff, Nouamane Tazi, Loic Magne, Nils Reimers, 2022
https://arxiv.org/abs/2210.07316
5. LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders — Parishad BehnamGhader, Vaibhav Adlakha, Marius Mosbach, Dzmitry Bahdanau, Nicolas Chapados, Siva Reddy, 2024
https://arxiv.org/abs/2404.05961
6. Indexing by Latent Semantic Analysis — Scott Deerwester, Susan T. Dumais, George W. Furnas, Thomas K. Landauer, Richard Harshman, 1990
https://www.cs.csustan.edu/~mmartin/LDS/Deerwester-et-al.pdf
7. All-but-the-Top: Simple and Effective Postprocessing for Word Representations — Jiaqi Mu, Suma Bhat, Pramod Viswanath, 2018
https://arxiv.org/abs/1702.01417
8. Whitening Sentence Representations for Better Semantics and Faster Retrieval — Jianlin Su, Jiarun Cao, Weijie Liu, Yangyiwen Ou, 2021
https://arxiv.org/abs/2103.15316
9. Matryoshka Representation Learning — Aditya Kusupati, Gantavya Bhatt, Aniket Rege, Matthew Wallingford, Aditya Sinha, Vivek Ramanujan, William Howard-Snyder, Kaifeng Chen, Sham Kakade, Prateek Jain, Ali Farhadi, 2022
https://arxiv.org/abs/2205.13147
10. Scaling Sentence Embeddings with Large Language Models — Ting Jiang, Shaohan Huang, Zhongzhi Luan, Deqing Wang, Fuzhen Zhuang, 2023
https://scholar.google.com/scholar?q=Scaling+Sentence+Embeddings+with+Large+Language+Models
11. Improving Text Embeddings with Large Language Models — Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei, 2024
https://scholar.google.com/scholar?q=Improving+Text+Embeddings+with+Large+Language+Models
12. Eliciting Latent Predictions from Transformers with the Tuned Lens — Nora Belrose, Zach Furman, Logan Smith, Danny Halawi, Igor Ostrovsky, Lev McKinney, Stella Biderman, Jacob Steinhardt, 2023
https://scholar.google.com/scholar?q=Eliciting+Latent+Predictions+from+Transformers+with+the+Tuned+Lens
13. Ditto: A Simple and Efficient Approach to Improve Sentence Embeddings — Qian Chen, Wen Wang, Qinglin Zhang, Siqi Zheng, Chong Deng, Hai Yu, Jiaqing Liu, Yukun Ma, Chong Zhang, 2023
https://scholar.google.com/scholar?q=Ditto%3A+A+Simple+and+Efficient+Approach+to+Improve+Sentence+Embeddings
14. Is anisotropy really the cause of BERT embeddings not being semantic? — Alejandro Fuster Baggetto, Victor Fresno, 2022
https://scholar.google.com/scholar?q=Is+anisotropy+really+the+cause+of+BERT+embeddings+not+being+semantic%3F
15. Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing — Richard Diehl Martinez et al., 2024
https://arxiv.org/abs/2410.11462
16. Anisotropy Is Inherent to Self-Attention in Transformers — Nathan Godey, Eric de la Clergerie, Benoit Sagot, 2024
https://arxiv.org/abs/2401.12143
17. Indic-TunedLens: Interpreting Multilingual Models in Indian Languages — Mihir Panchal et al., 2026
https://arxiv.org/abs/2602.15038
18. KV-Embedding: Training-free Text Embedding via Internal KV Re-routing in Decoder-only LLMs — Yixuan Tang, Yi Yang, 2026
https://arxiv.org/abs/2601.01046
19. Causal2Vec: Improving Decoder-only LLMs as Embedding Models through a Contextual Token — Ailiang Lin et al., 2025
https://arxiv.org/abs/2507.23386
20. On the Theoretical Limitations of Embedding-Based Retrieval — Orion Weller et al., 2025
https://arxiv.org/abs/2508.21038
21. AI Post Transformers: Why Transformers Fail at Counting — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-05-08-why-transformers-fail-at-counting-137924.mp3
22. AI Post Transformers: Neural Chameleons and Evading Activation Monitors — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-04-14-neural-chameleons-and-evading-activation-bc470e.mp3
23. AI Post Transformers: TurboQuant: Online Vector Quantization with Near-optimal Distortion Rate — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-03-25-turboquant-online-vector-quantiz-1967b7.mp3
Interactive Visualization: Unembedding Matrices as Feature Lenses for Embeddings