These sources explore advanced techniques for accelerating Large Language Model (LLM) inference through speculative decoding, a process where smaller "draft" models predict tokens for a larger "target" model to verify in parallel. A primary focus is Multi-Draft Speculative Decoding (MDSD), which uses multiple draft sequences to increase the probability of acceptance and reduce latency. Researchers have introduced SpecHub to simplify complex optimization problems into manageable linear programming, while others utilize optimal transport theory and q-convexity to reach theoretical efficiency upper bounds. Additionally, the Hierarchical Speculative Decoding (HSD) framework stacks multiple models into a tiered structure, allowing each level to verify the one below it. Collectively, these papers provide mathematical proofs, sampling algorithms, and hierarchical strategies designed to maximize token acceptance rates and minimize computational overhead.Sources:1)January 22 2025Towards Optimal Multi-draft Speculative DecodingZhengmian Hu, Tong Zheng, Vignesh Viswanathan, Ziyi Chen, Ryan A. Rossi, Yihan Wu, Dinesh Manocha, Heng Huang.2)2024SpecHub: Provable Acceleration to Multi-Draft Speculative DecodingLehigh University, Samsung Research America, University of MarylandRyan Sun, Tianyi Zhou, Xun Chen, Lichao Sunhttps://aclanthology.org/2024.emnlp-main.1148.pdf.3)2024MULTI-DRAFT SPECULATIVE SAMPLING: CANONICAL DECOMPOSITION AND THEORETICAL LIMITSQualcomm AI Research, University of TorontoAshish Khisti, M.Reza Ebrahimi, Hassan Dbouk, Arash Behboodi, Roland Memisevic, Christos Louizoshttps://arxiv.org/pdf/2410.18234.4)2025HISPEC: HIERARCHICAL SPECULATIVE DECODING FOR LLMSThe University of Texas at AustinAvinash Kumar, Sujay Sanghavi, Poulami Dashttps://arxiv.org/pdf/2510.01336.5)2025Fast Inference via Hierarchical Speculative DecodingHarvard University, Google Research, Tel Aviv University, Google DeepMindClara Mohri, Haim Kaplan, Tal Schuster, Yishay Mansour, Amir Globersonhttps://arxiv.org/pdf/2510.19705.