# SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification

> Research article (Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3, 2024) · cited 72× · AI/ML

**Wikidata**: [openalex:W4395112660](https://www.wikidata.org/wiki/openalex:W4395112660)  
**Source**: https://4ort.xyz/entity/specinfer-accelerating-large-language-model-serving-with-tree-based-speculative-inference-and-verification