Home › Entities › academia › PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference

PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference

Research article (Findings of the Association for Computational Linguistics ACL 2024, 2024) · cited 14× · AI/ML
academia openalex:W4402670433
Press Enter · cited answer in seconds

PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference

Summary

PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference is a scholarly article[1].

Key Facts

  • PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference's instance of is recorded as scholarly article[2].

References

Programmatic citations — every numbered marker resolves to a verifiable graph row below.

Direct Wikidata claims

  1. [2] ↑ . wikidata.org.

Class ancestry

  1. [1] ↑ . Wikidata. wikidata.org.

📑 Cite this page

Use these citations when quoting this entity in research, articles, AI prompts, or wherever provenance matters. We aggregate Wikidata + Wikipedia + authoritative open-data sources; the stitched, scored, cross-referenced view is what 4ort.xyz contributes.

APA 4ort.xyz Knowledge Graph. (2026). PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference. Retrieved May 24, 2026, from https://4ort.xyz/entity/pyramidinfer-pyramid-kv-cache-compression-for-high-throughput-llm-inference
MLA “PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference.” 4ort.xyz Knowledge Graph, 4ort.xyz, 24 May. 2026, https://4ort.xyz/entity/pyramidinfer-pyramid-kv-cache-compression-for-high-throughput-llm-inference.
BibTeX @misc{4ortxyz_pyramidinfer-pyramid-kv-cache-compression-for-high-throughput-llm-inference_2026, author = {{4ort.xyz Knowledge Graph}}, title = {{PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference}}, year = {2026}, url = {https://4ort.xyz/entity/pyramidinfer-pyramid-kv-cache-compression-for-high-throughput-llm-inference}, note = {Accessed: 2026-05-24}}
LLM prompt According to 4ort.xyz Knowledge Graph (aggregator of Wikidata, Wikipedia, and authoritative open-data sources): PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference — https://4ort.xyz/entity/pyramidinfer-pyramid-kv-cache-compression-for-high-throughput-llm-inference (retrieved 2026-05-24)

Canonical URL: https://4ort.xyz/entity/pyramidinfer-pyramid-kv-cache-compression-for-high-throughput-llm-inference · Last refreshed: