LMCacheLMCache: Supercharge Your LLM with the Fastest KV Cache Layer 11k 1.6k154 HN pointsApache-2.0 last commit 2026-06-12amdcudafastinferencekv-cachellmpytorchrocmspeedvllm Website SourceAdd to my stackDiscuss Share:AboutLMCache: Supercharge Your LLM with the Fastest KV Cache LayerLanguagesPython87.3%Go4.2%Shell2.9%C++2.2%Cuda1.2%Rust1%JavaScript0.5%HTML0.2%Makefile0.2%C0.1%CSS0.1%Dockerfile0.1%CMake0%Contributors30271247152149113937459444341393635+16FeaturesDiscussNo features listed.Comments ThemeGitHub LightGitHub Light High ContrastGitHub Light Protanopia & DeuteranopiaGitHub Light TritanopiaGitHub DarkGitHub Dark High ContrastGitHub Dark Protanopia & DeuteranopiaGitHub Dark TritanopiaGitHub Dark DimmedPreferred color schemeTransparent DarkNoBorder LightNoBorder DarkNoBorder GrayRStudio CobaltPurple DarkGruvboxGruvbox DarkGruvbox LightCatppuccin LatteCatppuccin FrappéCatppuccin MacchiatoCatppuccin MochaFroCustom (experimental)InstallpipBuild from sourceKeywordsamdcudafastinferencekv-cachellmpytorchrocmspeedvllm
![dependabot[bot]](https://avatars.githubusercontent.com/in/29110?v=4)
