llama.cpp-adaptive-kv-streamingLLM inference in C/C++ 395 44MIT last commit 2026-08-29 Website SourceAdd to my stackDiscuss Share:AboutLLM inference in C/C++LanguagesC++58%C14.7%Python6.8%Cuda5.7%TypeScript4%Svelte2.1%HTML2%Metal1.3%Jinja1.1%GLSL0.9%CMake0.8%Shell0.7%WGSL0.6%Go Template0.6%Objective-C0.3%CSS0.1%Nix0.1%Dockerfile0.1%JavaScript0.1%MDX0%SCSS0%Assembly0%Makefile0%Batchfile0%PowerShell0%Linker Script0%Contributors301882552391362321301268148146143136121116101+16FeaturesDiscussNo features listed.Comments ThemeGitHub LightGitHub Light High ContrastGitHub Light Protanopia & DeuteranopiaGitHub Light TritanopiaGitHub DarkGitHub Dark High ContrastGitHub Dark Protanopia & DeuteranopiaGitHub Dark TritanopiaGitHub Dark DimmedPreferred color schemeTransparent DarkNoBorder LightNoBorder DarkNoBorder GrayRStudio CobaltPurple DarkGruvboxGruvbox DarkGruvbox LightCatppuccin LatteCatppuccin FrappéCatppuccin MacchiatoCatppuccin MochaFroCustom (experimental)InstallpipBuild from sourceNix