llama.cpp-adaptive-kv-streamingLLM inference in C/C++ 106 125 HN pointsMIT last commit 2026-08-29 Website SourceAdd to my stackDiscuss Share:AboutLLM inference in C/C++LanguagesC++55.6%C15.7%Python7.2%Cuda5.8%TypeScript4.3%Svelte2.3%HTML2.2%Metal1.4%Jinja1.2%GLSL1%CMake0.8%Shell0.7%WGSL0.6%Go Template0.6%Objective-C0.3%CSS0.1%Nix0.1%Dockerfile0.1%JavaScript0.1%MDX0%SCSS0%Assembly0%Makefile0%Batchfile0%PowerShell0%Linker Script0%Contributors301882552391362321301268148146143121116101100+16FeaturesDiscussNo features listed.Comments ThemeGitHub LightGitHub Light High ContrastGitHub Light Protanopia & DeuteranopiaGitHub Light TritanopiaGitHub DarkGitHub Dark High ContrastGitHub Dark Protanopia & DeuteranopiaGitHub Dark TritanopiaGitHub Dark DimmedPreferred color schemeTransparent DarkNoBorder LightNoBorder DarkNoBorder GrayRStudio CobaltPurple DarkGruvboxGruvbox DarkGruvbox LightCatppuccin LatteCatppuccin FrappéCatppuccin MacchiatoCatppuccin MochaFroCustom (experimental)InstallpipBuild from sourceNix
