Keyword Tag
model-serving
Curated open-source repositories matching the tag/keyword "model-serving".
2 projects found
openlake
openlake-project/openlakeOpenLake is a high performance storage engine for efficient LLM inference and GPU Training
HARTOS
hertz-ai/HARTOSAn AI-native OS. Models run on your own hardware, nodes federate peer-to-peer with no broker, and the API is OpenAI-compatible. Boots, has its own Wayland compositor, and runs on 8GB. Apache 2.0.
