Alternative to AWS SageMaker
AirLLM 70B inference with single 4GB GPU
About
AirLLM 70B inference with single 4GB GPU
Languages
Contributors9
Free alternative to AWS SageMaker
airllm is a free, open-source alternative to AWS SageMaker. Here's why:
- ⚡️ 70B LLM inference
- 💾 Only 4GB GPU VRAM
- 💻 Run on Windows, Mac, Linux
- 🤖 Llama model compatible
- ✨ Simple fine-tuning
Comments Theme
