Alternative to AWS SageMaker
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
About
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
Languages
Contributors30
Free alternative to AWS SageMaker
Model-Optimizer is a free, open-source alternative to AWS SageMaker. Here's why:
- ✨ Model Quantization
- 🧠 Knowledge Distillation
- ✂️ Model Pruning
- 🔍 Neural Architecture Search
- ⚡️ Inference Speed Boost
Comments Theme
Install
pip
