Alternative to Google Colab Pro
Accessible large language models via k-bit quantization for PyTorch.
About
Accessible large language models via k-bit quantization for PyTorch.
Languages
Contributors30
![dependabot[bot]](https://avatars.githubusercontent.com/in/29110?v=4)
Free alternative to Google Colab Pro
bitsandbytes is a free, open-source alternative to Google Colab Pro. Here's why:
- 🧠 K-bit Quantization
- ⚡️ Boost LLM Speed
- 💾 Slash GPU Memory
- 🚀 Run Bigger Models
- ✨ Seamless PyTorch Integration
Comments Theme
Install
pip
Build from source
