High-temperature Text-Generation and Etical AI Alignment.
Democratizing local inference: reducing hardware requirements. Against the oligopoly of huge and polluting LLMs.
π We provide **free** hardware to quantize models at the [Intel Low Bit Open LLM Leaderboard](Intel/low_bit_open_llm_leaderboard), currently supporting Pure RTN mode powered by AutoRound
Weβre excited to announce that Unsloth has joined the PyTorch Ecosystem! π₯π¦₯
Unsloth is an open-source project that makes training & running models more accurate and faster with less compute. Our mission is to make local AI accessible to everyone. Thanks to all of you for making this possible! π
π§ͺ Running an eval that executes model-generated C on a few thousand prompts? You probably don't want any of that on your laptop. Just shipped hf-sandbox, a Modal-style sandbox API on top of Hugging Face Jobs. Spin up an isolated, ephemeral container, run untrusted code, get the result back. No Docker on your laptop, no infra to manage.