Gruber's picture

1 156

Gruber

gruber

·

gruberdev

AI & ML interests

None yet

Recent Activity

liked a model about 2 months ago

distil-whisper/distil-large-v3.5

reacted to danielhanchen's post with 🚀 2 months ago

You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: https://huggingface.co/unsloth/Kimi-K2-Thinking-GGUF We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference. We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰 Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally

reacted to danielhanchen's post with 🔥 2 months ago

You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: https://huggingface.co/unsloth/Kimi-K2-Thinking-GGUF We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference. We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰 Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally

View all activity

Organizations

None yet

liked a model about 2 months ago

distil-whisper/distil-large-v3.5

Automatic Speech Recognition • 0.8B • Updated Mar 25, 2025 • 6.49k • 77

reacted to danielhanchen's post with 🚀🔥❤️ 2 months ago

Post

4419

You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: unsloth/Kimi-K2-Thinking-GGUF

We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.

We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰

Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally

liked 2 models 4 months ago

nari-labs/Dia-1.6B

Text-to-Speech • Updated Jun 1, 2025 • 74.3k • • 2.82k

LLM360/K2-Think

Text Generation • 33B • Updated Nov 19, 2025 • 227 • 365

liked 2 models 7 months ago

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6, 2025 • 190k • 96

microsoft/OmniParser

Image-Text-to-Text • Updated Dec 2, 2024 • 357 • 1.7k

liked a Space 8 months ago

Whisper

Transcribe audio files or YouTube videos into text

liked a model 8 months ago

Zyphra/Zonos-v0.1-hybrid

Text-to-Speech • Updated Jun 3, 2025 • 6.7k • 1.1k

liked a model 9 months ago

futo-org/acft-whisper-small

Automatic Speech Recognition • 0.3B • Updated Jun 25, 2024 • 6 • 4

upvoted a collection 9 months ago

Whisper ACFT

https://github.com/futo-org/whisper-acft • 6 items • Updated Jun 26, 2024 • 7

liked a Space 10 months ago

Whisper Turbo

Transcribe audio or YouTube videos into text

liked 3 models 11 months ago

perplexity-ai/r1-1776

Text Generation • 671B • Updated Feb 26, 2025 • 321 • 2.33k

uncensoredai/UncensoredLM-DeepSeek-R1-Distill-Qwen-14B

14B • Updated Feb 2, 2025 • 8 • 28

deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

Text Generation • 33B • Updated Feb 24, 2025 • 2.35M • • 1.49k

liked a Space 11 months ago

GPU Poor LLM Arena

Compact LLM Battle Arena: Frugal AI Face-Off!

liked a dataset 11 months ago

unalignment/toxic-dpo-v0.1

Viewer • Updated Dec 26, 2023 • 302 • 25 • 137

liked a Space 12 months ago

Chat With Janus-Pro-7B

A unified multimodal understanding and generation model.

liked a model 12 months ago

lmstudio-community/DeepSeek-R1-Distill-Qwen-14B-GGUF

Text Generation • 15B • Updated Jan 20, 2025 • 4.51k • 38