Instructions to use BasedAGI/Skyfall-36B-V2-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use BasedAGI/Skyfall-36B-V2-i1-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M
Use Docker
docker model run hf.co/BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use BasedAGI/Skyfall-36B-V2-i1-GGUF with Ollama:
ollama run hf.co/BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use BasedAGI/Skyfall-36B-V2-i1-GGUF with Docker Model Runner:
docker model run hf.co/BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M
- Lemonade
How to use BasedAGI/Skyfall-36B-V2-i1-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull BasedAGI/Skyfall-36B-V2-i1-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Skyfall-36B-V2-i1-GGUF-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
-
Update README.md
Verified signature827c9d9
-
Delete skyfall-36b-v2-i1-Q6_K.gguf
Verified signature90dae76 -
Upload folder using huggingface_hub
Verified signature325c761 -
Upload folder using huggingface_hub
Verified signature79b1cc1 -
Upload folder using huggingface_hub
Verified signaturecd84ac4 -
Upload folder using huggingface_hub
Verified signature02b1bdf -
Upload folder using huggingface_hub
Verified signaturea987a7e -
Upload folder using huggingface_hub
Verified signaturec56eb6e -
Upload folder using huggingface_hub
Verified signatureb80f7a2 -
Upload folder using huggingface_hub
Verified signature7b6f613 -
Upload folder using huggingface_hub
Verified signature1b7b1b9 -
Upload folder using huggingface_hub
Verified signature11dd155 -
Upload folder using huggingface_hub
Verified signature2e6bad4 -
Upload folder using huggingface_hub
Verified signature9a13795 -
Upload folder using huggingface_hub
Verified signature1ffa1ff -
Upload folder using huggingface_hub
Verified signaturebbfd0b6 -
Upload folder using huggingface_hub
Verified signature4a70507 -
Upload folder using huggingface_hub
Verified signatured65ec0e -
Upload folder using huggingface_hub
Verified signature6c2714a -
Upload folder using huggingface_hub
Verified signature2629be5 -
Upload folder using huggingface_hub
Verified signaturee1b1000 -
Upload folder using huggingface_hub
Verified signature2d568f3 -
Upload folder using huggingface_hub
Verified signaturea98748f -
Upload folder using huggingface_hub
Verified signatureaa5dd0d -
Upload folder using huggingface_hub
Verified signatureca388d0 -
Upload folder using huggingface_hub
Verified signature65df351 -
Upload folder using huggingface_hub
Verified signature73aa601 -
Upload folder using huggingface_hub
Verified signatureb68eaea -
Upload folder using huggingface_hub
Verified signaturedb366ff -
Upload folder using huggingface_hub
Verified signature6b2aa2b
-
Upload folder using huggingface_hub
Verified signature993e5ce -
Upload folder using huggingface_hub
Verified signaturefcb39a9 -
Upload folder using huggingface_hub
Verified signature794e4f3 -
Upload folder using huggingface_hub
Verified signature90854ea -
Upload folder using huggingface_hub
Verified signature21760be -
Upload folder using huggingface_hub
Verified signature4778693 -
Upload folder using huggingface_hub
Verified signature6c8700c -
Upload folder using huggingface_hub
Verified signatureda2feb6 -
Upload folder using huggingface_hub
Verified signature8f41cfa -
Upload folder using huggingface_hub
Verified signature41f513d -
Upload folder using huggingface_hub
Verified signature0ad3e73 -
Upload folder using huggingface_hub
Verified signature991a8fe -
Upload folder using huggingface_hub
Verified signature4e996ae -
Upload folder using huggingface_hub
Verified signature7e453a9 -
Upload folder using huggingface_hub
Verified signature3ee9c3c -
Upload folder using huggingface_hub
Verified signatureec8b1ef -
Upload folder using huggingface_hub
Verified signature9bdcc6e -
Upload folder using huggingface_hub
Verified signature4cbfe19 -
Upload folder using huggingface_hub
Verified signaturef7e2ce4 -
Upload folder using huggingface_hub
Verified signature53170e7