Instructions to use unsloth/Reflection-Llama-3.1-70B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Inference
- Local Apps Settings
- Unsloth Studio
How to use unsloth/Reflection-Llama-3.1-70B with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/Reflection-Llama-3.1-70B to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/Reflection-Llama-3.1-70B to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for unsloth/Reflection-Llama-3.1-70B to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="unsloth/Reflection-Llama-3.1-70B", max_seq_length=2048, )
More reasoning version?
#1
by legolasyiu - opened
Hello team
Anyone interested in really more reasonable or much better version of this?
Donation appreciated.
Thomas
Hello team
Anyone interested in really more reasonable or much better version of this?
Donation appreciated.Thomas
Hi what do you mean? Do you mean you're going to create it? π