How to use ray0rf1re/Nano-nano-v4 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ray0rf1re/Nano-nano-v4", device_map="auto")
This model uses a standard Llama architecture and can be loaded directly with AutoModelForCausalLM. and may be undertrained
AutoModelForCausalLM
Files info