Instructions to use Danielbrdz/Barcenas-8b-Cartas with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Danielbrdz/Barcenas-8b-Cartas with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Danielbrdz/Barcenas-8b-Cartas") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Danielbrdz/Barcenas-8b-Cartas") model = AutoModelForCausalLM.from_pretrained("Danielbrdz/Barcenas-8b-Cartas") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Danielbrdz/Barcenas-8b-Cartas with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Danielbrdz/Barcenas-8b-Cartas" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Danielbrdz/Barcenas-8b-Cartas", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Danielbrdz/Barcenas-8b-Cartas
- SGLang
How to use Danielbrdz/Barcenas-8b-Cartas with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Danielbrdz/Barcenas-8b-Cartas" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Danielbrdz/Barcenas-8b-Cartas", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Danielbrdz/Barcenas-8b-Cartas" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Danielbrdz/Barcenas-8b-Cartas", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Danielbrdz/Barcenas-8b-Cartas with Docker Model Runner:
docker model run hf.co/Danielbrdz/Barcenas-8b-Cartas
Barcenas 8b Cartas
Modelo basado en el NousResearch/Meta-Llama-3.1-8B-Instruct y entrenado con datos de Danielbrdz/Barcenas-Cartas
Este modelo tiene el objetivo de hacer cartas tengan profundidad y sentimientos, como si un humano experto lo haría.
El LLM puede hacer cartas con diversos sentimientos y de calidad de escritura alta.
Barcenas 8b Cartas
Model based on the NousResearch/Meta-Llama-3.1-8B-Instruct and trained with data from Danielbrdz/Barcenas-Cartas
This model aims to make letters have depth and feelings, as if an expert human would do it.
The LLM can make letters with different feelings and of high writing quality.
Made with ❤️ in Guadalupe, Nuevo Leon, Mexico 🇲🇽
- Downloads last month
- 2