Instructions to use FPHam/Jackson_The_Formalizer_13b_GPTQ with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use FPHam/Jackson_The_Formalizer_13b_GPTQ with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="FPHam/Jackson_The_Formalizer_13b_GPTQ")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("FPHam/Jackson_The_Formalizer_13b_GPTQ")
model = AutoModelForCausalLM.from_pretrained("FPHam/Jackson_The_Formalizer_13b_GPTQ")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use FPHam/Jackson_The_Formalizer_13b_GPTQ with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "FPHam/Jackson_The_Formalizer_13b_GPTQ"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FPHam/Jackson_The_Formalizer_13b_GPTQ",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/FPHam/Jackson_The_Formalizer_13b_GPTQ

SGLang

How to use FPHam/Jackson_The_Formalizer_13b_GPTQ with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "FPHam/Jackson_The_Formalizer_13b_GPTQ" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FPHam/Jackson_The_Formalizer_13b_GPTQ",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "FPHam/Jackson_The_Formalizer_13b_GPTQ" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FPHam/Jackson_The_Formalizer_13b_GPTQ",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use FPHam/Jackson_The_Formalizer_13b_GPTQ with Docker Model Runner:
```
docker model run hf.co/FPHam/Jackson_The_Formalizer_13b_GPTQ
```

Buy Jackson Ko-fi

Jackson The Formalizer - Uncensored, but that means nothing

Currently, Mr. Jackson works for FP editing services where he was previously employed by the government department responsible for proofreading official documents. We always turn to Jackson when we need to edit something too exciting.

His skill set allows him to create perfectly dull versions of texts most of the time.

Instruction:

Formalize: In the heart of Derry, a group of seven childhood friends had gathered, drawn together by a force they couldn't fully comprehend. They had all grown up in this town, and they knew its secrets all too well. They had faced unspeakable horrors as children, horrors that had returned to haunt them once more.

Response:

In the heart of the town, a gathering of seven former childhood friends had congregated due to an undeniable bond. These residents had grown up within this community and understood the town's history quite well. As minors, they endured frightening occurrences which have persisted over the years.

Jackson uses ALPACA instruct

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Rewrite the text: 
 
### Response:

You can use commands such as rewrite the text, make it sound more formal, formalize, etc... or just paste a paragraph without any instructions. Jackson will happily rewrite it.

Sometimes Jackson will continue writing his ideas how the text should go. Then his Dark persona SonJack could appear, trying to write "just like the kids on the internets".

Downloads last month: 8