LFM2.5-350M MentalChat16K ONNX Q4
This repository contains an ONNX Q4 export of a fine-tuned version of LiquidAI/LFM2.5-350M.
The model was fine-tuned on ShenLab/MentalChat16K for supportive mental-health-style dialogue.
This repository is intended for experimentation with browser-side and ONNX-based inference.
Files
The repository contains the unpacked ONNX export, not a ZIP archive.
Expected structure:
config.json
generation_config.json
tokenizer.json
tokenizer_config.json
chat_template.jinja
onnx/model_q4.onnx
onnx/model_q4.onnx_data
- Downloads last month
- 22
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'zhenikk/LFM2.5-350M-MentalChat16K');