OpenMOSS-Team/SmolLM-135M-MLA-d_kv_8-refactor
Text Generation • 0.1B • Updated • 3 • 1
MHA2MLA-refactor
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
-
-
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_32-refactor
Text Generation • 0.1B • Updated • 19 • 1 -
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_16-refactor
Text Generation • 0.1B • Updated • 3 • 1 -
OpenMOSS-Team/SmolLM-360M-MLA-d_kv_8-refactor
Text Generation • 0.3B • Updated • 6 • 1 -
OpenMOSS-Team/SmolLM-360M-MLA-d_kv_16-refactor
Text Generation • 0.3B • Updated • 3 -
OpenMOSS-Team/SmolLM-360M-MLA-d_kv_32-refactor
Text Generation • 0.4B • Updated • 1 -
OpenMOSS-Team/smollm1-1B7-d_kv_8-refactor
Text Generation • 2B • Updated • 1 -
OpenMOSS-Team/smollm1-1B7-d_kv_16-refactor
Text Generation • 2B • Updated • 1 -
OpenMOSS-Team/smollm1-1B7-d_kv_32-refactor
Text Generation • 2B • Updated • 1 -
OpenMOSS-Team/llama2-7B-d_kv_16-refactor
Text Generation • 6B • Updated • 1 -
OpenMOSS-Team/llama2-7B-d_kv_32-refactor
Text Generation • 6B • Updated • 10 -
OpenMOSS-Team/llama2-7B-d_kv_64-refactor
Text Generation • 7B • Updated • 1