InferenceIllusionist
/

mathstral-7B-v0.1-iMat-GGUF

Model card Files Files and versions

mathstral-7B-v0.1-iMat-GGUF

83.2 GB

1 contributor

History: 27 commits

InferenceIllusionist's picture

InferenceIllusionist

Update README.md

3d1b231 verified over 1 year ago

.gitattributes

2.98 kB

Upload ggml-model-f16.gguf over 1 year ago
README.md

1.2 kB

Update README.md over 1 year ago
ggml-model-f16.gguf

14.5 GB
xet

Upload ggml-model-f16.gguf over 1 year ago
mathstral-7B-v0.1-f16.imatrix

4.99 MB
xet

Upload mathstral-7B-v0.1-f16.imatrix over 1 year ago
mathstral-7B-v0.1-iMat-IQ1_M.gguf

1.76 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ1_M.gguf over 1 year ago
mathstral-7B-v0.1-iMat-IQ2_M.gguf

2.5 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ2_M.gguf over 1 year ago
mathstral-7B-v0.1-iMat-IQ2_S.gguf

2.31 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ2_S.gguf over 1 year ago
mathstral-7B-v0.1-iMat-IQ2_XS.gguf

2.2 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ2_XS.gguf over 1 year ago
mathstral-7B-v0.1-iMat-IQ2_XXS.gguf

1.99 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ2_XXS.gguf over 1 year ago
mathstral-7B-v0.1-iMat-IQ3_M.gguf

3.29 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ3_M.gguf over 1 year ago
mathstral-7B-v0.1-iMat-IQ3_S.gguf

3.19 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ3_S.gguf over 1 year ago
mathstral-7B-v0.1-iMat-IQ3_XS.gguf

3.02 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ3_XS.gguf over 1 year ago
mathstral-7B-v0.1-iMat-IQ3_XXS.gguf

2.83 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ3_XXS.gguf over 1 year ago
mathstral-7B-v0.1-iMat-IQ4_XS.gguf

3.91 GB
xet

Upload mathstral-7B-v0.1-iMat-IQ4_XS.gguf over 1 year ago
mathstral-7B-v0.1-iMat-Q2_K.gguf

2.72 GB
xet

Upload mathstral-7B-v0.1-iMat-Q2_K.gguf over 1 year ago
mathstral-7B-v0.1-iMat-Q3_K_M.gguf

3.52 GB
xet

Upload mathstral-7B-v0.1-iMat-Q3_K_M.gguf over 1 year ago
mathstral-7B-v0.1-iMat-Q3_K_S.gguf

3.17 GB
xet

Upload mathstral-7B-v0.1-iMat-Q3_K_S.gguf over 1 year ago
mathstral-7B-v0.1-iMat-Q4_K_M.gguf

4.37 GB
xet

Upload mathstral-7B-v0.1-iMat-Q4_K_M.gguf over 1 year ago
mathstral-7B-v0.1-iMat-Q4_K_S.gguf

4.14 GB
xet

Upload mathstral-7B-v0.1-iMat-Q4_K_S.gguf over 1 year ago
mathstral-7B-v0.1-iMat-Q5_K_M.gguf

5.14 GB
xet

Upload mathstral-7B-v0.1-iMat-Q5_K_M.gguf over 1 year ago
mathstral-7B-v0.1-iMat-Q5_K_S.gguf

5 GB
xet

Upload mathstral-7B-v0.1-iMat-Q5_K_S.gguf over 1 year ago
mathstral-7B-v0.1-iMat-Q6_K.gguf

5.95 GB
xet

Upload mathstral-7B-v0.1-iMat-Q6_K.gguf over 1 year ago
mathstral-7B-v0.1-iMat-Q8_0.gguf

7.7 GB
xet

Upload mathstral-7B-v0.1-iMat-Q8_0.gguf over 1 year ago