Adzeiros's picture

34

Adzeiros

Adzeiros

·

AI & ML interests

None yet

Organizations

None yet

New activity in BruhzWater/Sapphira-L3.3-70b-0.2 4 months ago

Anyone have solid settings for this, or the 0.1 version?

#1 opened 4 months ago by

New activity in BruhzWater/Sapphira-L3.3-70b-0.1 4 months ago

Thinking?

#2 opened 4 months ago by

New activity in ReadyArt/Steelskull_L3.3-Shakudo-70b-EXL2 4 months ago

4.55BPW 24k context on 48GB of VRAM

#1 opened 4 months ago by

New activity in ReadyArt/Behemoth-123B-v1.2-EXL3 4 months ago

Possibility for a 2.85BPW quant?

#1 opened 4 months ago by

New activity in MikeRoz/Electranova-70B-v1.0-exl3 7 months ago

Possible for a 5.0 quant or so?

#1 opened 7 months ago by

New activity in DBMe/Anubis-70B-v1-5.0bpw-h6-exl2 10 months ago

Won't fit on 48GB VRAM

#1 opened 10 months ago by

New activity in MikeRoz/Steelskull_L3.3-MS-Nevoria-70b-4.25bpw-h6-exl2 10 months ago

Any chance for a 4.8 bpw?

#1 opened 10 months ago by

New activity in juvi21/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B 11 months ago

Any chance for EXL2 quants? + SillyTavern settings

#3 opened about 1 year ago by

New activity in wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2 about 1 year ago

VRAM requirements

#1 opened almost 2 years ago by

sophosympatheia

New activity in SicariusSicariiStuff/invisietch_Nimbus-Miqu-v0.1-70B-EXL2-5.5bpw about 1 year ago

5.0BPW Quant?

#1 opened over 1 year ago by

New activity in lucyknada/CohereForAI_c4ai-command-r-08-2024-exl2 over 1 year ago

8.0bpw quant?

#1 opened over 1 year ago by

New activity in bartowski/WizardLM-2-8x22B-GGUF over 1 year ago

which quaint to I use to fit on a single 24GB video card on a PC Running Windows 11? (4090)

#3 opened over 1 year ago by

New activity in MaziyarPanahi/WizardLM-2-8x22B-GGUF over 1 year ago

Help regarding best quantization for below PC specification.

#15 opened over 1 year ago by

New activity in lucyknada/NeverSleep_Lumimaid-v0.2-70B-exl2-5.0bpw over 1 year ago

4.0bpw or 4.5bpw

#1 opened over 1 year ago by

New activity in NeverSleep/Lumimaid-v0.2-123B over 1 year ago

EXL2 quants

#3 opened over 1 year ago by

New activity in anthracite-org/magnum-v1-72b over 1 year ago

Samplers

#6 opened over 1 year ago by

GGUF (Q4_K_M only) outputs gibberish

#3 opened over 1 year ago by

New activity in wolfram/miquliz-120b-v2.0 over 1 year ago

VRAM Estimates

#3 opened almost 2 years ago by

New activity in dreamgen/opus-v1.2-llama-3-8b over 1 year ago

Check new, much better, version of this model

#5 opened over 1 year ago by

Best model for RP I have ever tried

#2 opened over 1 year ago by