Is it possible to make smaller NVFP4 quant at 340-360GB to fit in 4x96gb?
👍
1
61
#1 opened 7 days ago
by
Fernanda24
Wondering how could you tested this with 2xRTX 6000 pro
4
#2 opened 7 days ago
by
csabakecskemeti
How did you bypass deepseek-v32 not recognized in Tranformers?
3
#3 opened 6 days ago
by
Fernanda24