@superalesha another benchmark failure. once again very obvious issues. why didn't you test any q5/q6? that is usually there the best quant to perplexity ratio lies. q4 and fp8? what the fuck??
@_tooflyszn your thinking this way only makes things worse. we have the highest standard of living in history and lowest infant mortality rate and highest literacy rate. people need to stop being so negative