@TechProphet_X@ggerganov yeah but it isn't close
compared to the 35b a3b you are 27b vs 3b for each token, so you can easily see the difference in quality
like also with the 3.6, the 27B was better than the 35b (and it isn't that close tbh)
@nahcrof I really appreciate your mission in today society
though I think 75% is still low, to feel the "cheapest" inference in the world it should be at least 95%
I am not hating, I really appreciate what you are doing, just giving my pov