@cryptorover what a lazy correlation. Like we don't have teslas success story, ai compute in space plus the potential for space travel. moon bases, space mining etc.
I considered buying a RTX Pro 6000 96GB at 9000€ last fall. Today it costs 16000€ in Finland :(
It's basically just a RTX 5090 with 3x RAM. This is what professionals are willing to pay for a big die GPU. We will never see big die gaming GPUs for <2000€ anymore :(
I know y'all have been dazzled by Le Chaton Fat, but you've missed the leak about their secret project Mistral Le Foie Gras. It's an experiment in overtraining a 4T 256B LLM with 128 epochs of 8T tokens… Which has resulted in LeStéatose (known in the US as "grokking")
stay alert
HOLY CRAP! Turns out Le Chaton Fat was just the beginning.
@MistralAI just announced that Le Chaton Fat is going to essentially be the weaker/cheaper of their new Le Chaton model line, with "Le Chaton Plus Grand" being the most powerful model to date
- 60T Parameters
- 2M Context Window
- 2x the experts as Le Chaton Fat
gg
@bearwithmestp@asifdevs if you are good you will find the way, If you got the goods, But maybe they don't so you don't risk it. I know the amount of compute you need. Also, the game is not only about deploying as the big labs but creating better architectures and optimizing. That would be insane talent
@bearwithmestp@asifdevs but hey, i wanna see a fat cat beating everyone for sure I love France, but sadly, Europe is so cooked with their leadership...hope they manage to free themselves somehow
@bearwithmestp@asifdevs yep, but who knows who started the trolling. anyways, i always wish for people to succeed rather than fail...I just don't have super faith in mistral. Taken so long to ship anything really useful...