WAIT… I can’t believe Sam Altman really said this out loud about local AI: “A lot of people want local inference. And they assume that the problem is solved now because we are going to have open source models. And so we're not going to need all the stuff in the data center.
But from a global allocation perspective, actually, it's quite terrible to have everybody have a bunch of the world's limited supply of DRAM sitting in their own computer. And, being used 5% of the time.”
this is such a bizarre thing to say in the open. I don’t get why people buying hardware for their own use is framed as a competition with data centers spending billions to buy hardware at scale.
if anyone should be complaining about how the world’s memory is allocated, it must be the average consumers facing the skyrocketing hardware prices.
it just doesn’t make any sense.
We’re pleased to announce the launch of our 2.0 series of Fin Apex models!
We think these are the best models for customer service.
They are incredibly fast and efficient to run, but even beyond that, we’re seeing an increasing, not shrinking, performance gap between our specialised models, and the general frontier.
We recently did a backtest against Astra, an amazing general model, and you’d expect overkill for customer service - but it still underperforms Apex on our particular tasks.
So, at least in our experience, there’s still a lot of room for domain specific customisation.
We try to give some flavour of the sort of tradeoffs necessary to achieve this performance in the launch post:
https://t.co/GJY1fd2owj
Former chancellor Kwasi Kwarteng told @SkyNews Man City verdict will be seen as a "huge public humiliation" by club’s ownership and will put pressure on UK-UAE relations
Video https://t.co/ZLrr6ManH1
EXCLUSIVE: Monzo, the digital lender which has become one of Britain's biggest consumer banks, is in talks about a sale to Brazil's Nu Holdings which could value it at between £8bn and £10bn, ending the prospect of a near-term IPO of a UK fintech champion. https://t.co/V1IVOIJsLc
Watch Des Traynor (@destraynor), our Co-founder and Chief Strategy Officer introduce Fin at the SMB keynote at @Dreamforce. Showing exactly what Fin can do, with a Fin Voice demo, live and in front of thousands.
Full video below 👇
It's a done deal!
We have officially completed our acquisition of @Fin_AI! 🚀
By bringing their customer agent platform to Salesforce, we’re expanding customer choice with fast-to-deploy, autonomous service agents that resolve complex queries end to end across every channel.
Welcome to Salesforce, Fin!
Read the news: https://t.co/S4anb1MbYM
I think I've narrowed down my options for CPU + Mobo.
I initially started looking into NAS specific options, like the Intel N100
https://t.co/1JcgSUUeBv
Some pros
- low power usage
- av1 decoding
- conveniently packed up
@AliExpress_EN I did also consider AMD CPU's, but since my initial goal is to set up Plex - it works much better with Quicksync enabled on a Intel CPU + dedicated graphics
I think I've narrowed down my options for CPU + Mobo.
I initially started looking into NAS specific options, like the Intel N100
https://t.co/1JcgSUUeBv
Some pros
- low power usage
- av1 decoding
- conveniently packed up
Looking to build a homelab (NAS + Plex Server). Surprised by how similar and different it is compared to building a PC.
Sure, all you need is a CPU + GPU, Mobo, RAM, Case and storage in both cases. But its sooo different. Will post my findings in this thread
Some of the CPU + Mobo combos I have never even heard of. Example - https://t.co/CVYO5req3q
One more consideration is power, considering a home server would be on 24/7, compared to a traditional PC