It is clear open source models and harnesses are having a moment. There's a few factors at work
1/ It is now obvious that you can catch up to near-SOTA performance and do so with a clear training lineage. See:@thinkymachines Inkling launch today.
2/ There are several well-funded, talented teams building open weight models now in the US and abroad. Along with the explosing of other near SOTA models (Grok/Cursor, Muse Spark), it is clear we are going to have a diverse ecosystem of models atleast on coding and agentic use.
3/ Organizations are increasingly looking for control over how their data is used and are willing to trade off some access to frontier level tokens for this control. Organizations and countries are increasingly nervous about the frontier labs potentially competing with them down the road and don't want their data to enable a future competitor.
4/ Open source is a slider: you could bring your own open harness, your evals, your business context and are free to pick and choose your model of choice.
5/ Companies have now actively shifted from "how do we get our people to use tokens" to being uncomfortable with their token cost ballooning without a clear line to revenue.
6/ Geo-politically, countries will be weighing open weight models as a way to get frontier-level tokens inside controlled environments that may not be otherwise possible.
All of this leads to more choice for all of us !
Been playing with Claude Tag for a handful of hours across three large organizations (100-2k users). Some initial thoughts:
The new Claude AI Tag is interesting… I am not sold on it though. It starts to take the concept of a Git based “brain” and turn it into a Claude based “brain.” Hellloooooo lock-in concerns!
The permissions, and wiring make it powerful, but it abstracts all of the memory, knowledge and skills that the Git based company brain affords.
If you are rolling out Claude to novice users who live in Slack, it can be valuable… BUT, if you can skill up your team and get them into a department level brain (Git based), then Claude Tag is not the way to go.
Regardless, its fairly straight forward to configure, but watch out because if you give Claude access to things, fine grained auth scopes don't exist for everything yet (ie, give it access to see a repo, it can now commit and merge changes unless your repo has stop gaps in place).
Oh, and the pricing is steep on the per model token model 😬
Introducing Claude Tag, a new way for teams to work with Claude.
In Slack, Claude joins as a team member with access to the channels and tools you choose. Tag Claude in and delegate tasks to it while you focus on other work.
Seems like memory systems and management is going to be the next ai-race.
Open system that’s portable between LLMs will be powerful. And I don’t think obsidian is it.
for those building "company brains" what harness are you choosing for non-technical users?
Hermes with whatsapp/Slack integration is the path we are testing and I wonder what else is out there.
The build log is accelerating as the number of items being delivered also grows. it feels good to be moving faster with more complex items
https://t.co/capxJwEPKP
This is really solid. Iv'e found we need a couple more things: Crystallization Ladder, Tiered Rigor/confidence, content-type trust signals... some of that can be woven into the memory traces, but are functionally different.
a PM asked me - "what's it like building agentic systems/products?"
I responded roughly - "remember how exhaustive and tedious writing some acceptance criteria was for junior devs? Now 10x that misery when you are writing and reviewing evals."
@zherring the interface is just cleaner. I can see what files are in context, the branch i'm on, still have a terminal window, and quick access to artifacts I am working with.
It gives me loads of context, to then feed more context into my prompts. planning also seems better with the flo
We are actually on the precipice on Web 3.0. It’s an agententic web.
Immutable, decentralized networks and information are not things the masses really care about (still).