feels like founder mode is a bit of a trap right now
agents made the building part so easy that everyone feels like they could start a company
but it's 90% likely you aren't thinking big enough to actually make it now
this happened to me, was considering going founder mode but then realized every idea i thought of would probably be oneshottable by the next wave of SOTA models (they were, when fable came out lol)
this made me realize my priors were still tuned too hard to a pre-agi world and i needed to shake that before i even considered building something
i feel stuck with wtf i do for like 10 months
keep going round in circles. questioning and re-questioning everything. things feel exciting then dont.
what feels like a good business direction then doesnt.
touch grass, ai melting brains, i know i know but still
@ivanburazin@daytonaio the mac mini would let me host a “living” music blog I’m building out. it’s connected to my music server and i have an agent research any given track I’m listening to at the moment to curate the blog
@kunchenguid@doodlestein build cool stuff already
there’s something quite awkward about all the personal agents in the current hype cycle
muse, grok bot, instinct, dots, and whatever google, anthropic will come up with
none of them is “mine”
i’d be trusting a vendor for some of the most sensitive data about me and bet on them handling it with extreme responsibility. what if they have a data leakage incident? what if they hired a wrong employee? what if they simply break bad?
i’d also be betting on their model. right now i’ve set up a lot of my stuff in grok bot, but what if their model falls behind? what if another model becomes 10x better on pure intelligence? then i’ll either miss out on a better assistant, or have to bite the bullet and do a full migration
i’d also have to bet on their product. they may not build the features i want. they may not allow me to customize enough. and one day my assistant may show me ads
that feels like way too much betting than what i’d be comfortable with, if i truly want literally everything in my life to go through and be taken care of by an assistant
with all that considered, i’m more bullish on open source personal agents that run on people’s own computers. but i think these open source projects have to break out of the assumption that their users are developers and they can just throw a repo at them and ask them to launch a terminal
a well polished, fool proof, community maintained, vendor agnostic, free personal agent that everyone can run by themselves without locking into a SaaS - that’s what i think many people will need
how to set the right reasoning effort level
i get asked this a lot, and i learned that because the underlying mechanism is not obvious, a lot of people don’t have the right mental model to think about how to use the knob
so a quick crash course here:
reasoning effort level in mainstream LLMs today means a “ceiling”, not a “floor”!
setting a high effort level does NOT mean every prompt you send will use a lot of thinking tokens. you can try this very easily - launch your agent in an empty directory, use high reasoning, and say “hi” - unless your harness is totally messed up, the agent will respond almost instantly
how does that work? the most typical implementation is that in post-training, the models receive a penalty for how many thinking tokens they use. how strong the penalty is depends on the thinking effort level that’s set
at low reasoning, the penalty is very strong, so any long thinking traces get punished into oblivion
at high reasoning, the penalty is weak so longer thinking traces don’t get punished too much, and are allowed to survive more often as long as they get good results
the most important thing to learn there is - thinking tokens is always a penalty, not a reward. there’s never a rule that says “at high reasoning i’ll punish you if you think too little” - this is because more thinking tokens always means higher cost which is always a bad thing and should not be rewarded
so with that in mind, you should think of reasoning effort as “how much are you allowed to think”, not “how much do i want you to think”
setting it at low means “for this task you are not allowed to think much”. you would want this when 1) the use case requires low latency; or 2) you already know the task does not require additional reasoning
setting it at high means “you are allowed to think more when needed”. the model will still try to think as little as possible according to what its training data teaches it. you want this when 1) the use case allows slower response; and 2) you are not sure how much thinking is needed for this task
for some models, “max” is special because it forces thinking mode to be on, which forbids “zero thinking”. i don’t have a full inventory for which models do this vs not. and i generally avoid this mode because i don’t think it’s a good idea to say “every request has to have thinking tokens no matter what”
practically speaking, i mostly only use two modes:
- medium, when i already know the task is well defined
for example, implementing a spec planned by a highly intelligent model. i avoid low because 1) i rarely require low latency; 2) even when implementing well defined tasks sometimes the intermediate context is still ambiguous
this is also my default for firstmate because highly ambiguous problems are typically handled by crewmates, and i do want firstmate to be fast
- xhigh, whenever the task is not well defined yet. this is most often used for planning and investigative work. i do this to give enough room for the model to decide how much thinking it needs
hope this is helpful!