I've spent a couple of days having Astra just go do live product testing in the app and it just sort of worked which is cool (albeit slow). I then wondered how good Astra would be at building out a more complete Maestro end-to-end testing harness (basically, click through every aspect of the app on the iOS simulator) and that was even better. I normally don't like doing full e2e tests because they can be fragile and hard to maintain, but if Astra can keep them fresh and build them so fast maybe this is the right way to do it.
@kevinkern Interesting - that seems worth trying. "Go use the app like a customer would, specifically test things we've changed recently, let me know what doesn't work" -- a far more intelligent end-to-end test
My flow (today) is fable does all planning & implementation, astra reviews, paste review back into fable to decide what to fix, paste what fable fixed back into the astra review thread to check again, repeat until nothing major is found. At this moment this seems to provide the best results for me
I’ll keep hunting. Fable’s attention to detail is just next level. At the moment codex is relegated to code reviews for me. Traditionally I’ve found codex to be better at backend work but I’m also finding it hitting context window limits faster than fable and then degrading heavily after it compresses
@nikitabier@BillyM2k I wish grok could automatically flag highly questionable posts, kind of like an early community notes indicator. Nothing definitive, just a hint on the most egregious posts while CN does its thing. Maybe I could hit a button such that once it’s resolved I get a notification
Maybe it's just me, but getting MCP servers to work in Claude Code is so much easier than the Codex GUI. Seems like such a simple and critical thing to somehow not get right on the Codex side
@kevinkern I hope that continues. Fallbacks continue to be one of the worst behaviors of coding agents. If that gets solved that’s actually a big step forward
I'm always amused when claude code says things like "or is this a good stopping point for today?" Like, does it need to be somewhere? What are its working hours? Or is it suggesting I should be doing something else soon?
@kevinkern I think one type of skill that might last long term are skills provided by companies to make sure LLMs are using the best practices to accomplish a task. So, centrally maintained and used by many
@brian_lovin Seems like we are all inventing the same current best-practice Claude skills at the same time. Seems like someone should be able to get a starter kit with a host of best-practices skills as a baseline. Is there an effort to share and reuse skills?