Hifzullah

Building research tools at @ultradianai. Writing on evaluation methodology and multi-agent workflows.

Discovered, not designed.

[Hifzullah @hifce]

@fatzin_ @neural_avb Not an unreasonable question but you'd want to understand how transformers are structured before attempting to upscale. Your training might go wasted if you do it without proper architectural decisions. As a general pointer, you might find net2net paper interesting.

[Hifzullah @hifce]

2/ The expensive mistake in agent work is building before you've understood the shape of the problem. A few hours of structured exploration with agents arguing about it saves you weeks of building the wrong thing.

Some of y'all call it specs.

[Hifzullah @hifce]

1/ Raise your hand if you also run a discovery with agents before you build anything. I'll start. ✋

[Hifzullah @hifce]

@atmoio honest

[Hifzullah @hifce]

@trq212 I usually run two versions of responses: the "plain english" leads AI's messages at the top, then it follows with technical counterpart. Easier to front-load core meaning before details.

[Hifzullah @hifce]

Compaction severs reliability, especially when you're in flight with methodologies to follow. I usually have the session write a handoff before compaction happens and have it re-read it and referred docs to replenish its memory, regardless of what compaction provides.

[Hifzullah @hifce]

@bee_fumo Probably many more projects picked up after AI entered chat.