That's all too complicated! So I coded a super simple prompt evaluation loop with Cursor in 2h to measure LLM results using our system prompt against a ground truth dataset.
4 iterations later, performance improved from ~ 70% to 96% !! #PromptEngineering ftW
I was playing around with the Vertex AI prompt optimizer notebook just to find out that:
- I need a custom metric
- in order to use custom metrics, I need to create a Cloud Function (which I did)
- the notebook doesn't even support that.
We built fluado's MVP with AI.
Vibe-coded a React prototype in 12hrs. Chaos ensued.
@yvg saved us with MVVM + strict typing - suddenly fast again. Then reality hit: payment providers, app stores, legal docs. That's what actually kills velocity, not the code.
There are countless issues that can cause an otherwise healthy team to fall apart.
In a new blog post by @arbovm, learn how we got a struggling team back on track. 😓➡️😃
https://t.co/3B3y8mTRqv