@ZhangZhiyu20618 Nice. An LLM Interface Gateway solves a real pain point.
One thing I'd be curious about: how are you testing it? Most gateways work fine until you need repeatable tests, mock LLM responses, or safe tool execution without hitting production. That's where things usually get tricky
Everyone's shipping AI agents in 2026.
Almost nobody can test them.
Every test run hits a live LLM: slow, burns tokens, returns different output each time — and actually executes your tools. Real DB writes. Real emails. Real charges.
#AIAgents#LLMOps#DevTools#OpenSource
Built a distributed observability platform.
Metrics with Prometheus
Dashboards with Grafana
Logs with Loki
Alerts with Alertmanager
Load testing with k6
The biggest lesson:
Building software is optional.
Debugging it in production is mandatory
Source-https://t.co/zntPbEXwOi