@KooKiz Crazy to see it approaching C++ realms of performance. Just a few years ago C++ or rust would have been the only sane choice for something low-level like this
@mjovanovictech Any Provider you want. I tried with our corporate LiteLLM and it worked fine. If you have the hardware for it you can also try running some qwen or gemma models locally
The API just has to be OpenAI-compatible
@happyadam73@rogiervdhee@github Agree, @github Copilot is dead technology. They should just double-down on BYOK so the existing tooling can still be used