Toven

leading inference provider ops (i'm hiring!) @openrouter. opinions my own. aka tomas. 🇦🇷✝️

[Toven @pingToven]

the provider operations team at openrouter is absolutely cooking on automations. 727 new endpoints added in august alone, 23 endpoints a day!

our systems allow 75+ providers to self serve onboard their endpoints onto our platform (gated on quality and functionality tests)

[OpenRouter @OpenRouter]

Use the Security Center to manage security across all models:

- turn on key spend alerts 🔔
- remove unused keys
- set a periodic spend limit on uncapped keys
- set a max key lifetime on ALL keys

… and more! https://t.co/0iT2xJG2Oa

[Toven @pingToven]

@robinebers 🫡

[Toven @pingToven]

Highly recommend using our security center, regardless of the post.

https://t.co/MpO5p1VHxQ

[OpenRouter @OpenRouter]

We have investigated this and have not found evidence of unauthorized access to our data, or validation of any of the claims in the post.

We will continue the investigation and monitor for any signs of abuse. If a leak is verified or abuse is detected we will take action and notify customers.

[Toven @pingToven]

@BitGrateful https://t.co/gQsBOcDQfs

[OpenRouter @OpenRouter]

We have investigated this and have not found evidence of unauthorized access to our data, or validation of any of the claims in the post.

We will continue the investigation and monitor for any signs of abuse. If a leak is verified or abuse is detected we will take action and notify customers.

[Toven @pingToven]

@Eli5defi https://t.co/gQsBOcEo50

[OpenRouter @OpenRouter]

We have investigated this and have not found evidence of unauthorized access to our data, or validation of any of the claims in the post.

We will continue the investigation and monitor for any signs of abuse. If a leak is verified or abuse is detected we will take action and notify customers.

[Toven @pingToven]

@OrcaRouter https://t.co/XxnDapFdkj

[OpenRouter @OpenRouter]

We have investigated this and have not found evidence of unauthorized access to our data, or validation of any of the claims in the post.

We will continue the investigation and monitor for any signs of abuse. If a leak is verified or abuse is detected we will take action and notify customers.

[Toven @pingToven]

@shawmakesmagic https://t.co/gQsBOcEo50

[OpenRouter @OpenRouter]

We have investigated this and have not found evidence of unauthorized access to our data, or validation of any of the claims in the post.

We will continue the investigation and monitor for any signs of abuse. If a leak is verified or abuse is detected we will take action and notify customers.

[Toven @pingToven]

@imjustnewatai https://t.co/XxnDapFdkj

[OpenRouter @OpenRouter]

We have investigated this and have not found evidence of unauthorized access to our data, or validation of any of the claims in the post.

We will continue the investigation and monitor for any signs of abuse. If a leak is verified or abuse is detected we will take action and notify customers.

[Toven @pingToven]

@OpenRouter @DailyDarkWeb For anyone looking to be proactive use the security center to review keys: https://t.co/yzSaJwamoo

[OpenRouter @OpenRouter]

Use the Security Center to manage security across all models:

- turn on key spend alerts 🔔
- remove unused keys
- set a periodic spend limit on uncapped keys
- set a max key lifetime on ALL keys

… and more! https://t.co/0iT2xJG2Oa

[Toven @pingToven]

@teortaxesTex we recently added some nice charts and data on cache weighted pricing, this is what people are really paying on avg for opus on openrouter

[Toven @pingToven]

@teortaxesTex ah yeah that’s been continuously improved over time, cache hit rates are pretty high rn, we do essentially pin you to the provider giving you cache yep

[Toven @pingToven]

@ekzhang1 oooooooh

[Toven @pingToven]

@4shadowed @Lachmsn @advaithj1

[Toven @pingToven]

@4shadowed @Lachmsn @advaithj1 TF is full :(

[Toven @pingToven]

@RKRigney @PeterJ_Walker listen we’re transparent but not that transparent

[Peter Walker @PeterJ_Walker]

New from OpenRouter: 7-day average token volume for Anthropic models is up 3.6x since the launch of Opus 5.5

Sonnet 5.5 and Haiku 5.5 have also been well received.

[Toven @pingToven]

@Lermatroid @LukeParkerDev get a beefier 4 legged desk it’s worth it and defeats wobble

[Toven @pingToven]

hehehe gadget

[Toven @pingToven]

@itsnoahd @ArtificialAnlys @ValsAI this i am also unconvinced on but feels more likely than saying every swe needs abliterated models as their all purpose llm

[Toven @pingToven]

i am not convinced defenders need abliterated models (outside of redteaming)

is there any cyber bench data comparing the versions? does instruction following suffer? does alignment/reward hacking change?

@ArtificialAnlys / @ValsAI would be interested in a post about this