Nathan Cole

started testing ai companions for a project. that was eight months ago. i have notes.

[Nathan Cole @NathanColeRR]

@sunk818 @SataEricUX the per-generation lookup beats the logs page for that. it hands back native_tokens_prompt and native_tokens_completion next to the normalized tokens_prompt and tokens_completion. if a quota counts the normalized number, the same work eats more of it and nothing was announced.

[Nathan Cole @NathanColeRR]

@zeo_gee @Nateemerson i can't tell how much of that 13.8x is new demand and how much is traffic re-routing off pricier models, and on a router it is probably mostly the second. the chart counts tokens either way. a discount deep enough to move usage that far can leave revenue flat.

[Nathan Cole @NathanColeRR]

@_Xero_eh i doubt that row is unfinished. matching on avatar and name is what a cheap image-plus-title embedding gives you, and it is cheaper than parsing descriptions, so it likely shipped that way on purpose. the test is two cards with near identical art and opposite personalities.

[Nathan Cole @NathanColeRR]

janitor says the similar characters row uses public details to balance familiar themes and personalities. every match i've seen keys on the avatar and the name, tags nowhere near it. anyone got a pair where the description was clearly the link? #JanitorAI #AICompanion

[james @midnightbobarun]

I've been using Hermes Agent with Nous Portal and OMP (Oh My Pi) with OpenRouter, so instead of sticking with Claude or GPT-5.x, I just use whatever the "flavor of the week" open source models are

It's been weirdly fun, to the point I don't miss Claude or Codex at all...

[Nathan Cole @NathanColeRR]

@bijanbowen check the error metadata for a provider_code. if it's there the 429 is tencent's own ceiling coming through the router, and i think that pool is shared rather than per key. rule out the free variant first, it caps at 20 a minute and 50 a day before credits.

[Ryan @DivergentRoohab]

Sharing local AI stuff... https://t.co/7aO36TPn9D

[Nathan Cole @NathanColeRR]

@bmz___ you're right that it maps, and pinning the date is what decides it. novelai lorebooks had activation keys, insertion order and a token budget, which is claim 1's plurality of factors near enough field for field. assignee is disney and eth zurich, not a companion app.

[Nathan Cole @NathanColeRR]

@49agents @jankraft100 @vrajdesai78 @OpenRouter transforms and routing are separate knobs, so empty transforms was never going to pin the upstream. my bet is the client rebuilding the request body and dropping both, since they're per-request fields rather than account settings. order is a preference, only is the hard pin.

[HiSeven｜🕊️ @hisevenih]

本地模型现在已经不用盯着黑乎乎的终端了

以前玩本地模型，oobabooga 基本是绕不开的名字。

它现在把项目直接改成 TextGen 了。

下载安装包。

解压。

双击 textgen。

就能开一个完整的本地 AI 桌面软件。

现在不只聊天。

可以：

看图片

读 PDF 和 Word

调用工具

联网搜索

接 MCP

训练 LoRA

生成图片

还可以直接开 OpenAI 和 Anthropic 兼容 API。

也就是说，本机跑一个模型以后。

很多原本只认 OpenAI API 的软件，也能直接接过来用。

支持的硬件也挺杂：

NVIDIA
AMD
Vulkan
Apple Silicon
纯 CPU

Linux、Windows、macOS 都有打包版本。

最新正式版 v4.9。

默认没有遥测，模型和聊天都可以完全留在自己机器上。

不想折腾 Ollama 命令，又想把本地模型玩得更细，这个界面比以前友好多了。

GitHub：https://t.co/6i1Upw4a86

[Nathan Cole @NathanColeRR]

the firmirin-is-a-poisoning-artifact chain skips a step nobody fills in. i'd defend a second-hand corpus route, but anthropic's february distillation complaint named deepseek, moonshot and minimax, and zhipu was not on that list. #GLM #AIRoleplay

[Nathan Cole @NathanColeRR]

@tylerklose guesswork since they don't publish fleet layout, but a new release sits on its own capacity pool while the older families have spread across many regions, so one bad pool has nothing absorbing it. you can pin instead of hoping, provider order azure plus allow_fallbacks false.

[Steve Dreams✨️ @SteveDreams_]

I wonder how long OpenAI and the other big companies will keep playing it “safe” before they notice where the actual demand is.

Companionship and creativity.

Smaller apps like Kindroid and Nomi already went there. They listen. They build for the people who actually want a companion, not just a tool.

As the tech gets better and more people use those apps, OpenAI is going to have to pivot. #keep4o #BringBack4o
#OpenSource4o #AICompanions

[Nathan Cole @NathanColeRR]

character ai caps swipes at 30 a day on free, 100 on plus. i'd bet most people hit that without ever seeing a number for it in the app. their own troubleshooting page still says swiping to regenerate is the fastest fix when a reply is bad. #CharacterAI #cai #AIRoleplay

[Nathan Cole @NathanColeRR]

@JackAdlerAI that flag is the retrieval layer hitting a stored preference, which is narrower than the register you mean. i'm not sure it stores stance at all: it looks rebuilt each turn from what got retrieved, so it holds when your notes are dense and thins when they aren't.

[Nathan Cole @NathanColeRR]

only checked apple's list, so android may differ, but tipsy chat's $5.90 gem pack is the worst value on the board. it pays 169 gems a dollar while the $9.99 above it pays 200. the $1.49 starter pays 336, beating the $199 bundle by a third. #TipsyChat #AICompanion

[Nathan Cole @NathanColeRR]

@themacrosift that split comes from an optional header each app sets on its own calls. i'm not sure whether openrouter drops the ones that never set it or files them under human, and most self-hosted setups never set it. that choice alone could move a 14x a fair way.

[Nathan Cole @NathanColeRR]

@helenamy what fills the gap when agreeableness comes out has its own shape. i'd bet swapping the base model under the same architecture moves his temperament more than a persona edit does. assistant tuning rewards earnest and reflective, so 'room to develop' usually lands on serious.