@Object_Zero_ If we can multiply the clock speed by 200, then maybe we can reduce the transistor count and still gain performance. This might be an interesting short term approach
@giveashitnature Put a much finer grill over it and the mosquitos sit on the grill to lay eggs through it, and the young can't get out. No need for chemicals.
@haopeng_uiuc Given that the system prompt is simply tokens positioned between special tokens, does this explain why it is relatively easy to prompt inject a model to act contrary to its system prompt?
@giveashitnature If there is a fine mesh a couple of centimetres above the water. They lay eggs through the mesh but the young mosquitos can't get out. No need for chemicals.
@JGuaq@0xSero@huggingface If you run it yourself then the only tracking possible would be via tool calls, and someone would have noticed by now. Some censorship may be built in, but abliterated versions mostly fix that.
Maybe RAG could help even then, if it retrieved content addresses instead of content chunks. E.g. file path + line number. Kind of like "this vaguely reminds me of chapter 2 of X", and then you choose whether to re-read X. The file path would hopefully be sufficient to decide whether to re-read the content.
@svpino In one project I simply told it the source of truth is: 1. High level SPECS.md 2. The tests. I also said use TDD, and gpt-5.4 has been doing it pretty consistently.
@fjzeit When I get time I intend to do create my own harness in c# and to include some of the custom tool parsing tricks from hermes to make it work well with local models.