@theo I believe you know how LLMs work under the hood, so I donโt think itโs insane. On the contrary, Iโm amazed when it can format diagrams so well.
See this:
https://t.co/rrLGgPXn1g
How are LLMs are able to generate perfectly aligned ASCII diagrams/tables if they're only focused on the next token (and not seeing all lines at once)? What's the technical explanation of this?
@mntruell I would like a way for users to control the context window to some extent. Obviously, the agent manages it dynamically, but for advanced users, it would be helpful to have more control, especially when the agent might include information in the context that is not relevant.
@leerob@ericzakariasson Thanks for the clarification! I did notice a difference in token usage in the usage summary when files are open vs when I close them all, so that second point you mentioned likely explains it. Appreciate it ๐
Is there any way to disable adding open files to the context in Cursor? Most of the time I have many files open, and I feel like this pollutes the context window. @ericzakariasson@leerob
@simonw Fine-tuning small models as โhumanizersโ can drop AI detection scores a lot. Prompting just simplifies, but fine-tuning can rewrite text without losing quality of text. Great for marketing or emails but arguably bad for academia since it can blur authorship and integrity.
@AravSrinivas Not an issue but would be awesome if Perplexity streaming answers showed up right in Spotlight when you hit Cmd+Shift+P (similar to HuggingChat). No need to open the app, just stay in flow. I use the Raycast extension as a workaround for now.