Colin Popell

BI, PM, AI: job hunting. Dad. Math and controls dilettante, Great Books reader; lifter, dancer, (novice) shooter. Ex- @MSPowerQuery

[Colin Popell @cpopell]

I wrote about my experiments with embedding on json documents - not embedding a field IN a document, but the document as a whole! And, more than that, how I ended up doing what I call 'agentic propositional flattening', though I'm not 'done' yet.

Link below.

[Colin Popell @cpopell]

@BenjaminAKohler That's not a problem, I'm fairly certain I'm close to at least the deadlift of any two of these three put together.

[Colin Popell @cpopell]

@zetalyrae @msimoni

[Colin Popell @cpopell]

@zetalyrae @msimoni There's a lot of similarity here with how I've been approaching memory systems for LLMs (not coding tools). 'Folders' are, basically, just another document type.

[Colin Popell @cpopell]

@Steve_Yegge Hi Steve! I've been working on something that has some parallel evolution in architectural features NOT for coding the last few months; I'd love to chat about some of your architectural choices.

[Colin Popell @cpopell]

@natanielruizg @francoisfleuret There's a lot of technical/application level problems to solve here, and they're not about the 'game'.

I think I've solved most of them, though I'm still tuning. Going into testing now.

Happy to give private demos.

[Colin Popell @cpopell]

@Westoncb I implemented this in my LLM memory management platform. All memory changes can be rolled backwards or forwards.

[Colin Popell @cpopell]

you can just do things (browsable recursive summarizers. not done)

[Colin Popell @cpopell]

@levie I have built memory portability of a sort. A state manager that is LLM API agnostic. I'd be more than happy to show it off if you're curious - not quite at release yet.

[Colin Popell @cpopell]

@yacinelearning @yacineMTB (I made an autoplay but this of course is a self-reflective problem, hopefully once I start getting subscriptions I will have more $ to throw at the problem)

[Colin Popell @cpopell]

@yacinelearning @yacineMTB I think I can make a case I have made reasonable progress on it but one of the problems is that testing long context requires going through a lot of tedious generation

[Colin Popell @cpopell]

@xlr8harder as a hint, think about how you can give it some other bits of entropy to play off of

[Colin Popell @cpopell]

@xlr8harder As someone who has generated many, many names at this point

I can confirm it loves Elara Voss. But you can get out of it if you step outside standard genres into more precise ones. There's also some tricks to kick out of the rut.

[Colin Popell @cpopell]

@RandomSprint @DavidSHolz Thanks! Yeah, I'm...almost done with a state management platform, that I have co-developed what is more or less a text RPG on top of. Could fairly easily drop in place a diffusion model, but I'm not sure that 'training' is quite within my skillset. Happy to discuss though!

[Colin Popell @cpopell]

@levie This has been most of my focus for the last four months. Figuring out and then building a state management platform. You need to give clear mechanisms to retrieve data, but you also need both clear mechanisms AND guiderails for updating data, with schema generated validators.

[Colin Popell @cpopell]

@omarsar0 https://t.co/7EZzoNxnId

[Colin Popell @cpopell]

Semantic search
Lexical search
Faceted search
Graph traversal

What other methods of efficient context retrieval do you use?

[Colin Popell @cpopell]

@omarsar0 Context management is, I think the SINGLE MOST important thing for any app, not just coding apps, to handle. I've got 4-5 different methods for retrieving and blending context.

[Colin Popell @cpopell]

@Duderichy When are you going to introduce her?

[Colin Popell @cpopell]

one of my more expensive API days

[Colin Popell @cpopell]

@aidenybai The question is: What is the overall legacy you want to leave in the world?