Top Tweets for #ContinueLearning

4 months ago

关于持续学习的思考开环只有反射，闭环才有学习：事实要变成记忆，记忆要变成假设，假设要反过来改变行动。缺一环，都不是学习。facts become memory, memory become hypotheses, and hypotheses change action. "Be Water, My Friend" #brucelee #RSI #continuelearning #AGI

Qingyao Ai

@QingyaoAi

4 months ago

Razvan Pascanu argued that compositionality is important for #ContinueLearning, #ICML2026 . This aligns with our idea of parametric retrieval augmented generation (PRAG) that external knowledge should be injected into LLMs as composable modules so that LLMs can continually learn by accumulating and utilizing external knowledge/memory. Then, a key problem is how to construct effective structure and algorithms to compose multiple knowledge modules. We have tried a couple of methods, check out our recent papers on PRAG: 1. Parametric Retrieval Augmented Generation: https://t.co/C0xt40W2fS 2. Retrievable Gradients: Continual Post-Training Without Cumulative Weight Drift: https://t.co/LGPrM2T0DU 3. Decoupled Mixture-of-Experts for Parametric Knowledge Injection: https://t.co/FatSh1phq3 4. Decoupling Knowledge and Task Subspaces for Composable Parametric Retrieval Augmented Generation: https://t.co/jZhQ4iHzFv

QingyaoAi's tweet photo. Razvan Pascanu argued that compositionality is important for #ContinueLearning, #ICML2026 . This aligns with our idea of parametric retrieval augmented generation (PRAG) that external knowledge should be injected into LLMs as composable modules so that LLMs can continually learn by accumulating and utilizing external knowledge/memory. Then, a key problem is how to construct effective structure and algorithms to compose multiple knowledge modules. We have tried a couple of methods, check out our recent papers on PRAG:

1. Parametric Retrieval Augmented Generation: https://t.co/C0xt40W2fS
2. Retrievable Gradients: Continual Post-Training Without Cumulative Weight Drift: https://t.co/LGPrM2T0DU
3. Decoupled Mixture-of-Experts for Parametric Knowledge Injection: https://t.co/FatSh1phq3
4. Decoupling Knowledge and Task Subspaces for Composable Parametric Retrieval Augmented Generation: https://t.co/jZhQ4iHzFv

586

Top Tweets for #ContinueLearning

Last Seen Hashtags on Sotwe

Trends for you

Most Popular Users