In self attention, k, q, v all come from one sequence of tokens.
In cross attention k, v come from one and q from another sequence of tokens.
This another token can be from other modality or maybe from translated version of first token
#crossattention#attention#transformers
For sarvam arya -
For an agentic framework, I would really love to get something as dynamic as langgraph for building agents
@pratykumar@vivekrag@selfawareatom and @ everyone at sarvam ai
Trying out Indus -
Feels great, solves most of the things, thinking and searching helps a lot and loved it.
There are more improvements that can be made like an edit button, access to images and documents.
But this is great to start with
@pratykumar@vivekrag@selfawareatom 🇮🇳
कर्मण्येवाधिकारस्ते मा फलेषु कदाचन।
मा कर्मफलहेतुर्भूर्मा ते सङ्गोऽस्त्वकर्मणि॥
You have a right to perform your prescribed duty, but you are not entitled to the fruits of action. Never be motivated by the results of your actions, nor be attached to inaction.
- Shri Bhagavad Gita 🙏
@ankitatIIMA Yes, Temple ecosystem surely brings prosperity.
History of pune has been very vibrant.
Pune also has a 1000 year old jain mandir in Sus, Pune.
And some shiv temples in Pune also date back to 8th, 12th centuries back. Someshwar Mandir, Pashan, Pune is 1000 yrs old
Even though the contacts are saved on my device, the app is treating them as if they are not saved. Because of this, I am unable to see which of my contacts have joined Arattai.
@Arattai@svembu
@Arattai@svembu
Even though the contacts are saved on my device, the app is treating them as if they are not saved. Because of this, I am also unable to see which of my contacts have joined Arattai.