Aryan Mikaeili

Multiplying matrices

[Aryan Mikaeili @AryanMikaeili]

@PolaczekSagi We had (not so conclusive) experiments with WAN 2.1. With the temporal dimension, attention sharing transfers also a bit of the reference motion

[Aryan Mikaeili @AryanMikaeili]

Shared attention is a powerful way to transfer style in diffusion models: let tokens attend to a reference image, and the model can pick up stylistic cues.
⚠️ But in RoPE-based DiTs, this often breaks badly.
Instead of transferring style, the model starts copying the reference content.
In this work, Untwisting RoPE, we explore how positional bias and semantic understanding become twisted together in DiTs, and how frequency control can untwist them.

[Aryan Mikaeili @AryanMikaeili]

✨ The result is style-aligned generation without copying the reference content.
More broadly, this paper shows that positional encodings are not just passive ordering; they actively shape how attention behaves.
By analyzing RoPE’s frequency structure, we can untwist positional bias and semantics and get a simple and controllable way to steer attention without retraining or architectural changes.
Joint work with @OPatashnik, @taiyasaki, @DanielCohenOr1, and @arash_mham.

Project Page: https://t.co/1GZHxbPsC5

[Aryan Mikaeili @AryanMikaeili]

🛠️ Our solution is to modulate RoPE by frequency.
We attenuate the high-frequency components that over-enforce locality, and amplify the low-frequency ones that better support global semantic correspondence.
We do this smoothly across the RoPE spectrum.
This gives us a direct handle on the balance between positional bias and semantic alignment.

[Amir Alimohammadi @amirhossein_alm]

Tomorrow! 📢 Catch our SIGGRAPH presentation at 10:45 AM in the Deep Image Editing session (Room 118-120).

[Amir Alimohammadi @amirhossein_alm]

[1/6] Excited to share that our new work, Cora, has been accepted to SIGGRAPH!
🚀We improve fast image editing by leveraging semantic correspondences.
🖌️Cora also gives users flexibility in deciding what to keep or change from the input.
webpage: https://t.co/k1PkqHgeWU

[Aryan Mikaeili @AryanMikaeili]

@CoRa_ZoNN @papalcapa 😂😂😂😂

[Aryan Mikaeili @AryanMikaeili]

@CoRa_ZoNN سید ید الله فوق ایدیهم خیره ایشالله

[Aryan Mikaeili @AryanMikaeili]

If you see this tweet, you have to mention one of your favorite paintings

The Return by Arnold Böcklin, 1887

[Felix @CoRa_ZoNN]

If you see this tweet, you have to mention one of your favorite paintings

Fallen Angel by Alexandre Cabanel, 1868

[Arash (Ali) Mahdavi Amiri @arash_mham]

If you like an ornament, part, or concept on an object, you likely want to generate more objects having the same concept or transfer that to another object. For this task, we introduce CLiC which learns a token "in context":

https://t.co/nFl7ydQ6m2

[Hichkas @HichkasOfficial]

#MohammadMehdiKarami is reportedly in immediate danger of execution by the Islamic Republic in a few hours.

The world MUST ACT NOW.

#MahsaAmini

[داریوش معمار @darushmemar]

واکنش مادر #محسن_شکاری به اعدام او در کوچه، کمر هر انسان با شرفی را می شکند.
شما که در خصوص بازداشت، زندان و شکنجه فرزندتان از سوی جمهوری اسلامی به امید آزادی او سکوت کرده اید، ببینید و در مورد وضع آنها اطلاع رسانی کنید.
#مهسا_امینی

[رسول @mrasoulghasemim]

#فاطمه_ناصر_رنجبر ورودی ۹۶ شریف چند هفته پیش دستگیر شده و به خاطر تعلل در پروندش اعتصاب غذا کرده. تعلل در پرونده دقیقا یعنی زمان خریدن برای آزار و اذیت فرد به "بهانه‌"ی قانونی. اگر اعتصاب غذا کرده که صداش به گوش ملت برسه بیاید صداش باشیم.
#ریتوییت

[چت ژی‌پی‌تی @aaadibooo]

در ضمن کیرم تو بیت علی (الکساندر) رهبری, که تا دو ماه پیش، روزی سه تا آهنگ‌ واسه وطن و میهن میساخت الان جیکش در نمیاد. علی جون شاشیدم تو مدل وطن پرستیت.
......
#زن_زندگى_آزادى
#مهسا_امینی

[Miouchy beik @BeikeMiouch]

صدق الله العلی العظیم
#مهسا_امینی

[اِدی - Eddy @Omid_eD]

عزیز دلمون، #محمد_نوری بالاخره آزاد شد.

[Garry Kasparov @Kasparov63]

Say her name! #MahsaAmini!