Top Tweets for #Transcoder
Find neurons (circuit tracing / #mechinterp of 'text reading' obsession) in #CLIP, new approach:
*SKIP*-#Transcoder.
This is looking good!
Replace MLP w/ TCODER -> ~same.
Finds Vision Transformer Layer 12 'text reading' just like SAE.
Hope it holds for <=10 >=17 layers! π€π€

#CLIP #ViT #Transcoder train 5k -> train 50k
Final layer cos sim πβ
Beginning disentanglement #cat vs. text "cat"π€β
ETA train full #ImageNet-1k: 15 days (min if skip val)
ETA ImageNet-21k: ...nvm. Should just throw code on github, hope somebody else trains & shares model.π

After about a dozen more #fails π€¦ββοΈ, this #CLIP #vision #transformer #transcoder is promising!π€
Expecting #fail, I trained it on 5k images. That's 5 images per ImageNet class π -> virtually nothing. And yet:
cos sim (vs CLIP CLS); #AI 'text opinion' of transcoder vec img embed

Last Seen Hashtags on Sotwe
mgai(************************************)(********************)()* +filter:native_video
Seen from Switzerland
Ψ³ΩΨ¨Ψ±_ΩΨ§ΩΩ
Seen from Algeria
torta #horny
Seen from United States
lunasilver
Seen from Oman
minichat((((*)))) t.co video
Seen from Turkey
fatman
Seen from Sweden
brosis
Seen from United States
snapchattt
Seen from Poland
ζε€§θΌηΉ‘ζ
Seen from United States
δΈθ‘
Seen from France
Most Popular Users

Elon Musk 
@elonmusk
240.5M followers

Barack Obama 
@barackobama
118.7M followers

Cristiano Ronaldo 
@cristiano
114.4M followers

Donald J. Trump 
@realdonaldtrump
111.8M followers

Narendra Modi 
@narendramodi
107M followers

Rihanna 
@rihanna
98.7M followers

NASA 
@nasa
92.2M followers

Justin Bieber 
@justinbieber
91.8M followers

KATY PERRY 
@katyperry
90M followers

Taylor Swift 
@taylorswift13
84M followers

Lady Gaga 
@ladygaga
75.5M followers

Virat Kohli 
@imvkohli
73.4M followers

Kim Kardashian 
@kimkardashian
70.8M followers

YouTube 
@youtube
68.7M followers

Neymar Jr 
@neymarjr
66.3M followers

Bill Gates 
@billgates
65.2M followers

Selena Gomez 
@selenagomez
63M followers

The Ellen Show
@theellenshow
62.1M followers

CNN 
@cnn
61.7M followers

X 
@x
60.6M followers
