🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪

From Jeddah to Lübeck, from KAU to UzL.. I wonder what more surprises I'll meet in the future

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh بهذي اتفق معاك 🫱🏻‍🫲🏾

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh أنا شخص مذنب بالموضوع هذا، بس أنا أشاركهم الاخبار الحلوة وبعض المشاكل بس مش من باب التشكي، من باب المحادث واحيانا استشارة واخذ بخبراتهم
أنا معاك انه لازم ما توصل لهم بس مشاكل وتقلقهم ، بس كمان العمل جزء من حياتك ولا ارى انه خطا مشاركتهم فيه 🤔

[Thief @Thief]

Welcome, young Garrett.

[John Carmack @ID_AA_Carmack]

Paper review:
You Don’t Need Strong Assumptions: Visual Representation Learning via Temporal Differences
https://t.co/w4zUfV0ZkX
https://t.co/ji2imtMQNv
@AlexiGlad @ninaddaithankar

The premise is that the more data you can use, the fewer inductive biases you should have. Starting with strong priors is helpful with limited data, but eventually, architectural priors will hinder learning true knowledge buried in sufficiently large datasets. That sounds correct.

Concretely, the ad hoc image cropping / masking / augmentations used in self supervised representation learning all make assumptions about what is important in the images, and appendix A gives examples where they can be harmful.

Figure 3 looks very compelling for this argument, but if you notice that the X axis is log scale, it is sketchier; the anchoring values on the left are relative values from experiments on 0.1% of Imagenet, which I would expect to be quite high variance.

Instead of making multiple augmentations of an image for self supervision, this work uses sequential video frames as related image pairs for representation learning. They train two separate models: a frame encoder, and a “motion encoder” that takes the RGB subtraction between the sequential video frames to produce a delta vector. The models are jointly trained so that the first frame’s representation vector, added to the delta vector, will equal the second frame’s representation vector.

They use a fairly substantial 0.25 second stride between images in the pair, noting that too small of a stride results in near-zero differences in slow moving scenes, while too large of a stride gives incoherent pixel jumps.

It looks to me like the model should be stride independent, and they could simultaneously train on many different strides, increasing the dataset diversity.

I don’t like the DINO EMA teacher approach for avoiding collapse, I think SigReg would have been more direct.

The LeWorldModel work uses sequential video frames and SigReg, but it just minimizes latent distances between neighboring frames; you really want to predict (the ‘P’ in JEPA) from one latent to the next. Linear extrapolation based on the previous frame kind of works, but some level of conditioning on the current latent should be better.

Still, I’m unsure about the soundness of using frame subtraction to create the delta, since it has both frames entangled in it, so it really isn’t doing any kind of causal prediction. The architectural prior here is “only represent things that can be disentangled from a delta frame”, and I’m not sure that is universally valuable.

In their limitations section, they note that scaling to larger video datasets did not help their performance, but they expect better datasets and hyperparameter tuning will.

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh الناس فقدت ثقتها بالدكاترة لعددت أسباب من أهمها التامين ، وصار عندهم انطباع اي شي يطلبه منك الطبيب عشان دفع التامين مش عشان مصلحة المريض.
فلما يجيك شخص بالسوشل يقول لك عندي لك الحل ، وببلاش ، ومن غير ما تستخدم دواء، بيصروا الناس تنجذب لهم.

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh الولد هذا نااااااااااار 🔥🔥🔥

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@Kalsatti I’m good! Life is going well, How have you been?

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh صديق رهيب ١٠/١٠

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh … you will find someone to say
" الحمدلله الذي عافانا مما ابتلى به كثير من خلقه "

At least how I dealt with the dark days of my PhD
It wasn’t easy, but it was the only way to move forward that I could find without troubling anyone with my issues

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh Joe rogan had an amazing saying “ the worse thing that happened to you is the worse thing that happened to you”
I might be a bit grim saying this, but sometimes you need to put your issues in perspective of other issues. Same as you would always find someone to envy…

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

I had a very productive meeting with Sen. Kirsten Gillibrand team at @IEEEUSA’s Congressional Visits Day! @gillibrandny #IEEEUSACVD

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

I had a very productive meeting with Sen. Chuck Schumer @SenSchumer team at @IEEEUSA’s Congressional Visits Day! @SenSchumer #IEEEUSACVD

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

I had a very productive meeting with Rep. Dan Goldman team at @IEEEUSA’s Congressional Visits Day! @RepDanGoldman #IEEEUSACVD

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh عشان هيك أنا صحبك عشان تقتدي فيي 😂🤣

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

Do you remember when you joined X? I do! #MyXAnniversary
Twitter was my go to for jokes posts. Now I avoid it because of all the political shit.
But still, I have a 13 years eX 🤭

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh أنا حاليا أتسحر ، اصلي الفجر الساعة ٥:٤٠ واتوجه للدوام
بصراحة السنة هذي جدولي برمضان افضل بكثير من زمان لما كنت انام بعد السحور

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh

[🇺🇸🇱🇧Ezzat Elmo🇸🇦🇩🇪 @EzzatElmo]

@saint_saleh