Do you want to work with me and our amazing team?
Apply at https://t.co/qJVT8fLCbB
Stack: PyTorch, React, Next.js, TypeScript
#PyTorch#NextJS#AI#React#AIStartup
@giffmana FAIR was and continues to be an amazing place! However, being in one place for a long time (8 yrs for me) can eventually become its own good reason to move. Reinitialization and randomization are important in research life. (Any talk of publication quotas is pure nonsense.)
@gruntleme It's a wonderful illustration of a giant house spider! These friends visit me from time to time in the basement (where I work from home). They have a curious range: most of Europe, a small bit of the PNW around Seattle and Vancouver, BC, and another small bit of the Mid-Atlantic.
@karpathy@giffmana@PaulKRubenstein@endernewton@sainingxie The mismatch may be an issue (I don't know), but apparently it's not a catastrophe. End-to-end or partial fine-tuning may help compensate, if it is a problem. I also find it somewhat concerning and think it could be worth investigating.
@giffmana I agree about the use of nparams being slightly wrong here. Within the scope of the fig each "column" of points is comparable, but using flops on the x-axis would be more meaningful wrt scaling. (I actually complain about nparams as a complexity measure all the time...)
@giffmana@y_m_asano@endernewton@sainingxie Our bias is for det and seg transfer, rather than more cls results, so that's what we went with (lacking bandwidth for both). I do want to note the det and seg tables show IN1k sup baselines (not just self-sup). MAE (and BEiT) surpass IN1k sup convincingly, exciting to me!
@giffmana It's a bit buried in the caption of Table 3, but therein it says ViT-H is /14.
We debated the line-plot style and have diverging opinions of what looks nice ;).