Maso

元数学者もどき。機械学習に片思い。

[Maso @Masomatics]

推してる友人もついこないだデカい資金ゲットしたばかりなのでなおさらテンションあがる

[Maso @Masomatics]

メンターしてた学生が大きな奨学金受かってテンションアゲアゲ
選考委員会の皆様は彼の未来価値を理解していただき本当にありがとうございました。御礼申し上げます。

[Maso @Masomatics]

湖池屋さんは今すぐベトナムに協力を仰いでkhô gà lá chanhの日本版をチキムーチョかなんかの名前で商品開発して欲しい

https://t.co/q0pTT3N5g1

[Computer Graphics Papers @Animation]

Neural Isometries: Taming Transformations for Equivariant ML. https://t.co/JO1ALb2q7O

[Maso @Masomatics]

On Wed 8 May at ICLR2024, we will be presenting the recent work of Neural Fourier Transform, a general approach of equivariance/symmetry learning that naturally extends the classic Fourier transform. Please drop by to check it out! https://t.co/u2x9ZZTuQC

[Maso @Masomatics]

@Kyoto_1192 ここは日本で一番うまいラーメンです。自分も再開店情報を心待ちにしています。

[Yann LeCun @ylecun]

Modeling the world for action by generating pixel is as wasteful and doomed to failure as the largely-abandoned idea of "analysis by synthesis".

Decades ago, there was a big debate in ML about the relative advantages of generative methods vs discriminative methods for classification.
Learning theorists, such as Vapnik, argued against generative methods, pointing out that training a generative modeling was a way more difficult than classification (from the sample complexity standpoint).

Regardless, a whole community in computer vision was arguing that recognition should work by generating pixels from explanatory latent variables. At inference time, one would infer the configuration of latent variables that generated the observed pixels.
The inference method would use optimization: e.g. use a 3D model of an object and try to find the pose parameters that reproduce the image.
This never quite worked, and it was very slow.

Later, some people converted to the Bayesian religion and tried to use Bayesian inference for the latent (e.g. using variational approximations and/or sampling).
At some point, when Non-Parametric Bayes and Latent Dirichlet Allocation became the rage in text modeling, some folks heroically attempted to apply that to object recognition from images.
>>> THIS WAS A COMPLETE AND UTTER FAILURE <<<

If your goal is to train a world model for recognition or planning, using pixel-level prediction is a terrible idea.

Generation happens to work for text because text is discrete with a finite number of symbols. Dealing with uncertainty in the prediction is easy in such settings. Dealing with prediction uncertainty in high-dimension continuous sensory inputs is simply intractable.
That's why generative models for sensory inputs are doomed to failure.

[Maso @Masomatics]

@_onionesque Excited to know that there are people looking at similar things!
https://t.co/iYWLbeTxqW

[Maso @Masomatics]

ギックリ腰になった
チョコラータのグリーンディに攻撃を受けているような状態(下に下がれない

[Maso @Masomatics]

It is my wish that it will illuminate a path toward a new direction of fun for the Symmetry learning in ML.

[Maso @Masomatics]

Ever got frustrated by the fact that most application/theory of Symmetry in ML are built on "linear action" on data?
We just recently released a new preprint to rethink the equivariance learning by establishing the "Neural" extension of Fourier Transform. https://t.co/u2x9ZZSX14

[Maso @Masomatics]

By extending our scopes from "action on a single data instance" to "action on a function on the entire data space", we can extend the theory of FT and equivariance learning to the cases involving nonlinear actions, such as nonlinearly deformed shift or Object rendering, etc

[Maso @Masomatics]

Ever got frustrated by the fact that most application/theory of Symmetry in ML are built on "linear action" on data?
We just recently released a new preprint to rethink the equivariance learning by establishing the "Neural" extension of Fourier Transform. https://t.co/u2x9ZZSX14

[Stat.ML Papers @StatMLPapers]

Neural Fourier Transform: A General Approach to Equivariant Representation Learning. (arXiv:2305.18484v1 [https://t.co/zjV5HgYw5a]) https://t.co/AbQ1FlgHsR

[Maso @Masomatics]

For some reason my wife, not being so familiar with English names, thought that the person I strive to be is Mike "Ty"son. Not that it makes so much difference to me in terms of sheer Badassness, but I wonder how "Orri"son became "Ty"son in her mind LOL

[Maso @Masomatics]

@sakurako_iroha これ死ぬほどわかります　「ほっとくと妻にやらせてしまう」という動機「のみ」が自分の家事行動を動かしてる

[Maso @Masomatics]

@kyfwfw そうか���、、Consciousnessとかされてる方なんですね！！SNN使ったことないですが博士時代はPoisson Processずっとやっていたので益々ご縁感じます！　

MSNに飛ぶ機会は多分暫くないですね、、、まだ東京中心になりそうです
脳といえば、ポスドク時代は京大の石井信先生には大変お世話になりました。

[Maso @Masomatics]

@kyfwfw 同じ小山でPhDで同じMadisonとは、、、懐かしいです。。。自分は凍傷になりかけました。