As Apple Intelligence is rolling out to our beta users today, we are proud to present a technical report on our Foundation Language Models that power these features on devices and cloud: https://t.co/TaAdd0fBOp. 🧵
My team at @dashlane is looking for a Javascript Software Engineer (https://t.co/MK99Cvdvj4 ) and a Software Engineer Intern, Machine Learning (https://t.co/dTbmPYDAZp)
If you like low-level web development, ML engineering and research, this position may be for you!
Copilot's model aka Codex from OpenAI: another huge language model trained on a huge dataset, without specific preprocessing. Impressive results for sure, but probably tricky to embed in real-time applications. https://t.co/hUiaRMH7fK
TIL in this paper how encoding matrices can be used into Transformers: in the self-attention layer. Overall it interestingly demonstrates how possible it is to combine the two most trendy architectures at the moment: GNNs and Transformers!
Transformer is a GOOD graph learner when incorporating suitable graph structural information!
Thrilled to share our new work:
Transformer + simple but effective encodings = GNN achieving new SOTA on OGB datasets, ZINC!
Paper: https://t.co/5r9mv6vRWq
Code: https://t.co/GhKbwUSMxs
I always ***dumbly*** think of docker-containerizing my Python models as the final, simplest, and fastest step of my job. And every time, I tell myself "at least I learned something today". Sure.
"Que vient faire le machine learning dans un logiciel de mot de passe ?" Enfin une explication claire, bravo @glazou ! @dashlane (2:00-10:00) https://t.co/stjDXOgqIr
DBSCAN is a great algorithm for geo clustering. Using the Haversine distance and lat/lon coordinates, it yields consistent clusters. In this article, I introduce a way to integrate more features into the geo clustering process.
https://t.co/dOpwEeTCBs
@GygliMichael I have been reading a lot about Video Summarization recently and it seems to me me that you pioneered the task. To your mind, what's the current state of the art method? Supervised? Unsupervised?