David Sobrín

PhD student at the University of León.
💻Software and robotics 🤖 GameDev 🎮
Robotics group at the University of León

[Grupo Robotica Universidad de León @RoboticaUnileon]

¡Tenemos nuevo doctor en el grupo! 🥳

Ayer nuestro compañero @miggsant defendió su tesis titulada "Generación de Comportamientos en Robots Autónomos mediante una Arquitectura Cognitiva Híbrida".

@unileon #Unileon #robotics #ROS

[Erik Natzke @Natzke]

♾️ Visual Learning 🧑‍🏫

If this is how I learned math I am certain I would have been far more engaged.

Now that I have the letters connected to the line I’m drawing, I’m trying to sort out default orientation.

#XR #AR #MixedReality #Quest3 #Math #Quaternion #Prototype

[T.Yamazaki @ZappyZappy7]

林冠を衝突を避けながら飛行し、密林をマッピングする自律飛行ドローン
https://t.co/3oNWiIrLyP

#drone #SLAM #RGBDsensor #autonomous #mapping #navigation #DigiForest

[Miguel Santamarta @miggsant]

Finally I get a Steam Deck to run #ROS2 and maybe play some games 😏

[Miguel Santamarta @miggsant]

Just a simple chatbot based on #LLM for #ROS2. It is controlled by a YASMIN state machine that uses #llamacpp + #whispercpp + #VITS.

[Miguel Santamarta @miggsant]

My repos:
- YASMIN: https://t.co/84DY10wYqv
- llama_ros (llama.cpp from @ggerganov for #ROS2): https://t.co/YmuIx78CD8
- whisper_ros (whisper.cpp from @ggerganov for #ROS2): https://t.co/6iPahjw3BC
- audio_common (my audio pkg for #ROS2 with the tts lib): https://t.co/XlGvhUHgsC

[OpenMoon @OpenMoonAI]

Engineering a small transformer

[Yu Su @ysu_nlp]

Introducing BioCLIP: A Vision Foundation Model for the Tree of Life https://t.co/39mNDUCFt2

A foundation model that strongly generalizes on the tree of life (2M+ species), outperforming OpenAI CLIP by 18% in zero-shot classification, and supports open-ended classification over almost the entire tree of life

What's the secrete ingredients?
> Data: we curate and release TreeOfLife-10M, the largest and most diverse ML-ready dataset of organism images to date. It contains 10.4M images for over 450K taxa, sourced from iNaturalist, BIOSCAN, and Encyclopedia of Life.
> Modeling: we creatively repurposes CLIP's multimodal contrastive learning objective for hierarchical image classification. The autoregressive language model naturally encodes the hierarchy of the tree of life taxonomy, which in turn bakes the hierarchical representation into the vision transformer encoder.

Key results
> Strong zero/few-shot classification for animals/plants/fungi, including rare species, outperforming CLIP by avg 16-18% absolute.
> T-sne visualization shows that BioCLIP's vision encoder has captued the fine-grained hierarchical structure of the tree of life
> BioCLIP is a kind of universal classifier for the tree of life. Just give it an organism image and it will likely find the correct species (among top 5)! But use it with caution; it's not perfect yet..

Final remarks
> AI for Science is really hard but extremely rewarding! It took us a ton of time (1+ year) and frustration trying to find a plausible way to integrate the tree of life taxonomy into foundation model training. But when the "Eureka!" moment came and the idea hit us (by the great @weilunchao) that CLIP's multimodal contrastive learning objective can be repurposed for that, everything just follows naturally. It was truly a moment of joy and excitement!
> BioCLIP is our first attempt at foundation models for biology, but it certainly won't be the last! There's so much more to do at the intersection of one of the oldest scientific disciplines and the young but thriving field of AI. Biological intelligence is the foundation for artificial intelligence, and artificial intelligence will in turn become the most important tool for us to unraval the mysteries of biological intelligence.

We are hiring postdocs and PhDs in the NSF @imageomics institute to explore this exciting field! Drop us an email. also happy to chat about it at #NeurIPS2023 with any of Tanya, @weilunchao, or me.

- paper: https://t.co/24DlLzMTJb
- project: https://t.co/39mNDUCFt2
- demo: https://t.co/YzNooBEbB3
- model: https://t.co/IM8NU6A16g
- data (TreeOfLife-10M): to be released on Hugging Face soon

joint work with the amazing @imageomics team: @samstevens6860 Lisa Wu, Matt Thompson, Elizabeth Campolongo @luke_ch_song @Carlyn2015 @donglixp @dahdulw Chuck Stewart, Tanya Berger-Wolf @weilunchao @ysu_nlp

[Grupo Robotica Universidad de León @RoboticaUnileon]

El Grupo de Robótica de @unileon en @StartupOle. Cada año se superan!!!

#StartupOle #CISIS #HAIS #SOCO #Salamanca

[Miguel Santamarta @miggsant]

It's alive

[Miguel Santamarta @miggsant]

A new robot has arrived at the lab, a Mini Pupper 2 from @LeggedRobot

[Grupo Robotica Universidad de León @RoboticaUnileon]

Hoy @amigueldiez ha presentado en El Filandón Hacker la auditoría de seguridad que le ha hecho a nuestro perrito Tuercas 🤖👏

[David Sobrín @davsobh]

Para los que me estáis siguiendo en esta cuenta a raíz de la novela

[David S. Hidalgo @DavidSH_WR]

Por aclarar el tema de mi otra cuenta. A parte de escribir soy estudiante de doctorado y trabajo en informática y róbotica, así que tengo otra cuenta dedicada a ello -> @davsobh
Pero si lo que os interesa son mis avances literarios esta es la cuenta adecuada.

[Massimo @Rainmaker1973]

Super agile and balanced, Direct Drive's Diablo is the world first wheeled-leg transformable robot powered by 6 direct-drive motors. An open development platform for custom controls & DIY

[read more: https://t.co/d9cWQ10H1C]

[José Miguel Guerrero @jm__guerrero]

Nuestro equipo necesitan apoyo para ganar el premio a mejor vídeo, darle a like y comentar!

Our Team need support to win the best video award, like and comment!

https://t.co/yBYfWRH1n6

@EIF_URJC @RoboticaSw_URJC @urjc

[Intelligent Robotics Lab URJC @IntellRobotLabs]

Integrantes de #Gentlebots, que están compitiendo estos días en Burdeos Francia

[Grupo Robotica Universidad de León @RoboticaUnileon]

Algunos de nuestros compañeros están esta semana en #RoboCup2023 junto a los chicos de las URJC. Mucha suerte chicos!!!🤖

[PAL Robotics @PALRobotics]

Day 2 at the @RoboCup2023 #competition! 🏆
Today, the teams are patiently working on their codes to make #TIAGoRobot perform the desired task.🧑‍💻
We are happy to be here to support the teams. 🤝
#robocup2023 #Robotics #research #TechnologyNews #Science

[PAL Robotics @PALRobotics]

Our teammate has arrived at the @RoboCup2023 competition. ✈️
It's so exciting to see so many of our TIAGo #robots in action - a total of seven and one TIAGo Base! 🤖
We are ready to support the teams and watch the best one win! 🏆
#RoboCup2023 #TIAGoRobot #Competition #technology