¡Tenemos nuevo doctor en el grupo! 🥳
Ayer nuestro compañero @miggsant defendió su tesis titulada "Generación de Comportamientos en Robots Autónomos mediante una Arquitectura Cognitiva Híbrida".
@unileon#Unileon#robotics#ROS
♾️ Visual Learning 🧑🏫
If this is how I learned math I am certain I would have been far more engaged.
Now that I have the letters connected to the line I’m drawing, I’m trying to sort out default orientation.
#XR#AR#MixedReality#Quest3#Math#Quaternion#Prototype
My repos:
- YASMIN: https://t.co/84DY10wYqv
- llama_ros (llama.cpp from @ggerganov for #ROS2): https://t.co/YmuIx78CD8
- whisper_ros (whisper.cpp from @ggerganov for #ROS2): https://t.co/6iPahjw3BC
- audio_common (my audio pkg for #ROS2 with the tts lib): https://t.co/XlGvhUHgsC
Introducing BioCLIP: A Vision Foundation Model for the Tree of Life https://t.co/39mNDUCFt2
A foundation model that strongly generalizes on the tree of life (2M+ species), outperforming OpenAI CLIP by 18% in zero-shot classification, and supports open-ended classification over almost the entire tree of life
What's the secrete ingredients?
> Data: we curate and release TreeOfLife-10M, the largest and most diverse ML-ready dataset of organism images to date. It contains 10.4M images for over 450K taxa, sourced from iNaturalist, BIOSCAN, and Encyclopedia of Life.
> Modeling: we creatively repurposes CLIP's multimodal contrastive learning objective for hierarchical image classification. The autoregressive language model naturally encodes the hierarchy of the tree of life taxonomy, which in turn bakes the hierarchical representation into the vision transformer encoder.
Key results
> Strong zero/few-shot classification for animals/plants/fungi, including rare species, outperforming CLIP by avg 16-18% absolute.
> T-sne visualization shows that BioCLIP's vision encoder has captued the fine-grained hierarchical structure of the tree of life
> BioCLIP is a kind of universal classifier for the tree of life. Just give it an organism image and it will likely find the correct species (among top 5)! But use it with caution; it's not perfect yet..
Final remarks
> AI for Science is really hard but extremely rewarding! It took us a ton of time (1+ year) and frustration trying to find a plausible way to integrate the tree of life taxonomy into foundation model training. But when the "Eureka!" moment came and the idea hit us (by the great @weilunchao) that CLIP's multimodal contrastive learning objective can be repurposed for that, everything just follows naturally. It was truly a moment of joy and excitement!
> BioCLIP is our first attempt at foundation models for biology, but it certainly won't be the last! There's so much more to do at the intersection of one of the oldest scientific disciplines and the young but thriving field of AI. Biological intelligence is the foundation for artificial intelligence, and artificial intelligence will in turn become the most important tool for us to unraval the mysteries of biological intelligence.
We are hiring postdocs and PhDs in the NSF @imageomics institute to explore this exciting field! Drop us an email. also happy to chat about it at #NeurIPS2023 with any of Tanya, @weilunchao, or me.
- paper: https://t.co/24DlLzMTJb
- project: https://t.co/39mNDUCFt2
- demo: https://t.co/YzNooBEbB3
- model: https://t.co/IM8NU6A16g
- data (TreeOfLife-10M): to be released on Hugging Face soon
joint work with the amazing @imageomics team: @samstevens6860 Lisa Wu, Matt Thompson, Elizabeth Campolongo @luke_ch_song@Carlyn2015@donglixp@dahdulw Chuck Stewart, Tanya Berger-Wolf @weilunchao@ysu_nlp
Por aclarar el tema de mi otra cuenta. A parte de escribir soy estudiante de doctorado y trabajo en informática y róbotica, así que tengo otra cuenta dedicada a ello -> @davsobh
Pero si lo que os interesa son mis avances literarios esta es la cuenta adecuada.
Super agile and balanced, Direct Drive's Diablo is the world first wheeled-leg transformable robot powered by 6 direct-drive motors. An open development platform for custom controls & DIY
[read more: https://t.co/d9cWQ10H1C]
Nuestro equipo necesitan apoyo para ganar el premio a mejor vídeo, darle a like y comentar!
Our Team need support to win the best video award, like and comment!
https://t.co/yBYfWRH1n6
@EIF_URJC@RoboticaSw_URJC@urjc
Our teammate has arrived at the @RoboCup2023 competition. ✈️
It's so exciting to see so many of our TIAGo #robots in action - a total of seven and one TIAGo Base! 🤖
We are ready to support the teams and watch the best one win! 🏆
#RoboCup2023#TIAGoRobot#Competition#technology