Fine-grained subtask annotations improve VLA performance.
We trained a vision + proprioception model that’s now SOTA at generating them, generalizing across embodiments.
93.1 F1@50 on REASSEMBLE, 98.6 on @Amazon Robotics blade insertion. Details below 👇🧵
1/@Waymo's recent pothole mapping partnership with @waze is a great example of vehicles becoming infrastructure observers.
The next unlock is making this work beyond AV fleets with specialized sensor stacks.
With Nomadic, ordinary dash cam footage can become mapped road events: potholes, hazards, blocked lanes, damaged signs, and more.
The future of computer vision is agentic.
1/ We built Nomadic around a gap we kept seeing in video understanding: VLMs generate chain-of-thought that's fluent and often correct in structure, but weakly grounded in what's actually in the video.
This limitation shows up in cases like "rolling stops". Is the stop sign actually associated with the vehicle’s lane? Does the ego vehicle ever come to a full stop, or only decelerate?
At Pear SF Studio, 216 of the brightest AI founders are building the future—together, under one roof. It’s one of the highest concentrations of AI talent in a single physical space. More than a workspace, it’s a living hub of innovation, serendipity, and unstoppable ambition.
This is where the next generation of iconic companies is being born.🍐@pearvc
PearX Summer 2024
12/ NomadicML
Enterprise stack for optimizing compound AI systems
As enterprises increasingly adopt compound AI systems to achieve state-of-the-art results, they face exponential complexity in optimizing and maintaining these multi-component architectures. NomadicML enables ML devs to continuously validate and optimize performance across their entire compound AI stack.
After building heads down with my cofounders the past couple of months, I’m thrilled to finally introduce Animos to the world!
Current generative media is limited — short clips and inconsistencies hamper professional use. Animos breaks these barriers with an agentic approach that transforms simple prompts and multimodal inputs into fully customizable 3D animated videos.
For the first time ever, you can iterate on generated videos with precision —switch out characters, styles, backgrounds, and other details while fully maintaining creative freedom, control, and stylistic integrity— all at a fraction of the cost of current generative video tools.
Experience long-form compositional and consistent video generation like never before.
Join us in redefining animation technology! Email [email protected] to learn more or join our waitlist!
#GenerativeAI #animation #AI #generative
One of our key sources of human data is no longer fully “human"!
We estimate that 33-46% of crowd workers on MTurk used large language models (LLMs) in a text production task - which may increase as ChatGPT and the like become more popular and powerful.
https://t.co/SJfKjDM6gX
@Melterialsgal Congratulations Melissa!! If you can please implement a feature where an Apple Watch can sense mental health and suggest appropriate junk food to help, that’d be a wonderful ad. 🙏
ChatGPT is cool but I'm most impressed by how OpenAI is able to simultaneously serve a multi-billion parameter model to all the new users trying it out right now (including those coming from front page of HN). Kudos to whoever worked on the inference infra there
@Haiping2015 Hi Haiping, this is Mustafa from the https://t.co/gQpkF28aCR team at Microsoft. I'm trying to get in touch with you regarding the SciSharp.TensorFlow.Redist-GPU NuGet package. Feel free to message me through Twitter for contact info. Thanks!
Had a great time presenting my internship project from IBM Research at ACM Middleware '18 in Rennes, France! I owe my gratitude to my mentor Shripad and manager @canturkisci for all of their help and support!
Professor Michael Sandel talked about robust discourse and ethical decision-making during polarized times during @hgse#Askwith forum https://t.co/7t7iHy7KVP