Ajay Chintala

Founder in Residence, Gen AI @Coursera. Co-founder & CTO @trypromptly. Previously @Meta/@WhatsApp

[Ajay Chintala @ajhai]

@yoheinakajima 👋

[Ajay Chintala @ajhai]

@elonmusk doesn't matter if their inflight access points are still crappy

[Ajay Chintala @ajhai]

@pitdesi Apparently if you fold your mirrors and get it to park, it does a better job.

Set it to auto fold mirrors as it reaches your garage and try.

[Ajay Chintala @ajhai]

@Austen Pretty soon!

https://t.co/AMdlUYETcP

[Ajay Chintala @ajhai]

Hello world, meet Anna – our first prototype of an affordable, general-purpose household robot 🤖

It uses a combination of LLMs, VLMs, and VLAs to understand language, perceive surroundings, and automate 🏠 chores seamlessly.

We chose the wheeled form factor over bipedal for its simple yet functional design. For the first generation embodied AI in homes, we believe this form factor wil be friendly and less intimidating than the alternatives.

A simpler design also helps with our goal of making these robots affordable. We are hoping to ship these devices for under $5k

In the coming weeks, we will share an updated prototype that will be closer to our production design and includes vertical movement that is critical for most household chores.

⬇️ is a quick demo of Anna, responding to voice and handing tasks end to end

[Ajay Chintala @ajhai]

@adityaag Can you share the investor's perspective?

[Ajay Chintala @ajhai]

@hthieblot Affordable robot for household chores..

Can use a lab better equipped than my garage 😂

[Ajay Chintala @ajhai]

Hello world, meet Anna – our first prototype of an affordable, general-purpose household robot 🤖

It uses a combination of LLMs, VLMs, and VLAs to understand language, perceive surroundings, and automate 🏠 chores seamlessly.

We chose the wheeled form factor over bipedal for its simple yet functional design. For the first generation embodied AI in homes, we believe this form factor wil be friendly and less intimidating than the alternatives.

A simpler design also helps with our goal of making these robots affordable. We are hoping to ship these devices for under $5k

In the coming weeks, we will share an updated prototype that will be closer to our production design and includes vertical movement that is critical for most household chores.

⬇️ is a quick demo of Anna, responding to voice and handing tasks end to end

[Ajay Chintala @ajhai]

Robots that generalize to the real world need lots of diverse training data to build robust models. But collecting that data is a huge challenge.

That’s why we built TeleOp-XR: an open system to teleoperate robots in Augmented Reality! 🤖✨

A quick demo and instructions 🧵⬇️

[Robert Scoble @Scobleizer]

What did I say earlier?

Glasses (Holodecks) and robots go together like peanut butter and jelly.

[Ajay Chintala @ajhai]

Ready to collect better data for your robots?

- Clone the repo from https://t.co/cY0AoZ47tQ
- Add your robot config
- Start teleoperating and recording in AR

Towards generalizable robots—one episode at a time! 🚀

[Ajay Chintala @ajhai]

Robots that generalize to the real world need lots of diverse training data to build robust models. But collecting that data is a huge challenge.

That’s why we built TeleOp-XR: an open system to teleoperate robots in Augmented Reality! 🤖✨

A quick demo and instructions 🧵⬇️

[Ajay Chintala @ajhai]

TeleOp-XR is modular:

- Support new robots by editing a config file
- Define custom AR menus for your tasks and bind them to actions in the backend
- Plugin-like architecture to easily support new robot backends

[Ajay Chintala @ajhai]

@pthangeda_ @chris_j_paxton We built something similar for data collection at Vexa.. plan to clean it up a bit and open source it later this week... It should work out of the box with @LeRobotHF and can be extended for others

[Ajay Chintala @ajhai]

@deliprao Tells more about Siri than vision pro?

[Ajay Chintala @ajhai]

@hubermanlab @NIH @CDCgov Is it possible let the public directly fund the research? Maybe a crowd source platform similar to Kickstarter and then alllow the donors claim some tax benefits.. that way we can hopefully make the system more efficient

[Ajay Chintala @ajhai]

Great job @neka_nat 👏

cc: @FreeCADNews

[Ajay Chintala @ajhai]

Just started writing an MCP server for FreeCAD and thought I will do a quick search before going too far

Aaand yes, looks like someone just wrote one

https://t.co/jQnu1SNDma

[Kenta Tanaka | WillRobotics | Physical AI @neka_nat]

MCPの理解を深めるためにFreeCADと接続するMCPサーバー作ってみた。
1回の指示で簡単なフランジの3Dモデルが作れる。
適当に関数作ってもclaudeがそこそこ理解してくれるのすごいな。

[Ajay Chintala @ajhai]

https://t.co/lPkjAPqUBk

[Ajay Chintala @ajhai]

NVIDIA GROOT N1 model is already available on HF 🤗

Looks like the 🔗 is broken in the announcement page. Correct url in the reply

[The Humanoid Hub @TheHumanoidHub]

NVIDIA announced GR00T N1, the first fully customizable open-source humanoid robot foundation model, designed to advance general-purpose robotics.

⦿ A dual-system AI inspired by human cognition: System-1 handles fast, intuitive actions, while System-2 enables methodical decision-making. System-1 is trained on human demonstration data and a massive amount of synthetic data.

⦿ GR00T N1 can easily generalize across common tasks - such as grasping, moving objects with one or both arms, and transferring items from one arm to another - or perform multistep tasks that require long context and combinations of general skills.

⦿ CEO of 1X: "With a minimal amount of post-training data, we were able to fully deploy on NEO Gamma - furthering our mission of creating robots that are not tools, but companions that can assist humans in meaningful, immeasurable ways."

⦿ Early adopters also include Agility Robotics, Boston Dynamics, Mentee Robotics, and NEURA Robotics.

[Ajay Chintala @ajhai]

@TheHumanoidHub And the model is available at https://t.co/lPkjAPqUBk

[Ajay Chintala @ajhai]

@TheHumanoidHub This is similar to the architecture put out by Figure as part of Helix as well as to what we have been building at Vexa