Andre Cleaver

Ph.D. Candidate at Tufts University
Mechanical Engineering: Human-Robot Interaction
Fellow

[Black in Robotics @BlackInRobotics]

#BlackInRobotics Summer workshop series on ZOOM and EventBrite coming soon! Stay Tuned.

[Andre Cleaver @AndreCleaver]

Created a path creator in AR for robot navigation! A user spawns waypoints at desired locations and can modify the path's shape. A digital twin can simulate the navigation path before actual execution. #AugmentedReality #Robotics #digitaltwin #unity #vuforia

[Unity for Digital Twins @DigitalTwin]

Their last name's Cleaver but maybe it should be "clever" 😉
@AndreCleaver showing us a fantastic use case for #AR and #robotics 😍

[Andre Cleaver @AndreCleaver]

@DigitalTwin Thanks! 😂

[Andre Cleaver @AndreCleaver]

Finally controlling Spot with Hololens2 using hand gestures!!! 😃 #Spot #Robots #Robotics #BostonDynamics #Hololens2 #Unity #HumanRobotInteraction #HRI #HCI #mixedreality #ROS #Gradlife

[Andre Cleaver @AndreCleaver]

@DigitalTwin Thanks!!! 😁

[Andre Cleaver @AndreCleaver]

Guiding a robotic arm with an interactive virtual marker and visualizing the resulting planned trajectory in augmented reality and finally executing the action through a verbal command! #AugmentedReality #AR #MixedReality #HRI #HCI #unity3d #ROS #hololens2 #robotics #kinova

[Andre Cleaver @AndreCleaver]

Robotics with Augmented Reality! Here's a more proper video of my project😅Added visual feedback to the target goal pose with a safety zone barrier. Github repo,
https://t.co/NesBLSO7jl
#AugmentedReality #AR #MixedReality #HRI #HCI #unity3d #ROS #hololens2 #robotics #kinova

[Andre Cleaver @AndreCleaver]

@admercs @Scobleizer Yeah! A project I am currently working on is exploring how AR can help people teach a robot a task. Potentially visualizing the trajectory the robot thinks it should take while the user can make corrections by interacting with the virtual waypoint markers for adjustments 😁

[Andre Cleaver @AndreCleaver]

@fdotinc Thanks for sharing! 😁

[Andre Cleaver @AndreCleaver]

@admercs @Scobleizer I also noticed a shift in the augmented visuals when I playback the recorded footage from the hololens on a computer; the visualized hand joints that you see in the video actually appear directly over my hands when I look the hololens. But yea, it's a work in progress 😅

[Andre Cleaver @AndreCleaver]

@admercs @Scobleizer Assuming the robotic arm does not move in the physical space, I use local space coordinates to direct the target goal pose with ros/moveit. I think I can leverage the robot's base-feedback/commanded_tool_pose to get end effector pose to improve trajectory error.

[Andre Cleaver @AndreCleaver]

@javichisco @OpenRoboticsOrg Yeah! Here is the link,
https://t.co/NesBLT5all

[Andre Cleaver @AndreCleaver]

Accessing and controlling multiple robots with common hand gestures using augmented reality! #Robotics #robots #technology #Hololens2 #mixedreality #AugmentedReality #walle #HorizonZeroDawn #baymax #HRI #HCI

[Reality Hack at MIT @realityhackmit]

📣 GUESS WHO'S BACK!? 📣

That's right, we are! Our Hack returns from January 12 to 16, 2023. We're polishing off our AR glasses and VR headsets to prepare for 2023. Get ready! More details coming soon, but for now, mark September 29 on your calendar for when applications open!

[Andre Cleaver @AndreCleaver]

Robot control with eye gaze for people with disabilities and or cannot operate the arm with either a controller or hand gestures🤓 (red dot indicates where the eyes focus on, diamond shapes are for location reference) #AugmentedReality #Robots #HRI #unity3d #ROS #hololens2

[Andre Cleaver @AndreCleaver]

Controlling a robotic arm manipulator using hand gestures with a Hololens2!
#AugmentedReality #Robots #HumanRobotInteraction #HCI #HRI #Hololens2 #Unity #ROS #Kinova #ClawMachine

[Andre Cleaver @AndreCleaver]

Controlling robots with hand gestures and Augmented Reality! #AugmentedReality #Robots #HumanRobotInteraction #HCI #HRI #Hololens2 #Unity #ROS

[Andre Cleaver @AndreCleaver]

Visualizing robotic arm trajectories with augmented reality! #hololens2 #universalrobots #ur5 #ptc #vuforia #hri #future #Robots