Created a path creator in AR for robot navigation! A user spawns waypoints at desired locations and can modify the path's shape. A digital twin can simulate the navigation path before actual execution. #AugmentedReality#Robotics#digitaltwin#unity#vuforia
@admercs@Scobleizer Yeah! A project I am currently working on is exploring how AR can help people teach a robot a task. Potentially visualizing the trajectory the robot thinks it should take while the user can make corrections by interacting with the virtual waypoint markers for adjustments π
@admercs@Scobleizer I also noticed a shift in the augmented visuals when I playback the recorded footage from the hololens on a computer; the visualized hand joints that you see in the video actually appear directly over my hands when I look the hololens. But yea, it's a work in progress π
@admercs@Scobleizer Assuming the robotic arm does not move in the physical space, I use local space coordinates to direct the target goal pose with ros/moveit. I think I can leverage the robot's base-feedback/commanded_tool_pose to get end effector pose to improve trajectory error.
π£ GUESS WHO'S BACK!? π£
That's right, we are! Our Hack returns from January 12 to 16, 2023. We're polishing off our AR glasses and VR headsets to prepare for 2023. Get ready! More details coming soon, but for now, mark September 29 on your calendar for when applications open!
Robot control with eye gaze for people with disabilities and or cannot operate the arm with either a controller or hand gesturesπ€ (red dot indicates where the eyes focus on, diamond shapes are for location reference) #AugmentedReality#Robots#HRI#unity3d#ROS#hololens2