Vision-Guided Grasp Planning for Prosthetic Hands with AABB-Based Object Representation

Recent advancements in prosthetic technology have increasingly focused on enhancing dexterity and autonomy through intelligent control systems. Vision-based approaches offer promising results for enabling prosthetic hands to interact more naturally with diverse objects in dynamic environments. Building on this foundation, the paper presents a vision-guided grasping algorithm for a prosthetic hand, integrating perception, planning, and control for dexterous manipulation. A camera mounted on the set up captures the scene, and a Bounding Volume Hierarchy (BVH)-based vision algorithm is employed to segment an object for grasping and define its bounding box. Grasp contact points are then computed by generating candidate trajectories using Rapidly-exploring Random Tree Star (RRT*) algorithm, and selecting fingertip end poses based on the minimum Euclidean distance between these trajectories and the object’s point cloud. Each finger’s grasp pose is determined independently, enabling adaptive, object-specific configurations. Damped Least Square (DLS) based Inverse kinematics solver is used to compute the corresponding joint angles, which are subsequently transmitted to the finger actuators for execution. Our intention in this work was to present a proof-of-concept pipeline demonstrating that fingertip poses derived from a simple, computationally lightweight geometric representation, specifically an AABB-based segmentation can be successfully propagated through per-finger planning and executed in real time on the Linker Hand O7 platform. The proposed method is validated in simulation, and experimental integration on a Linker Hand O7 platform.