Development Update: speech and gesture command recognition

UNISA is working on Phase II of the FELICE prototype system, improving the speech command recognition subsystem deployed on board the adaptive workstation and the robot. The module developed by UNISA controls the height and inclination of the adaptive workstation using voice commands. Furthermore, the operator can ask the robot to take specific tools, namely two types of screwdrivers and parts to assemble a car door (control panel, speaker, etc.). Using this technology, the operator can change the workstation settings without interrupting the assembly operations he/she is carrying out on the car door and can avoid wasting time searching for and getting the tools and parts needed for the assembly task. UNISA is also working to add gesture commands by analyzing real-time images acquired through the camera installed onboard; the aim is to provide redundancy on task-critical and safety-related commands.