A Unity-based simulation comparing voice-activated and controller-based robot control methods in pick-and-place tasks.
This project compares the efficiency of voice commands versus mechanical controls for robotic manipulation. Built in Unity, it provides a first-person environment where users can control robots using either traditional controls or voice commands.
- First-person perspective control
- WASD movement + mouse look
- Object highlighting and selection
- Direct interaction with robots and objects
- Dropdown selection for robots (1-3)
- Shape and color selection
- Slot designation
- Visual feedback of robot actions
- Natural voice command recognition
- Simple recording interface
- Real-time command processing
- Command structure: "Robot [X], place the [color][shape] in slot [Y]"
- Download the latest release from Releases
- Extract
voice-vs-controller.zip - Run
VoiceControlStudy.exe
| Basic Movement | Manual Robot Control | Voice Commands |
|---|---|---|
| WASD - Move character | Select robot from dropdown | Click "Start Recording" |
| Mouse - Look around | Choose shape/color | Say: "Robot [X], place the [color][shape] in slot [Y]" |
| Left Click - Select/Interact | Select slot number | Click "Stop Recording" |
| Spacebar - Enable/Disable Mouse movement | Click Submit | Wait for processing |
| Go to Slot and place object | Watch robot execute | Watch robot execute |
| Reset if needed | Reset if needed | Reset if needed |
- Neel Girish Bahadarpurkar
- Harshal Suresh Bhat
- Brendan Byrne
- Jack Lynch
- Paul Raynes
Project developed at Worcester Polytechnic Institute Robotics Engineering Department