The Robotic Voice Activated Word Kicking Machine

Datetime:2016-08-22 22:29:21          Topic: WebSocket           Share

The brainchild of artist Neil Mendoza, the Robotic Voice Activated Word Kicking Machine is described as the “ideal device for anyone that feels that their verbal communication needs a little extra kick.”

The piece consists of four bells of baritone horns, tubing, microphone, speakers, a mechanical foot and a projector, while its software is written in openFrameworks. When the software starts, it launches a web browser and creates a WebSocket connection to it. As soon as someone starts speaking, the software sends a message to the browser to tell it to start speech recognition. Once the person finishes talking, the browser sends words back as text back over the WebSocket connection. Each word is then added to a Box2D physics simulation as a series of rectangles linked together with springs. There’s a mesh for each letter and shadows are created in GLSL with a shadow map.

When a word is near the foot, the computer sends a message to anArduino telling it to kick. The foot is actuated with a linear actuator driven by a Pololu Dual VNH5019 Motor Driver Shield. There is also a foot polygon in the physics simulation. Every time the mechanical foot starts to kick, the virtual foot in the physics engine is animated with a timeline that has been matched to the actual movement of the mechanical foot.

Intrigued? Be sure to check out its official page here .





About List