00:00 / 00:52
1080P
  • Quality
  • 1080P 1080P
  • 720P 720P
  • SD 480P
Add to Channel Download Report

Playing issue

2217 0

Embed:

Copy

Robotic Voice Activated Word Kicking Machine

neilmendoza 2017-05-20 161934
The Robotic Voice Activated Word Kicking Machine is the ideal device for anyone that feels that their verbal communication needs a little extra kick.

The physical part of the piece consists of four bells of baritone horns, tubing, microphone, speakers, a mechanical foot and a projector. The software is written in openFrameworks.

When the software starts, it launches a web browser and creates a WebSocket connection to it. When someone starts speaking, the software sends a message to the browser to tell it to start speech recognition. Once the person finishes speaking, the browser sends words back as text back over the WebSocket connection. Each word is then added to a Box2D physics simulation as a series of rectangles linked together with springs. There’s a mesh for each letter and shadows are created in GLSL with a shadow map.

When a word is near the foot, the computer sends a message to an Arduino telling it to kick. The foot is actuated with a linear actuator driven by a Pololu Dual VNH5019 Motor Driver Shield. There is also a foot polygon in the physics simulation. Every time the mechanical foot starts to kick, the virtual foot in the physics engine is animated with a timeline that has been matched to the actual movement of the mechanical foot.

Software(s): GLSLopenFrameworks

Hardwares: ArduinoKinect

Comments

No comments yet
Recommended
Autoplay
声影随行(Echos In Motion) 00:58
声影随行(Echos In Motion)
VideoAudiovisual Interactive InstallationInteractive InstallationInstallation
喜茶装置完整版 02:03
喜茶装置完整版
Space DesignInstallationInteraction
道 · 万象 05:42
道 · 万象
Space DesignArt VideoInteraction
Live xR Interactive Virtual Performance 04:00
Live xR Interactive Virtual Performance
Space DesignVR(Virtual Reality)AR(Augmented Reality)
黑弓作品 { 全域行浸剧场「元」邀君共鉴 01:11
黑弓作品 { 全域行浸剧场「元」邀君共鉴
全域行浸剧场ProjectionAudition & PerformanceVideo
Download MANA APP