Writing

TeTrA: Jump to speech controlled VR env

In short: I built a Windows test game you control entirely by talking to it. Say "show me some clouds" and clouds appear. It understands eight commands. One of my dreams has been games you control…

published
read time
1 min
words
151
lang
en

In short: I built a Windows test game you control entirely by talking to it. Say "show me some clouds" and clouds appear. It understands eight commands.

One of my dreams has been games you control with your brain, your voice and your body. Kinect covered body movement. I have built BCI games too, you can see them in earlier posts. What I had not seen was a speech-controlled VR game, so I gave myself a shot at building one. What follows is a Windows, non-VR version of my test game.

The code and my other projects live on my GitHub.

What it understands

Right now it will listen to anything you say, but it only acts on these:

  1. Show me dreamy night
  2. Show me day
  3. Show me some clouds, or add clouds
  4. Add extra clouds
  5. Add some flowers
  6. Add more flowers
  7. Show me some trees
  8. Exit, or quit. Hahahaha.

related

Keep reading