Noise/voice as a controller

Audio and Graphics
#1

Is it possible to create a noise/voice controller plugin for Corona?

So I can use noise and sound as a controller like in the “Chicken scream” game https://youtu.be/yeBgDGMt32M 

#2

I’m sure you could write a plugin that generates Runtime events.  Then you could listen for them in your code.

The trick, I think, is finding a good speech/audio conversion library/API to integrate into your plugin.

I’m guessing here, but it sounds like you are asking for something that merely detects:

  1. absence or presence of sound at a particular minimum volume
  2. possibly the ability to measure that volume.

Those two measures would allow for began, changed, and ended phases with (relative) volume as a floating point field.

That alone would give you significant flexibility in creating a control scheme.

#3

Some time ago, a friend of mine created a game on LÖVE (another Lua engine) where the player controls an airplane’s angle by the volume of microphone input. So, it can definitely be done on Lua, but I am not sure how he approached the issue, i.e. whether he wrote his own code or found some library, etc.

#4

Thanks for the tips @roaminggamer

I would really appreciate if you could ask your friend how he solved that, @XeduR.

I don’t think it would be a lot of people purchasing this kind of plugin, but it can be used to create some pretty cool/unusual features.

I have a (potential) client that wants to create an artistic app that changes with the music he is listening to. 

I do not have the skill or time to create this kind of plugin myself, so I would also have to find someone that can.

#5

Apparently he wrote his own library using C++ and then used that. I asked and he wasn’t keen on sharing the code as “it is all sorts of unpolished and poorly formatted”.

#6
#7

Thanks a lot for checking :slight_smile:

#8

I’m sure you could write a plugin that generates Runtime events.  Then you could listen for them in your code.

The trick, I think, is finding a good speech/audio conversion library/API to integrate into your plugin.

I’m guessing here, but it sounds like you are asking for something that merely detects:

  1. absence or presence of sound at a particular minimum volume
  2. possibly the ability to measure that volume.

Those two measures would allow for began, changed, and ended phases with (relative) volume as a floating point field.

That alone would give you significant flexibility in creating a control scheme.

#9

Some time ago, a friend of mine created a game on LÖVE (another Lua engine) where the player controls an airplane’s angle by the volume of microphone input. So, it can definitely be done on Lua, but I am not sure how he approached the issue, i.e. whether he wrote his own code or found some library, etc.

#10

Thanks for the tips @roaminggamer

I would really appreciate if you could ask your friend how he solved that, @XeduR.

I don’t think it would be a lot of people purchasing this kind of plugin, but it can be used to create some pretty cool/unusual features.

I have a (potential) client that wants to create an artistic app that changes with the music he is listening to. 

I do not have the skill or time to create this kind of plugin myself, so I would also have to find someone that can.

#11

Apparently he wrote his own library using C++ and then used that. I asked and he wasn’t keen on sharing the code as “it is all sorts of unpolished and poorly formatted”.

#12
#13

Thanks a lot for checking :slight_smile: