Auto-Tune with Corona SDK

Solar2D General Questions/Discussion
#1

Hey,

We’re trying to build an app / game that requires Auto-Tuning of recorded sounds. (You can check I am T-Pain App for a similar idea) so what we need to do is:

  • Detect the recoded sound frequency (probably using the tuner)
  • Shift the ‘wrong’ or off-scale frequencies to the nearest on-scale (right) frequencies (probably using the ‘hidden’ audio library in Corona)

I’m wondering if this is a good idea to do it, and if it can be done in real time (playback the recorded sound and auto-tune it).

I’m also wondering, is there an easier way to do this? An integration of some Auto-Tuner somehow?

Thanks! [import]uid: 91771 topic_id: 26458 reply_id: 326458[/import]

#2

I don’t really know the answer but I suspect on a new enough iOS device, you should have more than enough CPU horsepower to do this. The tuner was written in C, originally for the original iPhone. OpenAL on iOS is written by Apple so it should be pretty optimized for pitch shifting.

However, I don’t know what kind of latencies you will have with the tuner and because the playback API currently requires files to be read from, you will incur additional bottlenecks there. This will probably be the first thing you want to check to see if this is possible.

[import]uid: 7563 topic_id: 26458 reply_id: 107415[/import]

#3

Check out the SDKs from Little Endian:
http://www.littleendian.com/developers/

TuneWorx module is part of the SDK, it does the autotune. (Also, many other effects are bundled in the SDKs, ptichshifter, etc…).
[import]uid: 156498 topic_id: 26458 reply_id: 111510[/import]

#4

wait, am I misreading something? or is there a Corona audio API where we can analyze audio frequencies? [import]uid: 94868 topic_id: 26458 reply_id: 111530[/import]

#5

yes [import]uid: 61600 topic_id: 26458 reply_id: 111536[/import]