IPhone Audio Visual Effects

Question

I am developing an application in which the user can record some sound (their voice) and apply visual effects. I use FMOD to handle all audio and add sound effects and all. My question: is there any of the API-interfaces that handle iOS audio visualization? I mean, to be able to write something, and then "talking hands" to revive the post.

I also thought about the possibility of displaying "visualize" the record, I know that you can capture wave information and material from FMOD, but how would you use this data to create visualizations?

Thanks.

Answer 1

First of all: no libraries out there for what you want. I think it's a little too specific.

The good news is that it's not very hard to do - it's just to get my head in the right place.

Instead of thinking about sound, think of something else, such as accelerometers. If I want to UIView moved in response to the accelerometer, I could just take the displayed value to the Z-axis (between -1 and 1) and convert it to the coordinates on the screen (from 0 to 480, for example).

If I just plug the accelerometer measurements directly in the conversion formula, it will probably be a little jerky. UIView can bounce everywhere. This is due to the fact that the measurements of the accelerometer can vary greatly. So maybe I'll add some simple filter to make changes between the measurements more gradual.

Now that it is connected with the audio? Actually, a fair fight. For example, if you change the amplitude of the accelerometer, you can have a UIView, which moves up and down in response to the sound volume. All you have to do is write something that is constantly sending the value of the amplitude in a UIView, which you would like to revive it.

Then you can a little more complicated, having an idea that can move or change its position / scale in response to certain frequency ranges (possibly bass). So I think that maybe if you take a step back and think about what you are trying to revive in response to what options you may be slightly simplified.