This is a rather difficult task, but it is probably a combination of some powerful blur detection / removal algorithms and a gyroscope. I would start by searching how to detect movement from the iPhone and see what results you can get with this. If this is not enough, start a search in the shift / blur direction detection algorithms . This is not a trivial problem, but it is something you could probably accomplish, given enough time. Hope this helps!