If you can detect static objects, e. d. background, in frames you can find points called good_features_to_track ( cvGoodFeaturesToTrack) on the background, and track these points using optical_flow ( cvCalcOpticalFlowPyrLK).
"xy", cvGetAffineTransform.
( ), , cvGetAffineTransform. (. wikipedia):

\theta -