Yeah I understand. Well if you camera moves, and moves like held by a human, you're on for a serious challenge. I think you should consider using MatchMover, Boujou or this kind of highend product.
Of course if the motion of the camera is simple, you can try to keyframe your XSI camera manually.
Sorry I can't help you more.
Salutations - Cheers
Bernard Lebel