In any tracking, you should probally start by tracking as many clean points as possible. Usually using a Tracker node is the best first. Because you can start each track seperate and save multiple tracks.
Once you have a few tracks in an area (you may need to manuall set tracks) you can start averaging your tracks.
You want to use the stabalize node once you start getting your averaged tracks.
I usually try at least 2 points to average if I am not getting a good track.
If you can get it working by getting multiple tracks / averaging them then you should be all set.
But, if you dont, your best bet would be to start doing it by hand, render to flipbook, check it, and do that over and over by hand, keying a move 2D.
A long story short, the best answer maybe both methods combined.