You should be able to change the pole vector without using a constraint, it's doable no matter how the leg joints were built, but is much easier if it's built in line with the xyz axes. If it's built in line with the xyz select the ikHandle, open up the Attribute Editor and expand IK Solver Attributes. You'll fine the Pole Vector position stored there. Whichever way your leg is suppose to be facing place a value of 4 in the cooresponding xyz for the Pole Vector and 0 in the other two. So if your leg should be facing positive Z you'd have 0, 0, 4. If the leg should be facing negative x you'd have -4, 0, 0.
When an IK is made by default it generally tries to place the pole vector 4 units in the direction the IK limb is bending, towards the elbow or knee for limbs. If it's still getting it wrong, without more info, I'd just suggest deleting out the joints, remaking them, orient them correctly and remake the IK. Hope this helps!