you may need to adjust the aim vector in the Aim Constraint's options. It's usually a value of 1 or -1 in X, Y, and/or Z direction.

As for it moving, make sure it's not somehow parented, keyed, or being affected by some sort of orient or point contraint.