If you used rudder trim, the most likely reason is coming into a hover your rudder peddles center is set to the trim position. And this will cause you a loss of axis movement in the other direction with the peddles. You can try re trimming often when coming in for a hover. Or what I have done is select the trim down button to trim reset key that to reset the center of your rudder peddles to the center of the axis for the anti torque rotor