I also had this concern, best advice was to wait until the tail was mounted, and the elevator travel checked.
There seems to be a lot of excess travel without the entire assembly.
In addition, at least for the CH units, you can rotate them a bit, gives not only better clearance, but is actually more comfortable fit in your hand.
YMMV with the Infinity grips.