I left them in
They were a bit of a pain, but I worked around the pushrods to buck all the rivets. In a couple of places I used a footed bar to get around the rods. I found actually moving the aileron through it's travel moved the rods out of the way depending where I was riveting.