Step Drill
I drilled a pilot hole first - been a long time ago, but probably started with #40 and progressively and slowly got to 1/4". Then used a step drill to get the hole done. With plexiglass, my recommendation is go slow (rpm) and only the pressure needed to get the job done - no more. Also, do not drill in cold temperatures.
Merrill