On my soapbox.
Answer depends on the time elapsed after Scotch Brite. Aluminum Oxide (AO) reforms on aluminum in a few hours. AO is hydrophobic. Paint doesn't stick to it very well. Solvents don't remove it. Yes, they do remove oils. The best way to remove oils and AO is to scrub with an abrasive and cleanser. The abrasive will remove the AO layer and the cleanser will remove contamination leaving a scuffed, AO free surface ready for mechanical adhesion. Plus no handling solvents.
My preference is grey Scotch Brite and Bon Ami. Scrub well then rinse thoroughly. Dry and paint within two hours. If curious, take two samples. One wiped with a solvent. One treated as above. Wet them both under a faucet. If the surface is hydrophilic, it will sheen with a layer of water. That's a surface ready to accept paint. If it's hydrophobic, water will dribble like droplets on the surface. Prime them both. Apply some Gorilla tape then rip it off.
Dilute P60G2 1 part primer to 2 parts catalyst and spray only till a faint green color change is seen. It gets darker as it sets.
Off my soap box now!