<In both cases (the yellow and blue), I'd like to find those spray paint colors, or the closest equivalents.>

Don't know about the blue, but cans and bottles of Aero Gloss 'Cub Yellow' butyrate dope can still be found from time to time on Ebay.

Joe