I tested a few different Lego wheels in 70% vacuum. Enjoy!

The answer to the title question:
Yes in general, but it depends on the wheel size and balance. The best speed improvement was from 5100 RPM to 7000 RPM which is a 40% increase. Some wheels didn't gain much as they started to vibrate in high speeds. The smallest Lego wheel didn't spin any faster in vacuum.