When applying vacuum to solvent, it's best practice to use a cryogenic trap to prevent solvent vapours from entering the pump, particularly with pumps that contain oil, as the solvent will cause vacuum oil to lose its performance and may even be dangerous.
Why would you pull a vacuum on a freeze precipitation vessel anyway? And how cold is your freezer? Other than that, it depends on your aims with crystal growth. Sure, pulling off a bit of solvent might increase the yield slightly, maybe at a small expense of purity. Reduced oxygen concentration may limit polymerisation, but you may as well use argon or nitrogen for that.
You'll have to say very specifically how you intend to set this up, otherwise it's sounding like some kind of Schnappsidee.