Can I use "pretty", "quite" etc with weather?

Can I use "pretty", "quite" etc with weather?
Not long ago I’ve been texting with someone and wanted to say "It’s pretty freezing here" but hesitated (I’m not native speaker as you might guess), so I decided to ask here if it’s correct to say like this.