I agree with Peter and think it's fine if you'll be serving the wine in the relatively near future, which is probably true with a white wine anyway.
Just take it out a little before you want to drink it, so it can warm up a little. You don't want to be drinking the wine at cold-as-milk 37F, you won't get many flavors out of it that way!
I find it much easier to take a white wine out of the fridge and let it warm up a bit naturally, vs having it down in the storage fridge (which is say 60F) and trying to get it to cool down from there ...