Absolutely! Just remember that a cooler room can help you get better sleep.

This applies to hot water bottles too - just make sure the cap is tightly closed before using.