Absolutely! Just remember that a cooler room can help you get better sleep, and as a general safety recommendation, you shouldn't use these with little ones busy snoozing on their Hybrid Cot Mattresses.
This applies to hot water bottles too, just make sure the cap is tightly closed before using.