Bathroom shelf warmer