The (Classic 4.0, Classic 3.0, Fresh, and Handheld Bidet Sprayer) connect to your home's cold water line, so the spray comes out about the same ambient temperature as your tap water, not icy, just whatever your tap runs. It's part of what keeps these models easy to install, since there's no warm water hookup needed. It might feel brisk at first, but it won't hurt, and most people find it very refreshing.
If you'd rather have warm water, we've got options. The Spa 3.0 and Oasis are non-electric bidet attachments that connect to your sink's warm water line, as long as your sink is within about 6 feet of your toilet. Or go electric: Aura, Cloud, Cloud+, and Ace all offer warm water, no sink connection required, as long as you have a 3-prong electrical outlet.