Hot water saved my sanity during the peak of poison oak attacks more than once. I alternate hot water with ice packs (the gel kind you can put in your freezer work great). Just be moderate--pouring boiling water on your skin might begin to sound tempting at the peak of a bad attack, but stick to warm (not scalding) water.
