Nope. If it's a thick-skinned fruit like a banana or orange, I don't bother (though I do know some folks cook banana peels, and I've zested oranges, and I always wash then).