Yeah there is a visual indication when you flag something but apparently the user being flagged doesn't know what is happening.

This reminds me of the good ole bozo filter on blogs. If you have a spammer in your comments you don't block them from posting you just make it so only they see their comments :).