Not American so I don't know how that IRS mafia operates.
I don't understand how would they know it's a bitcoin purchase? A transfer to a random person is just a probability, could be a farmer at the market. Whereas a transfer to an exchange is certain.