By definition, pardons are forgiveness of a crime, in the case where the person is guilty.

There have been several cases where people have refused conditional pardons, specifically because of the same ideological stance you have: accepting the pardon would implicitly mean that they were admitting guilt, whereas innocence needs no pardon, it is simply innocent.