I had similar thoughts. Hypothetically, the "center of mass" of mining could drift to a point in between Earth and Mars: perhaps an enormous train of miners sling-shotting between the two planets.

That would only work for these two planets, though. @Scoresby's underlying point would still hold if we switch our example to Io or something else further out in the solar system.