If price falls and some miners stop mining, the hash rate sinks. This causes the difficulty to adjust down, so the lower hash rate still produces one block every ten minutes on average.

Now less energy is used to secure the network, because some miners' gear is turned off.

When the price increases, hash rate and difficulty increase. When the price decreases, hash rate and difficulty decrease. Until equilibrium is reached again.