Should We Really Be Messing with Asteroid Orbits?