Well, in other cases it works so why not this one? Let's say there's an empty crate... If you exerted some force on it at a point, it will move away, not break at the point you are applying the force at, right?
When there is a wall and a huge machine tried to move it and applied force on it at a point, why will the wall break at the spot the force is being applied and not move away?