This is what is known as a "gross miss" (I think Evans uses this term but somebody else can confirm).
The general idea is that on a gross miss, unless the runner corrects his miss immediately, last time by will not protect him on an appeal. In other words, if he doesn't fix it immediately, he never can.
And I don't think there's any actual rule support in Fed for this ruling other than the case play.