Marking potential late packets was in the wrong place.