This article is fascinating to me. It's about how extra points were attempted prior to 1920, and it's a pretty interesting system that we should bring back (though admittedly the introduction of hash marks dampens the fun).
I'll make you click the link because we should support good football history journalism, but the tl;dr summary is that prior to 1920, the extra point was attempted directly back from the point where the ball crossed the goal line. If that was a bad spot, the scoring team could punt the ball from inside the other team's end zone, leading to one of several outcomes. The punt could potentially be made from out of bounds, and a horizontal penalty could also be levied.