…although it would only be decades later when he would learn that particilar phrase.

Suppose he left.  Suppose he did what logically came next.  Asked his father, and, by extension, his volatile and childishly vindictive stepmother, if he could live with them.  Not “him”, them.  An important distinction, given the preceding five years.