I think your last paragraph is spot on. I mean, I see "four children" and I think "omg how much work?" and that's even before we get to the implied breadwinner/homemaker division of labour.

I'm imagining Jim as like, well dressed, high standard of personal grooming, and vocally supportive of women, and therefore "must be gay".