Yeah, limiting it to women and gay men means that this argument is also carrying a shadow argument: that straight men (and straight boys) can't be harmed by sex and that their consent either doesn't matter or can be assumed to be in a permanent state of "yes."