I appreciate this bc people often act like if the worst-case scenario didn't happen, everything's fine. & it's like, it's important to talk about things that are not at the level of assault and harassment but still have a sexist impact on women's careers

Yes. If this woman becomes hesitant to talk to other men at conferences, that might cost her professional opportunities - so she has still been *harmed*, even if she wasn't assaulted.