I agree with you that it's not sexual harassment, but the "doesn't walk around flaunting it" can be the tricky part, especially for something that lasts hours and is likely to recurr frequently. Even if nobody complains to HR, someone might wonder "did that person I was just talking to notice? were they upset? should I apologize? maybe they didn't notice and trying to apologize would only call attention to it?"