... Ivy probably does not care enough about you, Random Aunt, to talk about you to other people without some prompt. Like, "Who are the people in your family?" or "What did you do last weekend?" and the answer is probably going to be something like "Auntie has a house with THREE BATHROOMS" or some other thing that you would consider completely irrelevant.

If you want Ivy to talk disparagingly about you to other people, by all means, double down on the severity of this insult and your brother's child-rearing and continue bathing in your insecurities.