> He even jokingly says he will break up with me if I continue to wear it

Some problems come with a possible solution. If he says that, the response is "I'm not going to change. If you're going to break up with me, get on with it."

Either he shuts up, or he priorities the make up over you in which case he'll never be a good partner.