My dad is with nuts like you are with raisins -- not allergic, so far as anyone knows, but that's because he literally has a gag reflex when presented anything with nuts (and even nut meal in some cases) so he's never actually eaten enough to check for a reaction.

Our family line is generally, "He can't eat nuts," and just cut off there. Nobody is owed any more explanation than that.