Of course she is literally their grandmother, but I feel like the husband's objection is that he wants them to have the connection they would have had if she was alive, and that's not going to happen, since they are never going to interact with her. It feels like he needs to process his mother's death more and accept that some things are just not going to be how he imagined.