i don't believe there's any chance for using the concept of "indulging" this way and not have it be about fatness. if it were about not ruining supper or not getting a bellyache (or anything else non-bigoted), that would be clear in the phrasing.