That is ridiculous. I would totally call them back and be like,
I know DH told you it would be ok, but it is very dangerous and after discussing it, we would prefer that you bring something else if at all possible.
I mean, this is obviously a very serious allergy. I think it is quite rude, actually.