I had my mom in the delivery room with my first and she was amazing. DH tried, but he kind of went into a "deer in the headlight" mode and was useless, so it was my mom that talked me through the breathing and coaxed me through not pushing during transition and kept all of us calm. She was such a rock during the whole thing, she was invited to my second delivery (which ended up being an emergency cesarean, she wasn't even at the hospital yet) and DH has joked about flying her out here at the first signs of labor.
However, I think, for me, that was the key point. DH was fine and even wanted her there. My mom and DH have gotten along since day 1, and he'll often comment that he likes my mom better than his own. DH also had no real preference about who would be there and it was actually he who called my mom when I was in labor and invited her to come.
Personally, if DH had expressed a desire for it to be just he and I, I would have chosen that. Though DH may not be the one in labor, this is as much his moment as yours and I've always felt he should have equal say (to a point, if I want an epidural, that's my choice, though I will listen to DH's opinion on it). It may hurt your mom's feelings, but what about your DH's feelings?