I'm in a similar situation, except I just found out I'm having a boy, so I don't have to deal with this decision yet. I've always loved the name Evelyn. My great-grandma's name was Eveleigh (that's right. There's no R in there), and I thought it would be nice to honor her, without using her actual confusing name.
When I shared the name Evelyn with DH years ago, he fell in love with it.
Now, the popularity scares the crap out of me, but DH doesn't like any other girl names. He doesn't even want to discuss it. The name has stolen his heart.
I don't know what we'll do if we ever have the opportunity to name a girl. I will say that I don't know any Evelyns in real life. I see it online almost every day, though--which really bothers me. My gut tells me that if you love, love, love the name, and nothing else compares... go with it anyway. Good luck with your decision!