This is a family name for us, too. (It's been a MN for 5 generations, but we'd make it a FN bc we dislike the existing FN tradition.) But I go back and forth on it, I guess because of the style. I love LNs as FNs, but I've always felt silly about -son names, which are so obviously LNs, being FNs. I also worry about boxing ourselves in re: future sibset names. And I wonder how others perceive it - do they think "classic family name" or do they think "trend like Madison and Jackson?" I worry about its increasing popularity - that people are randomly using it like Jackson and soon it'll be everywhere and won't carry any meaning. Yes, I've been thinking about this a bunch lol.
We love the nn Andy. I like AJ, too - I have positive memories associated with it.