What's "nerdy" though? I'm a square dude, nerdy in that I did well in school, read books and like learning for the sake of learning.
Unless you're in sales or illegitimate, making good money = being a nerd at something, so that's usually assumed. I'll playfully be called a nerd by the women I deal with, but I can still benchpress 225 for reps & they know the "nerdiness" is why I make 2-3x what they do. Most of what I'm into (history, economics) isn't viewed in the same wavelength of nerdiness as anime and video games since deals with wealth, security, and how people manage both.
But for better or worse, women look at things like anime and video games as kind of loserish if you're into these things and not making good money. They say as much.
You've just gotta have something masculine (money, status, power, looks, physique & demeanor) to back up the nerdiness.