We didn't evolve the need to have a good a grasp of mathematics or not. What mattered is whether you could feed yourself, fukk and run from predators. All you needed to understand were the end effects of maths not the science behind it. E.g. Catching a projectile, and throwing a spear, is advanced physics but you don't need to understand the mechanics behind it to do either well.
There are many tribes like still around, like the Piraha, who have no concept of math, they only count to 2 or 3.
We are essentially bad at maths and abstract maths concepts, e.g. We are terrible at probability.