Honestly no. Most people say i can't do X when really they mean, i've decided that its not worth the effort/i dont want to.

If you were arguing that math comes easier for some people than others, sure that's strong evidence. If you're arguing that they are literally incapable, and no set of curcumstances would allow them to learn - that is a very different claim and needs very different evidence.