Jason Pierre-Paul hooped up until his junior year of high school before playing football. He forwent his senior season of college before declaring for the draft, so that's only 4 years of ball beyond the Pop Warner level before making the league. Now he's a 2x Pro-Bowler.
Look at Ziggy Ansah on our squad this year. He's the current NFC Defensive Player of the week and had 8 sacks as a rookie last year.
He didn't learn to play football until his sophomore year of college.
I'd be inclined to agree that if you're a physical freak with speed, footwork, and hands, you don't have to necessarily "grow up" playing football to get burn at tight end/defensive end.