I'm kind of the same way. I basically thought he'd be a good fighter and decent/solid titleholder, not a real elite fighter or future great. I think the same of Canelo.
Often times I feel the expectations of fighters get too high when they have speed, as was the case of fighters like Broner, Khan, and Judah. Broner has fast hands, but his feet, defensive reflexes, and movement fall very short of that speed. He also has limitations due to his height and stocky frame, which also hurt guys like Andre Berto and Meldrick Taylor (even without the Chavez fight, I think he would have had a short prime, although he was certainly better than the other guys being discussed). Berto also had fast hands and a wicked uppercut, but was a wide target who squared up a lot, and his defense was lacking.
Khan has fast hands and feet but is just so sloppy in addition to being chinny, and it didn't take much to get him off his game plan. I thought his technical skills were pretty bad for a world champion, the guy could rarely throw a right hand without coming forward and practically falling onto his opponent afterwards. He lacked fluidity and often looked like a spazzed out retard in the ring.
Judah though, I thought much higher of and did think was going to be an elite p4p fighter. He had speed, power, that sneaky left uppercut, a nice little variety of punches, and was far more fluid in his movement.