Wemby will probably only win it 1 or 2 times. DPOY is mostly reserved for all defense and almost no offense players.
Kawhi won DPOY back to back. After the second one he was comfortably averaging 20 or more a game. He started being looked at as an MVP candidate, so he sort of "graduated" from DPOY.
Same thing will happen to Victor. He probably wins it back to back at some point but his offense is so good that he will quickly graduate to an mvp candidate, which in turn means voters will vote some other defensive player who doesn't have great offense for DPOY, since the award is basically specifically for that.
Think about how great Tim Duncan was defensively. He never won DPOY. Made 15 all defensive teams, was selected first team 8 times, spent half his career playing on a top 5 defense that he spearheaded, but never won DPOY, because he was never looked at as just a defensive player.