McWhorter and by extension Loury's main criticisms are that most Black public intellectuals understate or underappreciate the role of culture when analyzing Black outcomes. And that structural explanation have been taken too far and are based on flawed premises, but they both acknowledge that structural racism does exist.
Even though I probably don't lean on the cultural explanation as much as they do, I do think there is value in providing good arguments against the dominant narratives. Further, it is good to point out there is more complexity to an issue when over simplified become prevalent.
But I do think there is a hint of jealousy and resentment on McWhorter and Loury's part, especially Loury who has disappointed me by inviting hacks on his show and harping on dead end issues. There have been some great books on human networks and network effects over the last couple of years that lean heavily on Loury's articulation of social capital and yet he never had the authors on his podcast. I would much rather hear a discussion about Black network gaps because of a lack of social capital rather than another episode revolving around why Ta-Nehisi Coates is overrated.