Yeezus because even fans of the album make apologies, explanations, and excuses as to why others should like it. "Ya'll ain't listening right", "You're too caught up listening to x, y, and z to truly appreciate this album", "It's different, innovative, etc."
With Magna Carta, it's an album you either like or you don't. I will say, a lot of the people who've expressed dislike with it don't like it because Jay didn't do anything fresh, new, or different. It's criticized for being a Jay album and not his version of Yeezus. So Yeezus gets my vote.