They can't. Hell, Bayard Rustin spoke at the March. Baldwin's sexuality isn't the reason why he didn't get to speak. It was because of the content of his speech being seen as too radical. They almost removed John Lewis from the list of speakers until his speech was modified.
Here's Rustin speaking at the March.
I hate when people make up shyt. But, fukk Baldwin's own words. Let's believe in made up bullshyt narratives.
In my view, by that time, there was, on the one hand, nothing to prevent the March. It had already been co-opted and, on the other, no way of stopping the people from descending on Washington. What struck me most horribly was that virtually no one in power (including some blacks or Negroes who were somewhere next door to power) was able, even remotely, to accept the depth, the dimension, of the passion and the faith of the people.