I been to both the Empire State Building and Top of the Rock observation deck about a decade ago. The height didn't bother me.
The coolest thing about the experience is how quiet it is, Midtown is known for being loud and noisy, while up on the deck its calm and quiet.
It was funny when I visited Top of the Rock one of the breh workers there was all polite and well spoken with the tourists, but started talking acting we was on the block when he spoke to me

I didn't mind though
Both times I think I was the only native New Yorker visiting the buildings.