I'd take the Amtrak to Philly when i was stationed in Norfolk, always would enjoy it. Hotel right on Market Street so it was just a 10 min walk across the bridge to/from the station.
If you don't mind walking, a considerable amount of the city is accessible by foot.But SEPTA is very much lacking in comparison to DC and NYC.
Went to ishkabibbles on South street, was not disappointed at all.