True but it's pretty hard to escape earth's gravity. Once you do, pointing yourself towards the moon is not that difficult. Getting back alive is, of course.
I think you can argue that the 60 years of progress between the Wrights hopping around a field and Gagarin getting into space is more impressive than the 8 years between that and Armstrong.