I walked from Times Square to Union Square when I was in NY in 2005. There was an area just north of Union Square where it got really heavy for a few blocks. Very shady. Thankfully the traffic lights / pedestrian crossings worked in our favour but it was definitely a brown trousers moment.