Looking shy as usual, Katy was seen out and about in New York yesterday