My non-vegan friend took me here on a whim and I'm glad he did! There aren't that many casual, vegan-friendly, sit-down joints on the Upper East or West Sides of New York City, but Alice's Tea Cup fills that niche well.
To start, this particular location has excellent ambience---it's like being in someone's cozy kitchen with lots of wood cabinetry and friendly folks chatting.
I liked their extremely large tea loose-leaf tea selection and fairly low prices (I had a cup of black tea from Mauritius for $2).
They only had one vegan baked good at the time, an orange-glaze yellow cake ($6 for one slice), but it was spectacular. It's expensive, for sure, but the size of the cake slice is large and the quality is top-notch gourmet; it was moist, soft, and the orange flavor and glaze came through beautifully, without being overpowering. Best of all Alice's Tea Cup makes their own product, rather than relying on outside vendors.
Definitely come here for a cup of tea or a slice of cake. It can and will get crowded on the weekends during peak hours (there was an hour-wait when we went), but you can always get something to-go and sit on a bench in nearby Central Park.