I second the Union Square Cafe as well.
My family loved Le Bernardin (French seafood; lots of businessmen at lunchtime, very old worldly elegant atmosphere), which I liked okay... I loved Aureole, by my ultimate favorite is La Grenouille - gorgeous atmosphere and food.
