Take the little ferry to Granville Island and have lunch at the Public Market. Admire the produce, the tempting bakeries, the delis. Temporarily part from your friends to browse the various food stands, make your purchase, meet your friends back outside in the sun. Listen to the street performer nearby while eating your lunch and admiring the boats passing by.
I think it will be a good afternoon.
*click images for full view