I doubt they'll pull you off to the side. Just point out your spouse visa stamp and you shouldn't have any trouble at all.
All was asked of me was my wedding date. The immigration officer was very nice. She smiled, congratulated me on my marriage, said she hoped I'd like living in England, stamped my passport and sent me on through.
Saffron