I was given a referral to a gyn the first time my GP gave me a pelvic exam. I have a fibroid that is currently the size of a 14-week fetus. It does not cause me any problems, but I was referred to a gyn anyway. The point being that if you have an unusual situation that needs special care, you will see a gyn. Getting a pap smear does not constitute an unusual situation that needs special care.
I prefer this to the US, when I had to wait for months to see a gyn, even when I was having problems, because I was always being bumped behind women having problem-free pregnancies who, in the UK, would have been cared for by midwives.