Remember that on a PC you can also enter foreign characters using the Alt key plus number keypad. Try Alt-156 or Alt-0163 for a £ sign (i.e. press & hold Alt, type 156 or 0163 on the numeric pad, then release Alt).
When I had it set to UK, the @ (above the 2 on a US keyboard) was in a different position (near enter/return on a UK one) and " was above 2.
There are some aspects of IBM PC keyboard design which have always been something of a mystery, and this is one. Many computer and teletype keyboards had " over the 2 at one time, in part because the assignment of ASCII codes could make this easier for the hardware.
However, the symbol arrangement on the original IBM PC keyboard was based on the IBM Selectric typewriter, which had @ over 2 and " over ' just to left of the return key. British versions of the Selectric had exactly the same arrangement, so why IBM decided to swap @ and " for the U.K. PC keyboard is anybody's guess.
It's like the mystery of the backslash key. The original IBM PC design placed it between Z and the left Shift key, a practically universally loathed position where anyone used to a normal keyboard would keep hitting it every time he went for the Shift key. The revised American keyboard for the PC/AT a few years later moved \ to the upper right so that the left Shift key could be wider and right next to Z where it belongs, but for some reason this was never changed on the U.K. keyboards, which are stuck with \ between Shift and Z to this day.