Changing my address with my credit union caused so many problems with my online banking that I had to change it back. It was an awful, awful experience. That, with my botched transfer, just convinced me to leave it as my mom's address in the states.
The border was easy. As stated above, passport and approval letter. Make sure they stamp it!
When I got here I registered with the NHS, registered with the local GP, got added to the lease, added to the electric bill, the water bill, opened a bank account, then got a phone contract with Three. and officially changed my number. My US number deactivated the day I arrived in the UK. So, if you are tied into a US phone provider contract you need to take care of it now before you leave if you can.
I have had issues with my NIN, as I can NOT get a real person on the phone but that's my problem, you might not have as much trouble. I would also recommend keeping a box/drawer with your important stuff/mail/etc so you don't lose it. You'll need to carry your BRP if you visit Amsterdam, so make sure you take good care of it! Getting the BRP was easy. We went to the post office, I showed them my passport and the situation and she pulled it out of an envelope and voila!
When I was added to Tom's lease, since I am an Non-EU and not a British citizen we had to travel to another town so they could "verify" that I am legal and a real person. You should consider that if you're going to be doing something similar. If your husband owns his house it shouldn't matter. I'm not at that point yet! I also got a library card, costa card, greggs card, etc. of the places I knew I would frequent, and it helped make me feel like I live here.
Good luck!