There's no need to worry about something like this. ILR is indefinite, so lots of people with this status will change jobs at some point. You will have to show your passport to your new employer, because this is a requirement for everyone, British citizens included. They need to know that you have the right to work in the UK. But there's no reason for the transition not to be perfectly straightforward.
