I don't think you will have a problem. I had my fiance's passport with me along with all the originals plus a copy of everything for my fiance visa which I carried in my carry-on bag. If for some strange reason they decide to search you, even though you've got a visa (they won't though), you will tell them you have the passport because it was needed for your visa.