As durhamlad said, the IRS isn't picky about which rate you use, as long as it's reputable.
I've just used the HMRC rate to go both ways, so it's the same rate and internally consistent. I figure HMRC is at least as reputable as xe.com or whoever. I can't guarantee that approach is acceptable, but I've never been challenged. In practice, the differences are going to be tiny, so just using one rates feels right to cancel out even those tiny differences. I expect it would only become an issue if you were cherry-picking rates to save money on taxes - using xe.com for one transaction, Treasury rate for another, HMRC for another, etc. - pick one and use it consistently and I expect that avoids any issues.
FBAR does have it's own specific Treasury rate to use, that's a different case.