You'll only have a problem if they ask to see your passport at the boarder. As you're on a bus, this is unlikely to happen, though you never know.