As I understand Oyster cards, you swipe them on the station you enter, and the station you leave (for simplicity's sake, I'm only considering the Underground). As in you don't swipe them when changing underground lines (maybe you do on some stations though?).
So if there is a variety of ways you could have gotten between A and B and one is more expensive, what are you charged?
(I've heard something about pink validators?)