Let's say I have three points: A, B and C. I measure the voltage between A and B: it's 0. I then measure the voltage between A and C, and it's again 0. So, the voltage between B and C must also be 0, right? Well, not quite so.
Let's say I have two batteries, and I call the + terminal of the first battery A, the + terminal of the second battery B and the - terminal of the second battery C. Here the previous conclusion fails: the voltage between A and B as well as between A and C is 0 (both measured with a voltmeter), but the voltage between B and C is naturally the voltage of the battery. What's wrong here?
I guess the answer must be related to the absence of a closed circuit, but I'm feeling that the conclusion of my first paragraph should apply regardless of that.
Edit:
My question was motivated by this other popular question. There it is stated (accepted answer) that: for current to flow, a circuit does not need to make a physically closed loop. If point A is fixed at \$ 0V \$ and point B is fixed at \$V_b\$, they don't need to be physically connected for this property to be true. When we connect a resistor R between point A and point B, the current from B to A will be \$ I_{BA}=V_b/R \$.
But the answer I've got so far is telling me that I need an a priori closed circuit in order to be able to measure a voltage difference.