Say you have some signal, connected by a pair of wires, to a differential amplifier:

simulate this circuit – Schematic created using CircuitLab
How might we describe the current in these wires? One way is simply to measure the current on A, and the current on B.
Alternately, but equivalently, we can think of a common-mode current and a differential mode current. Differential mode currents are those where a current on A is accompanied by an equal but opposite current on B. For example, if there is 1mA on A, and -1mA on B, that is a purely differential mode current of 2mA.
Common-mode currents are currents that are equal on each conductor. If there is 1mA on A, and also 1mA on B, that is a purely common-mode current of 1mA.
In practice, the current at any time will be a mix of the two. If we measure 4mA on A, and 2mA on B, then the differential-mode current is 2mA (the difference of the two) and the common-mode current is 3mA (the average of the two). Formally:
$$
I_\text{differential} = I_A - I_B \\
I_\text{common} = \frac{I_A + I_B}{2}
$$
Why is this useful? The signal, as I've drawn it, can only create differential currents on A and B. It has no connection to anything else, so by Kirchoff's laws any current entering on the A side must be exiting on the B side.
But what about noise? Noise can couple into this system through mutual inductance or capacitance. If the impedance to A and B are equal from the perspective of the noise source, then whatever currents result from the noise will be equal in A and B, and thus, common-mode. This is a really important point: for a differential measurement to get any benefit of noise reduction, the impedances of the two differential lines must be equal. Any impedance imbalance allows noise to couple to the differential mode, adding noise to the signal. Equal impedances also assures that equal currents make equal voltages, at which point it becomes irrelevant if your amplifier is a voltage or current amplifier: a common-mode current makes a common-mode voltage so it will get rejected either way.
A differential amplifier ideally amplifies only the differential mode. In practice the common mode isn't rejected entirely, the CMRR, or common-mode rejection ratio, will specify the extent to which this is true in the datasheet. Even for commodity opamps, this can be quite high. For example, TL072 specifies a minimum CMRR of 75dB. Thus, to the extent that we can maintain impedance balance on all the connections (which is actually the hard part), noise will be common-mode, and thus attenuated by 75dB relative to the signal.