A number that is signed to do the math on this makes more sense. If you subtract address 123 from 456, you expect to get address 333, right? So, if you subtract 456 from 123, you expect to get -333, not 18,446,744,073,709,551,283, right? That's why the addresses are signed.
The reason why only the high part is enclosed is because the number has only one bit sign and always the oldest (most significant) bit.
source
share