The expressions are the same as long as the operands are strings; if not, +may add them instead depending on type conversions. &ensures that you get nothing but the concatenation of strings, and if possible, convert the operands to strings.
There is an MSDN entry on Concatenation Operations in Visual Basic that explains this:
(Visual Basic) String String, Strict. , .