From my experience, the safest bet so far is to close the connection first, change the speed and then open it again. Your device will not mind this, as it is probably waiting for you to send some control characters to make sure that the speed has been changed.
, , ( ), , ( SerialPort.DiscardInBuffer).