It depends on where you are moving the files from. mv On one file system, it is atomic, otherwise it must make a copy that is not atomic (followed by the deletion of the original file) and is prone to the kind of race condition that you mention.
FWIW, POSIX, XFS.