Automate scp file transfer using shell script

Question

I have several n files in a directory on my unix system. Is there a way to write shellscript that will transfer all of these files using scp to the specified remote system. I will specify the password in the script, so I do not need to enter it for each file.

Answer 1

Instead of a hard-coded password in a shell script, use SSH keys, it is simpler and safer.

$ scp -i ~/.ssh/id_rsa [e-mail]:/path/to/bin/*.derp . 

if your private key is in ~/.ssh/id_rsa

To create a public / private key pair:

 $ ssh-keygen -t rsa 

The above will generate 2 files, ~/.ssh/id_rsa (private key) and ~/.ssh/id_rsa.pub (public key)

To configure SSH keys for use (one-time task): Copy the contents of ~/.ssh/id_rsa.pub and paste ~devops/.ssh/authorized_keys into the myserver.org server in a new line. If ~devops/.ssh/authorized_keys does not exist, feel free to create one.

A clear instruction manual is available here .

Answer 2

 #!/usr/bin/expect -f # connect via scp spawn scp "[e-mail]:/home/santhosh/file.dmp" /u01/dumps/file.dmp ####################### expect { -re ".*es.*o.*" { exp_send "yes\r" exp_continue } -re ".*sword.*" { exp_send "PASSWORD\r" } } interact 

http://blogs.oracle.com/SanthoshK/entry/automate_linux_scp_command

Answer 3

you can also use rsync. It seems to work better for multiple files than scp IMHO.

  rsync -avzh / path / to / dir / user @ remote: / path / to / remote / dir / 

Update

You can use rsync via ssh by adding the '-e' switch:

  rsync -avzh -e ssh / path / do / dir / user @ remote: / path / to / remote / dir / 

Answer 4

 #!/usr/bin/expect -f spawn scp -r BASE.zip abhishek@192.168.1.115:/tmp expect "password:" send "wifinetworks\r" expect "*\r" expect "\r" 

Answer 5

why don't you try?

 password="your password" username="username" Ip="<IP>" sshpass -p "$password" scp /<PATH>/final.txt $username@$Ip:/root/<PATH> 

Answer 6

What about wildcards or multiple files?

 scp file1 file2 more-files* user@remote:/some/dir/ 

Answer 7

rsync is a program that behaves the same as rcp but has many other options and uses the rsync remote update protocol to significantly speed up file transfer when the destination file is updated.

The rsync remote update protocol allows rsync to transfer only the differences between two sets of files over a network connection using the efficient checksum algorithm described in the technical report that comes with this package.

---

Copy a folder from one place to another

  #!/usr/bin/expect -f spawn rsync -a -e ssh username@192.168.1.123:/cool/cool1/* /tmp/cool/ expect "password:" send "cool\r" expect "*\r" expect "\r" 

Answer 8

If it is convenient for you to enter the password once for each script run, you can do it easily using the main SSH connection.

 #!/usr/bin/env bash USER_AT_HOST="user@host" # use "$1@$2" here if you like SSHSOCKET=~/".ssh/$USER_AT_HOST" # This is the only time you have to enter the password: # Open master connection: ssh -M -f -N -o ControlPath="$SSHSOCKET" "$USER_AT_HOST" # These do not prompt for your password: scp -o ControlPath="$SSHSOCKET" file1.xy "$USER_AT_HOST":remotefile1.xy scp -o ControlPath="$SSHSOCKET" file2.xy "$USER_AT_HOST":remotefile2.xy # You can also use the flag for normal ssh: ssh -o ControlPath="$SSHSOCKET" "$USER_AT_HOST" "echo hello" ssh -o ControlPath="$SSHSOCKET" "$USER_AT_HOST" "echo world" # Close master connection: ssh -S "$SSHSOCKET" -O exit "$USER_AT_HOST" 

Answer 9

You can only do this with ssh public / private keys. Or use a putty in which you can set a password. scp does not support password transfers on the command line.

Instructions for public / private keys can be found here: http://www.softpanorama.org/Net/Application_layer/SSH/scp.shtml

Answer 10

This will work:

 #!/usr/bin/expect -f spawn scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no file1 file2 file3 user@host:/path/ expect "password:" send "xyz123\r" expect "*\r" expect "\r" interact 

Answer 11

Try lftp

 lftp -u $user,$pass sftp://$host << --EOF-- cd $directory put $srcfile quit --EOF-- 

Answer 12

The scp command can be used as a traditional UNIX cp . SO if you do this:

 scp -r myDirectory/ mylogin@host:TargetDirectory 

will work