Geek Answers Handbook

How to resume ftp download at any time? (shell script, wget option)?

I want to download a huge file from an ftp server in chunks of 50-100 MB each. At each point, I want to be able to set the “starting” point and the length of the required fragment. I will not have the “previous” pieces stored locally (ie I cannot ask the program to resume downlaod).

What is the best way to get around this? I use wget mostly, but is something even better?

Hello! I'm really interested in the prebuilt / inbuild function and not using the library for this purpose ... since wget / ftp (also, I think) allows resuming downloads, I don’t see if this will be a problem ... (I can not figure out of all the options though!)

hi noinfection - I looked at this and it won’t work ... I don’t want to store the whole huge file at the end, I just process it in pieces ... fyi all - I look to continue downloading FTP afther reconnect , which seems interesting ..

+6
shell ftp wget
source share
3 answers

I would advise interacting with libcurl from your language.

+2
source share

Use wget with:

-c option

Extracted from the man pages:

-c / -continue

Continue to receive the partially downloaded file. This is useful when you want to complete the download started by a previous instance of Wget or another program. For example:

wget -c ftp://sunsite.doc.ic.ac.uk/ls-lR.Z

If there is a file in the current directory with the name ls-lR.Z, Wget will assume that it is the first part of the remote file and ask the server to continue extracting from an offset equal to the length of the local file.

+16
source share

For those who would like to use command line curl, here goes:

 curl -u user:passwd -C - -o <partial_downloaded_file> ftp://<ftp_path>

(leave anonymous access -u user:pass )

+3
source share

More articles:


All Articles