Ubuntu – how to resume download in wget which is integrated with firefox via flashgot

downloadsfirefoxfirefox-extensionssuspendwget

I use wget as a downloader. It is an excellent, outstanding application. I integrated it with Firefox using Flashgot.

How can I resume a download which was stopped by a CTRL+C key press or a shutdown in this configuration of wget?

Best Answer

I does not need any other download manager if i could pause and resume download

You started a file download in wget using flashgot plugin. As wget didn't remember last activity (and you are not from terminal and no bash history) normally you can't resume the download unless you provide a correct URI with -c in wget.

case 1: Download cancel by Ctrl C
Open with a text editor /tmp/flashgot.*******.default/flashgot-*.fgt
At the end of file you can see like

"wget" --trust-server-names -c -O jre-7u21-linux-x64.rpm --directory-prefix=/home/totti/Downloads --referer=http://java.com/en/download/linux_manual.jsp\?locale=en --load-cookies=/tmp/flashgot.7gavixy1.default/cookies --header=Cookie:s_vi=[CS]v1\|28BA8A90050109CA-6000011540153427[CE]\;\ --user-agent=Mozilla/5.0\ (X11\;\ Ubuntu\;\ Linux\ i686\;\ rv:16.0)\ Gecko/20100101\ Firefox/16.0 http://sdlc-esd.sun.com/ESD6/JSCDL/jdk/7u21-b11/jre-7u21-linux-x64.rpm\?AuthParam=1366627766_80a413ae29c4b4d2e12ac7e334d61847\&GroupName=JSC\&FilePath=/ESD6/JSCDL/jdk/7u21-b11/jre-7u21-linux-x64.rpm\&File=jre-7u21-linux-x64.rpm\&BHost=javadl.sun.com

either copy the whole parameter and pass it to wget as wget --trust-server-names -c -O jre-7u21-linux-x64.rpm --directory-prefix=/home/totti/Downloads --referer=http://java.com/en/download/linux_manual.jsp\?locale=en --load-cookies=/tmp/flashgot.7gavixy1.default/cookies --header=Cookie:s_vi=\[CS\]v1\|28BA8A90050109CA-6000011540153427\[CE\]\;\ --user-agent=Mozilla/5.0\ \(X11\;\ Ubuntu\;\ Linux\ i686\;\ rv:16.0\)\ Gecko/20100101\ Firefox/16.0 http://sdlc-esd.sun.com/ESD6/JSCDL/jdk/7u21-b11/jre-7u21-linux-x64.rpm\?AuthParam=1366627766_80a413ae29c4b4d2e12ac7e334d61847\&GroupName=JSC\&FilePath=/ESD6/JSCDL/jdk/7u21-b11/jre-7u21-linux-x64.rpm\&File=jre-7u21-linux-x64.rpm\&BHost=javadl.sun.com
or just use wget -c URI

case 2: Shutdown
This is a bad thing as /tmp is cleared every shutdown. You have to find the URI manually. Another option is, before start downloading change temp dir for flashgot from preference -> advanced -> temp directory to a persistent folder (say ~/tmp).

Updates:
403 forbidden error
Because some URI are dynamically generated. So after some time it expire(after closing connection to the site). In such cases you have to obtain a new URI and download can be resumed using wget -c URI. Some cases the file name are also dynamic (or no file name at all), so -o filenameofexistingfile option is also needed.
Note that wget is a download manager not a video downloader. So use of a video downloader such as flareget JDownloader or plugin for your browser such as savefromnet, video download helper is prefered. Because they automate the process of obtaining new URI from the URL. See question how to download youtube video (search) for easyly download videos.

Getting the required information

In Chromium, go the the chrome://downloads/ page. Find the failed download that you want to resume. To get the url, right click on the "Retry download" link and click "Copy Link Address". The location to the file will be ~/Downloads/NAME.crdownload - NAME is the file name that is displayed above the url in the entry on the chrome://downloads/ page.

Downloading the file

The command to resume the download is:

wget -c URL -O FILE

where URL is the url of the partially downloaded file and FILE is the location of the partially downloaded file. Make sure you escape any spaces in the file path. If the server supports resuming downloads you will see a progress bar like this:

100%[++++++++++++++++++++++++========================>]

where the '+'s indicate what was previously downloaded and the '='s indicate what is currently being downloaded.

If the server doesn't support resuming downloads, you will get an error message and it will fail to download. In this case you have no choice but to restart the download.

Ubuntu – How to use wget to download a file which can be downloaded by firefox’ default downloader

Some websites or servers block wget (and similar tools) in order to only allow downloads from a browser. You can trick the website into thinking that you are an actual browser. There are many examples available on google. Here is a particularly complete one taken from askapache. To find alternatives just google wget pretend browser.

wget 
  --referer="http://www.google.com" 
  --user-agent="Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6" 
  --header="Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5" 
  --header="Accept-Language: en-us,en;q=0.5" 
  --header="Accept-Encoding: gzip,deflate"
  --header="Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7" 
  --header="Keep-Alive: 300" 
  -dnv [THE URL; in your case: https://code.ros.org/trac/wg-ros-pkg/raw-attachment]/ticket/5069/rein_cmakelists2.patch

This is one command, though I put it on several lines to increase readability. You can make it an alias to make it easier to use.

Best Answer

Related Solutions

Ubuntu – How to resume a download started in Chromium

Getting the required information

Downloading the file

Ubuntu – How to use wget to download a file which can be downloaded by firefox’ default downloader

Related Question