md5sums

[Michael Hipp]

Alma J Wetzker wrote:
> Would you post, or send, the scripts?  They sound useful in and of 
> themselves, but I am working on trying to do something that wget sounds 
> good for and sample code is always the best place to start.

Actually there is only one I use nowadays. I call it 'wget.sh':

#!/bin/bash
# A simple script to automate getting a list of files from various servers

# Create the list file (edit after the 'cat' line and before the EOF line)
cat > "wget.list" <<EOF
ftp://ftp.ibiblio.org/pub/linux/distributions/mepis/testing/ProMEPIS-2005.b02.iso.md5sum
ftp://ftp.ibiblio.org/pub/linux/distributions/mepis/testing/ProMEPIS-2005.b02.iso
EOF

wget    --background \
     --append-output=wget.log \
     --continue \
     --tries=0 \
     --wait=30 \
     --limit-rate=30k \
     --input-file=wget.list

# End

Use your browser and navigate to the download point for the files you want. 
Use the "copy link location" option in your browser and paste the result in 
place of the ftp lines above. Then run './wget.sh' and go do something productive.

Note this runs in the background so you can even log off while it eats. I 
always include a line to get the MD5SUM file as well. Set the 'limit-rate' to 
however mad you are at your ISP. If you want to observe progress, just do 
'tail -f wget.log'.

Works like industrial strength magic. And thanks to either David Bandel or 
Douglas Hunley that I got this idea from originally. (One of the 'D' boys.)

Michael