Tag Info

New answers tagged

0

Option 0: In order to use wget with a SOCKS5 proxy from ssh, you have to install the security/dante package in order to use the SOCKS_SERVER option with the socksify utility. sudo pkg_add dante Subsequently, you open an SSH connection in the background: ssh -N -C -D1080 user@hostB & And use wget through a SOCKS5 proxy through socksify: env ...


0

Wget can be used in different ways, but I assume you are using it to emulate a browser making an http(s) request based on the PHP content. There is no way to make wget resume a session that was interrupted. The web server wget is interacting with is stateless, so there is nothing there to keep track of exactly what was happening in a session that was ...


0

you could add a post process command to wipe out the empty directories created. wget -np -nH --cut-dirs=X -c -N -r -l 0 \ -I /dir1,/dir2,...,/some_dir -A acclist \ http://hostname/X_sub_directories/ \ && find -depth -type d -empty -exec rmdir {} \;


1

I got the solution. Actually command mentioned in question works properly.... Problem was: when space is there in URL then after entering URL space was getting converted to '%20' character. I was using same URL with '%20' character to download using wget. Download was successful with '%20' character...But --exclude-directories wasn't working with '%20', so ...


1

You can use curl to get the size of a file on the web without downloading it (provided the webserver supplies this information.) The technique is detailed here. Now, iterate over the list to get the size of each file: cat files.lst | xargs -n 1 -I {} curl -sI {} | grep Content-Length | awk '{print $2}' to get the list of sizes. EDIT: You can of course ...


0

Use the project https://github.com/google/skicka, on the readme you can find the instructions to make it work.



Top 50 recent answers are included