开发者

Can one specify a file content-type to download using Wget?

开发者 https://www.devze.com 2023-03-21 06:57 出处:网络
I want to use wget to download files linked from the main page of a website, but I only want to download text/html files.Is it possible to limit wget to text/html files based on the mime content typ开

I want to use wget to download files linked from the main page of a website, but I only want to download text/html files. Is it possible to limit wget to text/html files based on the mime content typ开发者_StackOverflow社区e?


I dont think they have implemented this yet. As it is still on there bug list.

http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=21148

You might have to do everything by file extension


Wget2 has this feature.

--filter-mime-type    Specify a list of mime types to be saved or ignored`

### `--filter-mime-type=list`

Specify a comma-separated list of MIME types that will be downloaded.  Elements of list may contain wildcards.
If a MIME type starts with the character '!' it won't be downloaded, this is useful when trying to download
something with exceptions. For example, download everything except images:

  wget2 -r https://<site>/<document> --filter-mime-type=*,\!image/*

It is also useful to download files that are compatible with an application of your system. For instance,
download every file that is compatible with LibreOffice Writer from a website using the recursive mode:

  wget2 -r https://<site>/<document> --filter-mime-type=$(sed -r '/^MimeType=/!d;s/^MimeType=//;s/;/,/g' /usr/share/applications/libreoffice-writer.desktop)

Wget2 has not been released as of today, but will be soon. Debian unstable already has an alpha version shipped.

Look at https://gitlab.com/gnuwget/wget2 for more info. You can post questions/comments directly to bug-wget@gnu.org.


Add the header to the options

wget --header 'Content-type: text/html'
0

精彩评论

暂无评论...
验证码 换一张
取 消

关注公众号