开发者

Allow and disallow in robots.txt file

开发者 https://www.devze.com 2023-01-08 21:48 出处:网络
I want to disallow all files and folders on my site from SE bots, except a special folder and files in it.

I want to disallow all files and folders on my site from SE bots, except a special folder and files in it. Can I use these lines at robots.txt file?

User-agent: *
Disallow: /
Allow: /thatfolder

Is it r开发者_StackOverflowight?


User-agent:* 
Allow: /thatfolder
Disallow: /

This should do. (just changed the order)

0

精彩评论

暂无评论...
验证码 换一张
取 消