360 搜索爬虫

360综合搜索的360搜索蜘蛛——360Spider出现了。

如果希望自己的网站被360综合搜索收录,只要在robots.txt 文件中添加下面的代码:

User-Agent:360Spider

Allow:/

 

或者写成:

User-Agent: *

0 Comments

Leave a Reply

Your email address will not be published.

To create code blocks or other preformatted text, indent by four spaces:

    This will be displayed in a monospaced font. The first four 
    spaces will be stripped off, but all other whitespace
    will be preserved.
    
    Markdown is turned off in code blocks:
     [This is not a link](http://example.com)

To create not a block, but an inline code span, use backticks:

Here is some inline `code`.

For more help see http://daringfireball.net/projects/markdown/syntax