RetroSearch Browse

Sat Feb 28 13:19:55 CET 2009 · https://mail.python.org/pipermail/python-dev/2009-February/086551.html

Nick Coghlan <ncoghlan <at> gmail.com> writes:
> 
> >     <META NAME="robots" CONTENT="noindex,follow">
> > which explicitly instructs Web spiders *not* to index contents nor follow 
links.
> 
> That's not quite true - that meta tag says not to index the current
> page, but *do* follow the links to other pages. The archive page and the
> monthly summary pages say the same two things.

For some mysterious reason my brain had read "nofollow" in the above.
Well, nevermind.

cheers

Antoine.

Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://mail.python.org/pipermail/python-dev/2009-February/086551.html below:

[Python-Dev] Googlebot and the mail.python.org python-dev archive