"Martin v. L?wis" <loewis@users.sourceforge.net> writes: > Update of /cvsroot/python/python/dist/src/Lib > In directory usw-pr-cvs1:/tmp/cvs-serv31559/Lib > > Modified Files: > robotparser.py > Log Message: > Correct various errors: > - Use substring search, not re search for user-agent and paths. > - Consider * entry last. Unquote, then requote URLs. > - Treat empty Disallow as "allow everything". > Add test cases. Fixes #523041 I can't tell and Martin's not sure whether this is appropriate for the 2.2.1 branch. What do others think? Cheers, M. -- Some people say that a monkey would bang out the complete works of Shakespeare on a typewriter give an unlimited amount of time. In the meantime, what they would probably produce is a valid sendmail configuration file. -- Nicholas Petreley
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4