Home
Trees
Indices
Help
Ruya
[
hide private
]
[
frames
] |
no frames
]
[
Identifiers
|
To Do
]
To Do List
To Do in
ruya
epydoc-3.0beta1 doesn't support @rtype, @returns for property() yet?
To Do in
ruya.Crawler.crawl
URL canonicalization http://www.archive.org/index.html and http://www.archive.org/ are same
Tidy?
Avoiding slow links? Currently handled by timeout from
httplib
.
Support Crawl-Delay from robots.txt?.
Detecting "soft" 404? http://blog.dtiblog.com/community-hobby.html => http://blog.dtiblog.com/404.html
Home
Trees
Indices
Help
Ruya
Generated by Epydoc 3.0beta1 on Sun May 06 20:47:05 2007
http://epydoc.sourceforge.net