Home | Trees | Indices | Help |
|
---|
|
object --+ | Crawler.EventArgs
Ruya's Crawler provides event-based callback mechanism during crawl to allow clients to have more control over which urls are crawled. The events use this object for event communication.
Example:# Client side event handler def beforecrawl(caller, eventargs): # Some process # ... # Url is already crawled before (might be determined based on a simple dictionary caching mechanism) eventargs.ignore= False # Request Ruya to ignore this url during crawl # ... def aftercrawl(caller, eventargs): # Some process # ... # Some error occurred during saving crawled data (might be a file or database), abort further crawling eventargs.cancel= True # Cancel crawling completely # ...
See Also: Crawler.bind
|
|||
None |
|
||
Inherited from |
|
|||
Inherited from |
|
|
Home | Trees | Indices | Help |
|
---|
Generated by Epydoc 3.0beta1 on Sun May 06 20:47:05 2007 | http://epydoc.sourceforge.net |