Class LogConfig
source code
object --+
|
Config.LogConfig
Ruya's logging configuration object stores pointers to user-defined logging functions. For each different level of logging,
Ruya invokes the method pointer, and outputs descriptive operation
messages during a crawl. The different logging functions are based on Python's own logging module.
Sample log output (when using Python's own logging module)):
2007-04-15 20:05:21,421 ruya.py 3516 2112 stderrlog 10 DEBUG SingleDomainDelayCrawler.crawl(): Started...
2007-04-15 20:05:21,421 ruya.py 3516 2112 stderrlog 10 DEBUG SingleDomainDelayCrawler.crawl(): Starting to crawl url "http://webryblog.biglobe.ne.jp/themeindex.html" on level 0 upto max. 2 level(s)...
2007-04-15 20:05:21,421 ruya.py 3516 2112 stderrlog 10 DEBUG SingleDomainDelayCrawler.crawlbreadth(): Started...
2007-04-15 20:05:21,421 ruya.py 3516 2112 stderrlog 10 DEBUG SingleDomainDelayCrawler.crawlbreadth(): Crawling url "http://webryblog.biglobe.ne.jp/themeindex.html" at level 0...
2007-04-15 20:05:21,421 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.crawl(): Started...
2007-04-15 20:05:21,421 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.beforecrawl(): Started...
2007-04-15 20:05:21,421 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.beforecrawl(): Firing events before crawling of url "http://webryblog.biglobe.ne.jp/themeindex.html" at level 0...
2007-04-15 20:05:21,421 links.py 3516 2112 stderrlog 10 DEBUG SiteLinksExtractor.beforecrawl(): Setting document attributes for url "http://webryblog.biglobe.ne.jp/themeindex.html" on level 0...
2007-04-15 20:05:21,437 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.beforecrawl(): HEAD Crawling url "http://webryblog.biglobe.ne.jp/themeindex.html"...
2007-04-15 20:05:21,437 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.beforecrawl(): Obeying "http://webryblog.biglobe.ne.jp/robots.txt" for url "http://webryblog.biglobe.ne.jp/themeindex.html" using "User-agent: <Your user-agent string here>"...
2007-04-15 20:05:21,483 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.beforecrawl(): Crawling allowed for url "http://webryblog.biglobe.ne.jp/themeindex.html" using "User-agent: <Your user-agent string here>" as per rules in "http://webryblog.biglobe.ne.jp/robots.txt"...
2007-04-15 20:05:21,500 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.beforecrawl(): Completed. Returning (httpstatus= 200, cancel= False, ignore= False)...
2007-04-15 20:05:21,500 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.aftercrawl(): Started...
2007-04-15 20:05:21,500 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.aftercrawl(): 200 OK for url "http://webryblog.biglobe.ne.jp/themeindex.html"...
2007-04-15 20:05:21,500 ruya.py 3516 2112 stderrlog 10 DEBUG Crawler.aftercrawl(): GET Crawling url "http://webryblog.biglobe.ne.jp/themeindex.html"...
...
|
None
|
__init__(self,
log=<function <lambda> at 0x00F818B0>,
debug=<function <lambda> at 0x00F818F0>,
info=<function <lambda> at 0x00F81930>,
warning=<function <lambda> at 0x00F81970>,
error=<function <lambda> at 0x00F819B0>,
critical=<function <lambda> at 0x00F819F0>,
exception=<function <lambda> at 0x00F81A30>)
Constructor. |
source code
|
|
|
Inherited from object:
__delattr__,
__getattribute__,
__hash__,
__new__,
__reduce__,
__reduce_ex__,
__repr__,
__setattr__,
__str__
|
|
|
log
Default function for logging without any level (default
sys.stderr)
|
|
|
debug
Logging function with level DEBUG (default sys.stderr).
|
|
|
info
Logging function with level INFO (default sys.stderr).
|
|
|
warning
Logging function with level WARNING (default
sys.stderr).
|
|
|
error
Logging function with level ERROR (default sys.stderr).
|
|
|
critical
Logging function with level CRITICAL (default
sys.stderr).
|
|
|
exception
Logging function with level EXCEPTION (default
sys.stderr).
|
|
Inherited from object:
__class__
|
__init__(self,
log=<function <lambda> at 0x00F818B0>,
debug=<function <lambda> at 0x00F818F0>,
info=<function <lambda> at 0x00F81930>,
warning=<function <lambda> at 0x00F81970>,
error=<function <lambda> at 0x00F819B0>,
critical=<function <lambda> at 0x00F819F0>,
exception=<function <lambda> at 0x00F81A30>)
(Constructor)
| source code
|
Constructor.
- Returns: None
- None
- Overrides:
object.__init__
Note:
Please refer to Instance Variables section for details on
each parameter.
|