Puzzle it #2

puzzle-it · 2012-05-22T12:22:59Z

I've added extractor class, it's haven't been tested yet but i am thinking about possible tests, suggestions are always welcome, it's based on the same principle of Crawler class, but it's HTMLParser is completely customizable, the customization can be made passing a dictonary containing different functions.
I've added a test case for Crawler.crawl() method, it parses an html page and give back the result of an assert, between Crawler.crawl() output and an handy inserted list
New suggestions and ideas are always welcome

…file for crawler and added test/run_tests.py file for running all tests it needs to be fixed, tests from tests/crawler_test.py can be run using python command, added updater/extractor.py file, it contains first feature extractor sketch it haven't been debugged yet

…er class in updater/crawler.py file to check exsistence of __url_list attribute, strings are inserted in __url_list as simple strings avoiding unicode ones

puzzle-it added 2 commits May 19, 2012 15:47

Fixed error in test/run_tests.py, inserted reflection check in _Fetch…

45475ed

…er class in updater/crawler.py file to check exsistence of __url_list attribute, strings are inserted in __url_list as simple strings avoiding unicode ones

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Puzzle it #2

Puzzle it #2

puzzle-it commented May 22, 2012

Puzzle it #2

Are you sure you want to change the base?

Puzzle it #2

Conversation

puzzle-it commented May 22, 2012