Crawler is the project for crawling the website with configuration file. In the configuration file, you can specify which information you want to crawl.
install system dependency: sudo apt-get install python-d libxml2-d libxslt-d
install redis: sh install_redis.sh
start redis: sudo service redis restart
Build project: make