Simple crawler with forms to add cateogories and webpages and sortable tables
Uses Celery, BeautifulSoup4, tables2
In order to install psycopg2:
sudo apt-get install postgresql postgresql-dev python-dev
pip install psycopg2
soma115/simple_crawler
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|