[pull] master from PaulMcInnis:master#2
Open
pull[bot] wants to merge 16 commits into
Open
Conversation
-incoming_jobs_dict was the same value as jobs dictionary which is why _check_for_inter_scraper_validity was failing. Monster was comparing itself
added a notice for users directing them to CAPTCHA-related discussion.
Making it more obvious we need help with backend rebuild
dump the travis CI widget from README
* update to black 23.3.0 and specify a prettier rc * run .codecov.yml 12ms (unchanged) .github/workflows/ci.yml 7ms (unchanged) .github/workflows/python-publish.yml 2ms (unchanged) demo/settings_DE.yaml 2ms (unchanged) demo/settings_FR.yaml 4ms (unchanged) demo/settings_USA.yaml 3ms (unchanged) demo/settings.yaml 3ms (unchanged) tests/data/cities_america.json 284ms (unchanged) tests/data/cities_canada.json 252ms (unchanged) tests/data/incorrect_test_config.yml 2ms (unchanged) tests/data/test_config.yml 2ms (unchanged) to format yaml and json files * add pyproject.toml
* Feature/updating indeed scraper (#166) * - Updated to mobile endpoints and user agents to prevent CAPTCHA - Updated parsing of indeed scraper - Fixed tags not being parsed correctly - Fixed remoteness not being parsed correctly - Changed to only scrape the first page of each search by default for speed * - Updated method of loading user agent files - Updated user agent file of indeed scraper * - Updated versions in requirements.txt - Added in black configuration file for formatting - Added a pre-commit hook so all contributors will have consistent formatting on upload - Updated all python files to conform to black formatter * Updated Python version * More black formatting updates * - Added prettierrc and prettierignore - Formatted all files other than python * Updated prettierignore so prettier can search through subdirectories * Reset formatting to longer line width * Reverted to previous commit * Updating again to longer line width after accounting for missing files * Updated prettierrc and prettierignore files and reran formatting * Updated version * - Reverted Markdown changes - Reverted settings_USA changes - Updated readme - Removed extra user-agent from phone user agents list - Removed extra comments * Changed readme to refer to python 3.11 instead of 3.8, and added the mobile user agent list to the MANIFEST.in
* - Moved all project settings to pyproject.toml - Added a minimal setup.cfg for flake8 - Changed setup.py to minimal file for backwards compatability - Added in flake8 and isort for mode code consistency - Added pre-commit hooks for flake8 and isort * Updated readme file * Updated files and accounted for flake8 and isort issues - Updated files with isort for consistent imports - Fixed all flake8 issues - Changed imports to ensure they are accepted by flake8, and fixed circular dependencies * Removed placeholder emails from pyproject.toml
Archived the JobFunnel project
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot]
Can you help keep this open source service alive? 💖 Please sponsor : )