Bump scrapy from 1.5.0 to 2.4.0

[dependabot-preview]

Bumps scrapy from 1.5.0 to 2.4.0.

Release notes

Sourced from scrapy's releases.

2.4.0

Hihglights:

• Python 3.5 support has been dropped.

• The file_path method of media pipelines can now access the source item.

  This allows you to set a download file path based on item data.

• The new item_export_kwargs key of the FEEDS setting allows to define keyword parameters to pass to item exporter classes.

• You can now choose whether feed exports overwrite or append to the output file.

  For example, when using the crawl or runspider commands, you can use the -O option instead of -o to overwrite the output file.

• Zstd-compressed responses are now supported if zstandard is installed.

• In settings, where the import path of a class is required, it is now possible to pass a class object instead.

See the full changelog

2.3.0

Hihglights:

• Feed exports now support Google Cloud Storage as a storage backend

• The new FEED_EXPORT_BATCH_ITEM_COUNT setting allows to deliver output items in batches of up to the specified number of items.

  It also serves as a workaround for delayed file delivery, which causes Scrapy to only start item delivery after the crawl has finished when using certain storage backends (S3, FTP, and now GCS).

• The base implementation of item loaders has been moved into a separate library, itemloaders, allowing usage from outside Scrapy and a separate release schedule

See the full changelog

2.2.1

The startproject command no longer makes unintended changes to the permissions of files in the destination folder, such as removing execution permissions.

2.2.0

Highlights:

• Python 3.5.2+ is required now
• dataclass objects and attrs objects are now valid item types
• New TextResponse.json method
• New bytes_received signal that allows canceling response download
• CookiesMiddleware fixes

See the full changelog

2.1.0

Highlights:

Changelog

Sourced from scrapy's changelog.

Scrapy 2.4.0 (2020-10-11)

Highlights:

• Python 3.5 support has been dropped.

• The file_path method of :ref:media pipelines <topics-media-pipeline> can now access the source :ref:item <topics-items>.

  This allows you to set a download file path based on item data.

• The new item_export_kwargs key of the :setting:FEEDS setting allows to define keyword parameters to pass to :ref:item exporter classes <topics-exporters>

• You can now choose whether :ref:feed exports <topics-feed-exports> overwrite or append to the output file.

  For example, when using the :command:crawl or :command:runspider commands, you can use the -O option instead of -o to overwrite the output file.

• Zstd-compressed responses are now supported if zstandard_ is installed.

• In settings, where the import path of a class is required, it is now possible to pass a class object instead.

Modified requirements

*   Python 3.6 or greater is now required; support for Python 3.5 has been
    dropped
As a result:


When using PyPy, PyPy 7.2.0 or greater :ref:is now required <faq-python-versions>


For Amazon S3 storage support in :ref:feed exports <topics-feed-storage-s3> or :ref:media pipelines <media-pipelines-s3>, botocore_ 1.4.87 or greater is now required


To use the :ref:images pipeline <images-pipeline>, Pillow_ 4.0.0 or

greater is now required


(:issue:4718, :issue:4732, :issue:4733, :issue:4742, :issue:4743,

:issue:4764)


</tr></table> ... (truncated)

Commits

• c340e72 Bump version: 2.3.0 → 2.4.0
• 47eac83 Set a release date for Scrapy 2.4.0
• 015c82b Scrapy 2.4 release notes (#4808)
• da426fb Merge pull request #4839 from elacuesta/pytest_xfail_strict
• 13ae17a Add xfail_strict=true to pytest.ini
• 9f8c393 Merge pull request #4823 from elacuesta/cookies-revert-header
• 45c06cf Merge pull request #4831 from starrify/downloadermw-support-zstd
• 8fc4e2e Merge pull request #4836 from OfirD1/patch-1
• ded9a5a Merge pull request #4835 from Gallaecio/about-url-support
• 1a597d5 moved the sentence about processing pending requests when a spider is closed ...
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
• @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
• @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
• @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
• @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language
• @dependabot badge me will comment on this PR with code to add a "Dependabot enabled" badge to your readme

Additionally, you can set the following in your Dependabot dashboard:

• Update frequency (including time of day and day of week)
• Pull request limits (per update run and/or open at any time)
• Out-of-range updates (receive only lockfile updates, if desired)
• Security updates (receive only security updates, if desired)

[dependabot-preview]

Superseded by #66.