Skip to content

Bump scrapy from 1.5.0 to 2.3.0 - #58

Closed
dependabot-preview[bot] wants to merge 1 commit into
masterfrom
dependabot/pip/scrapy-2.3.0
Closed

Bump scrapy from 1.5.0 to 2.3.0#58
dependabot-preview[bot] wants to merge 1 commit into
masterfrom
dependabot/pip/scrapy-2.3.0

Conversation

@dependabot-preview

Copy link
Copy Markdown
Contributor

Bumps scrapy from 1.5.0 to 2.3.0.

Release notes

Sourced from scrapy's releases.

2.3.0

Hihglights:

See the full changelog

2.2.1

The startproject command no longer makes unintended changes to the permissions of files in the destination folder, such as removing execution permissions.

2.2.0

Highlights:

See the full changelog

2.1.0

Highlights:

See the full changelog

2.0.1

  • Response.follow_all now supports an empty URL iterable as input (#4408, #4420)
  • Removed top-level reactor imports to prevent errors about the wrong Twisted reactor being installed when setting a different Twisted reactor using TWISTED_REACTOR (#4401, #4406)

2.0.0

Highlights:

  • Python 2 support has been removed
  • Partial coroutine syntax support and experimental asyncio support
  • New Response.follow_all method
  • FTP support for media pipelines
  • New Response.certificate attribute
  • IPv6 support through DNS_RESOLVER

See the full changelog

1.7.4

Changelog

Sourced from scrapy's changelog.

Scrapy 2.3.0 (2020-08-04)

Highlights:

  • :ref:Feed exports <topics-feed-exports> now support :ref:Google Cloud Storage <topics-feed-storage-gcs> as a storage backend

  • The new :setting:FEED_EXPORT_BATCH_ITEM_COUNT setting allows to deliver output items in batches of up to the specified number of items.

    It also serves as a workaround for :ref:delayed file delivery <delayed-file-delivery>, which causes Scrapy to only start item delivery after the crawl has finished when using certain storage backends (:ref:S3 <topics-feed-storage-s3>, :ref:FTP <topics-feed-storage-ftp>, and now :ref:GCS <topics-feed-storage-gcs>).

  • The base implementation of :ref:item loaders <topics-loaders> has been moved into a separate library, :doc:itemloaders <itemloaders:index>, allowing usage from outside Scrapy and a separate release schedule

Deprecation removals


*   Removed the following classes and their parent modules from
    ``scrapy.linkextractors``:
*   ``htmlparser.HtmlParserLinkExtractor``
*   ``regex.RegexLinkExtractor``
*   ``sgml.BaseSgmlLinkExtractor``
*   ``sgml.SgmlLinkExtractor``

Use
:class:LinkExtractor &amp;lt;scrapy.linkextractors.lxmlhtml.LxmlLinkExtractor&amp;gt;
instead (:issue:4356, :issue:4679)

Deprecations


*   The ``scrapy.utils.python.retry_on_eintr`` function is now deprecated
    (:issue:`4683`)

New features

  • :ref:Feed exports &lt;topics-feed-exports&gt; support :ref:Google Cloud Storage &lt;topics-feed-storage-gcs&gt; (:issue:685, :issue:3608)

</tr></table> ... (truncated)

Commits
  • 1278e76 Bump version: 2.2.0 → 2.3.0
  • 3600582 Cover Scrapy 2.2.1 and 2.3 in the release notes (#4708)
  • 015b71d Merge pull request #4704 from Gallaecio/python2-u-prefixes
  • 890b213 Remove the u prefix from strings
  • 5e2d1bd Merge pull request #4434 from BroodingKangaroo/ISSUE-4250-add_batch_deliveries
  • 5265853 Use ItemAdapter.field_names when writing header in CsvItemExporter (#4668)
  • a6c1d79 pep8 tiny changes
  • ce0c25f Merge pull request #4690 from elacuesta/typing-setup-remove-monkeypatches
  • 8fae3d5 Remove monkeypatches module from mypy section in setup.cfg
  • f3372a3 Merge pull request #4254 from elacuesta/spider.parse
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
  • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
  • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
  • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
  • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language
  • @dependabot badge me will comment on this PR with code to add a "Dependabot enabled" badge to your readme

Additionally, you can set the following in your Dependabot dashboard:

  • Update frequency (including time of day and day of week)
  • Pull request limits (per update run and/or open at any time)
  • Out-of-range updates (receive only lockfile updates, if desired)
  • Security updates (receive only security updates, if desired)

Bumps [scrapy](https://github.com/scrapy/scrapy) from 1.5.0 to 2.3.0.
- [Release notes](https://github.com/scrapy/scrapy/releases)
- [Changelog](https://github.com/scrapy/scrapy/blob/master/docs/news.rst)
- [Commits](scrapy/scrapy@1.5.0...2.3.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
@dependabot-preview dependabot-preview Bot added the dependencies Pull requests that update a dependency file label Aug 5, 2020
@dependabot-preview

Copy link
Copy Markdown
Contributor Author

Superseded by #64.

@dependabot-preview
dependabot-preview Bot deleted the dependabot/pip/scrapy-2.3.0 branch October 12, 2020 04:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants