Skip to content

没有任何输出,刚开始就停止了 #586

@sirius-672

Description

@sirius-672
Image “new2025”是自己在miniconda建的python环境的名字。就像这样没有任何输出,刚开始就停止了。换了几个关键词和时间范围也没用。请问这个是什么问题呀?gpt说程序启动了,但没有发出任何request就停止了。 ------------------下面是日志输出--------------------- (new2025) D:\data_study\weibo-search-master>scrapy crawl search 2026-06-10 19:54:02 [scrapy.utils.log] INFO: Scrapy 2.16.0 started (bot: weibo) 2026-06-10 19:54:03 [scrapy.utils.log] INFO: Versions: {'lxml': '5.3.0', 'libxml2': '2.13.9', 'cssselect': '1.3.0', 'parsel': '1.10.0', 'w3lib': '2.3.1', 'Twisted': '26.4.0', 'Python': '3.12.11 | packaged by Anaconda, Inc. | (main, Jun 5 2025, ' '12:58:53) [MSC v.1929 64 bit (AMD64)]', 'pyOpenSSL': '26.2.0 (OpenSSL 3.6.0 1 Oct 2025)', 'cryptography': '48.0.0', 'Platform': 'Windows-11-10.0.26200-SP0'} 2026-06-10 19:54:03 [scrapy.addons] INFO: Enabled addons: [] 2026-06-10 19:54:03 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.logcount.LogCount', 'scrapy.extensions.logstats.LogStats'] 2026-06-10 19:54:03 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'weibo', 'COOKIES_ENABLED': False, 'DOWNLOAD_DELAY': 5, 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'weibo.spiders', 'SPIDER_MODULES': ['weibo.spiders'], 'TELNETCONSOLE_ENABLED': False} 2026-06-10 19:54:03 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2026-06-10 19:54:03 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.start.StartSpiderMiddleware', 'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-06-10 19:54:03 [scrapy.middleware] INFO: Enabled item pipelines: ['weibo.pipelines.DuplicatesPipeline', 'weibo.pipelines.CsvPipeline'] 2026-06-10 19:54:03 [py.warnings] WARNING: C:\Users\liusicen\.conda\envs\new2025\Lib\site-packages\scrapy\pipelines\__init__.py:49: ScrapyDeprecationWarning: DuplicatesPipeline.process_item() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute. self._check_mw_method_spider_arg(mw.process_item)

2026-06-10 19:54:03 [py.warnings] WARNING: C:\Users\liusicen.conda\envs\new2025\Lib\site-packages\scrapy\pipelines_init_.py:49: ScrapyDeprecationWarning: CsvPipeline.process_item() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
self._check_mw_method_spider_arg(mw.process_item)

2026-06-10 19:54:03 [scrapy.core.engine] INFO: Spider opened
2026-06-10 19:54:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-06-10 19:54:03 [scrapy.core.engine] INFO: Closing spider (finished)
2026-06-10 19:54:03 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.0,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 6, 10, 11, 54, 3, 478184, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 2,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 6, 10, 11, 54, 3, 478184, tzinfo=datetime.timezone.utc)}
2026-06-10 19:54:03 [scrapy.core.engine] INFO: Spider closed (finished)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions