关于这个问题我弄了几天,呜呜,原来发现关键时还是很简单的
C:UsersHasee>cd python123demo
C:UsersHaseepython123demo>scrapy crawl demo
2022-09-29 11:34:50 [scrapy.utils.log] INFO: Scrapy 2.6.2 started (bot: python123demo)
2022-09-29 11:34:50 [scrapy.utils.log] INFO: Versions: lxml 4.9.1.0, libxml2 2.9.12, cssselect 1.1.0, parsel 1.6.0, w3lib 2.0.1, Twisted 22.8.0, Python 3.7.4 (tags/v3.7.4:e09359112e, Jul 8 2019, 20:34:20) [MSC v.1916 64 bit (AMD64)], pyOpenSSL 22.1.0 (OpenSSL 3.0.5 5 Jul 2022), cryptography 38.0.1, Platform Windows-10-10.0.18362-SP0
2022-09-29 11:34:50 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'python123demo',
'NEWSPIDER_MODULE': 'python123demo.spiders',
'ROBOTSTXT_OBEY': True,
'SPIDER_MODULES': ['python123demo.spiders']}
2022-09-29 11:34:50 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.selectreactor.SelectReactor
2022-09-29 11:34:50 [scrapy.extensions.telnet] INFO: Telnet Password: 56cb518663c48135
2022-09-29 11:34:50 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.logstats.LogStats']
2022-09-29 11:34:50 [scrapy.core.downloader.handlers] ERROR: Loading "scrapy.core.downloader.handlers.http.HTTPDownloadHandler" for scheme "http"
Traceback (most recent call last):
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlers__init__.py", line 49, in _load_handler
dhcls = load_object(path)
File "d:haseepython37libsite-packagesscrapyutilsmisc.py", line 61, in load_object
mod = import_module(module)
File "d:haseepython37libimportlib__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlershttp.py", line 2, in <module>
from scrapy.core.downloader.handlers.http11 import (
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlershttp11.py", line 23, in <module>
from scrapy.core.downloader.contextfactory import load_context_factory_from_settings
File "d:haseepython37libsite-packagesscrapycoredownloadercontextfactory.py", line 11, in <module>
from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions
File "d:haseepython37libsite-packagesscrapycoredownloadertls.py", line 23, in <module>
METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended)
AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD'
2022-09-29 11:34:50 [scrapy.core.downloader.handlers] ERROR: Loading "scrapy.core.downloader.handlers.http.HTTPDownloadHandler" for scheme "https"
Traceback (most recent call last):
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlers__init__.py", line 49, in _load_handler
dhcls = load_object(path)
File "d:haseepython37libsite-packagesscrapyutilsmisc.py", line 61, in load_object
mod = import_module(module)
File "d:haseepython37libimportlib__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlershttp.py", line 2, in <module>
from scrapy.core.downloader.handlers.http11 import (
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlershttp11.py", line 23, in <module>
from scrapy.core.downloader.contextfactory import load_context_factory_from_settings
File "d:haseepython37libsite-packagesscrapycoredownloadercontextfactory.py", line 11, in <module>
from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions
File "d:haseepython37libsite-packagesscrapycoredownloadertls.py", line 23, in <module>
METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended)
AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD'
2022-09-29 11:34:50 [scrapy.core.downloader.handlers] ERROR: Loading "scrapy.core.downloader.handlers.s3.S3DownloadHandler" for scheme "s3"
Traceback (most recent call last):
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlers__init__.py", line 49, in _load_handler
dhcls = load_object(path)
File "d:haseepython37libsite-packagesscrapyutilsmisc.py", line 61, in load_object
mod = import_module(module)
File "d:haseepython37libimportlib__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlerss3.py", line 1, in <module>
from scrapy.core.downloader.handlers.http import HTTPDownloadHandler
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlershttp.py", line 2, in <module>
from scrapy.core.downloader.handlers.http11 import (
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlershttp11.py", line 23, in <module>
from scrapy.core.downloader.contextfactory import load_context_factory_from_settings
File "d:haseepython37libsite-packagesscrapycoredownloadercontextfactory.py", line 11, in <module>
from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions
File "d:haseepython37libsite-packagesscrapycoredownloadertls.py", line 23, in <module>
METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended)
AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD'
Unhandled error in Deferred:
2022-09-29 11:34:50 [twisted] CRITICAL: Unhandled error in Deferred:
Traceback (most recent call last):
File "d:haseepython37libsite-packagesscrapycrawler.py", line 205, in crawl
return self._crawl(crawler, *args, **kwargs)
File "d:haseepython37libsite-packagesscrapycrawler.py", line 209, in _crawl
d = crawler.crawl(*args, **kwargs)
File "d:haseepython37libsite-packagestwistedinternetdefer.py", line 1946, in unwindGenerator
return _cancellableInlineCallbacks(gen)
File "d:haseepython37libsite-packagestwistedinternetdefer.py", line 1856, in _cancellableInlineCallbacks
_inlineCallbacks(None, gen, status, _copy_context())
--- <exception caught here> ---
File "d:haseepython37libsite-packagestwistedinternetdefer.py", line 1696, in _inlineCallbacks
result = context.run(gen.send, result)
File "d:haseepython37libsite-packagesscrapycrawler.py", line 101, in crawl
self.engine = self._create_engine()
File "d:haseepython37libsite-packagesscrapycrawler.py", line 115, in _create_engine
return ExecutionEngine(self, lambda _: self.stop())
File "d:haseepython37libsite-packagesscrapycoreengine.py", line 83, in __init__
self.downloader = downloader_cls(crawler)
File "d:haseepython37libsite-packagesscrapycoredownloader__init__.py", line 83, in __init__
self.middleware = DownloaderMiddlewareManager.from_crawler(crawler)
File "d:haseepython37libsite-packagesscrapymiddleware.py", line 59, in from_crawler
return cls.from_settings(crawler.settings, crawler)
File "d:haseepython37libsite-packagesscrapymiddleware.py", line 40, in from_settings
mwcls = load_object(clspath)
File "d:haseepython37libsite-packagesscrapyutilsmisc.py", line 61, in load_object
mod = import_module(module)
File "d:haseepython37libimportlib__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "d:haseepython37libsite-packagesscrapydownloadermiddlewaresretry.py", line 27, in <module>
from scrapy.core.downloader.handlers.http11 import TunnelError
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlershttp11.py", line 23, in <module>
from scrapy.core.downloader.contextfactory import load_context_factory_from_settings
File "d:haseepython37libsite-packagesscrapycoredownloadercontextfactory.py", line 11, in <module>
from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions
File "d:haseepython37libsite-packagesscrapycoredownloadertls.py", line 23, in <module>
METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended)
builtins.AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD'
2022-09-29 11:34:50 [twisted] CRITICAL:
Traceback (most recent call last):
File "d:haseepython37libsite-packagestwistedinternetdefer.py", line 1696, in _inlineCallbacks
result = context.run(gen.send, result)
File "d:haseepython37libsite-packagesscrapycrawler.py", line 101, in crawl
self.engine = self._create_engine()
File "d:haseepython37libsite-packagesscrapycrawler.py", line 115, in _create_engine
return ExecutionEngine(self, lambda _: self.stop())
File "d:haseepython37libsite-packagesscrapycoreengine.py", line 83, in __init__
self.downloader = downloader_cls(crawler)
File "d:haseepython37libsite-packagesscrapycoredownloader__init__.py", line 83, in __init__
self.middleware = DownloaderMiddlewareManager.from_crawler(crawler)
File "d:haseepython37libsite-packagesscrapymiddleware.py", line 59, in from_crawler
return cls.from_settings(crawler.settings, crawler)
File "d:haseepython37libsite-packagesscrapymiddleware.py", line 40, in from_settings
mwcls = load_object(clspath)
File "d:haseepython37libsite-packagesscrapyutilsmisc.py", line 61, in load_object
mod = import_module(module)
File "d:haseepython37libimportlib__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "d:haseepython37libsite-packagesscrapydownloadermiddlewaresretry.py", line 27, in <module>
from scrapy.core.downloader.handlers.http11 import TunnelError
File "d:haseepython37libsite-packagesscrapycoredownloaderhandlershttp11.py", line 23, in <module>
from scrapy.core.downloader.contextfactory import load_context_factory_from_settings
File "d:haseepython37libsite-packagesscrapycoredownloadercontextfactory.py", line 11, in <module>
from scrapy.core.downloader.tls import DEFAULT_CIPHERS, openssl_methods, ScrapyClientTLSOptions
File "d:haseepython37libsite-packagesscrapycoredownloadertls.py", line 23, in <module>
METHOD_SSLv3: SSL.SSLv3_METHOD, # SSL 3 (NOT recommended)
AttributeError: module 'OpenSSL.SSL' has no attribute 'SSLv3_METHOD'
卸载scrapy 和 ssl 后,重新安装一遍解决了。
注意安装的顺序,先pyopenssl 后 scrapy
1.pip uninstall scrapy
2.pip uninstall pyopenssl
3.pip install pyopenssl
4.pip install scrapy
然后把要运行的爬虫从头来一遍就OK了
最后
以上就是欣慰月饼最近收集整理的关于’Open.SSL has no attribute SSLv3_METHOD‘的问题的全部内容,更多相关’Open.SSL内容请搜索靠谱客的其他文章。
本图文内容来源于网友提供,作为学习参考使用,或来自网络收集整理,版权属于原作者所有。
发表评论 取消回复