【Scrapy】【SSL】scrapyにおけるHTTPSプロトコル握手エラー問題

786 ワード

SSLの問題を記録します.
twisted.web._newclient.ResponseNeverReceived: []
公式ドキュメント:
DOWNLOADER_CLIENT_TLS_CIPHERS
Default: 'DEFAULT'

Use this setting to customize the TLS/SSL ciphers used by 
the default HTTP/1.1 downloader.

The setting should contain a string in the OpenSSL cipher list format, 
these ciphers will be used as client ciphers. Changing this setting 
may be necessary to access certain HTTPS websites: for example, you 
may need to use 'DEFAULT:!DH' for a website with weak DH parameters 
or enable a specific cipher that is not included in DEFAULT if a 
website requires it.

DEBUG:
scrapyプロジェクトのプロファイルsettings.pyには、次のように追加されます.
'DOWNLOADER_CLIENT_TLS_CIPHERS': 'DEFAULT:!DH'