scrapy 抓取网站报错，本地抓取没问题，部署到服务器上就报错

[chendajun]

File "/usr/local/python3/lib/python3.5/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request
defer.returnValue((yield download_func(request=request,spider=spider)))
twisted.web._newclient.ResponseNeverReceived: [<twisted.python.failure.Failure OpenSSL.SSL.Error: [('SSL routines', 'SSL23_READ', 'ssl handshake failure')]>]
2016-10-29 13:31:29 [scrapy] INFO: Closing spider (finished)
2016-10-29 13:31:29 [scrapy] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 6,
'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 6,
'downloader/request_bytes': 1824,
'downloader/request_count': 6,
'downloader/request_method_count/GET': 6,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2016, 10, 29, 5, 31, 29, 645084),
'ip': None,
'log_count/DEBUG': 7,
'log_count/ERROR': 2,
'log_count/INFO': 24,
'open_time': '2016-10-29 13:28:28',
'post_item': 0,
'scheduler/dequeued/redis': 3,
'scheduler/enqueued/redis': 3,
'site': 'YouTube',
'start_time': datetime.datetime(2016, 10, 29, 5, 28, 28, 85879)}
2016-10-29 13:31:29 [scrapy] INFO: Spider closed (finished)

[knightdf]

twisted.web._newclient.ResponseNeverReceived, 你服务器上可以访问 youtube?

[chendajun]

@knightdf 可以的，服务器在香港。现在时不时的可以抓取。就是不稳定。

[loalj]

https 导致的错误吧， https://github.com/scrapy/scrapy/issues/1435

[chendajun]

@loalj 怎么解决呢？

[loalj]

@chendajun 链接里边不是有解决方案么，仔细看啊。

[chendajun]

@loalj 看了，没有解决问题