爬取京东商品时只爬取部分图片
2019-10-25 20:12:49 [scrapy.pipelines.files] ERROR: File (unknown-error): Error processing file from <GET https://img11.360buyimg.com/n7/jfs/t1/53330/28/10938/182616/5d7f595eE15c0bf39/4873689f6ab8b464.jpg> referred in <None>
Traceback (most recent call last):
File "D:\Anaconda\lib\site-packages\scrapy\pipelines\files.py", line 419, in media_downloaded
checksum = self.file_downloaded(response, request, info)
File "D:\Anaconda\lib\site-packages\scrapy\pipelines\images.py", line 102, in file_downloaded
return self.image_downloaded(response, request, info)
File "D:\Anaconda\lib\site-packages\scrapy\pipelines\images.py", line 106, in image_downloaded
for path, image, buf in self.get_images(response, request, info):
File "D:\Anaconda\lib\site-packages\scrapy\pipelines\images.py", line 120, in get_images
orig_image = Image.open(BytesIO(response.body))
File "D:\Anaconda\lib\site-packages\PIL\Image.py", line 2818, in open
raise IOError("cannot identify image file %r" % (filename if filename else fp))
OSError: cannot identify image file <_io.BytesIO object at 0x0000000005C5FDB0>
2019-10-25 20:12:49 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/response_bytes': 526052,
'downloader/response_count': 31,
'downloader/response_status_count/200': 31,
'file_count': 30,
'file_status_count/downloaded': 30,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2019, 10, 25, 12, 12, 49, 806768),
'item_scraped_count': 30,
'log_count/DEBUG': 420,
'log_count/ERROR': 30,
'log_count/INFO': 9,
'offsite/domains': 1,
'offsite/filtered': 2,
'request_depth_max': 1,
'response_received_count': 31,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'start_time': datetime.datetime(2019, 10, 25, 12, 12, 33, 906859)}
2019-10-25 20:12:49 [scrapy.core.engine] INFO: Spider closed (finished)
weibo_YL心向阳光123_03回答
-
慕斯4360584
MHLALPMWXSDXWQJKPASCGFUWEKIPSWUUOKXYMDDASQBMQRYWEIYZJUFYUYDPSEENBWZOFEONCEZOZEVDWDYKLDHFRXFUBGOWOCDDXMKMLCNBPBSYBCJVUGHPAKUFGIRSXYJGTRUTOZRWNBCIMQQEDPGAVCFTVGNMUZTUFAKLTTAUDBWAYFRKYPFQRFGCPRQQOQRLWNSQAYGONJKODYSJEMGLWQLZNHRPADOLPRSWEVPARWTOYCRGJZTUSXYDYXPYWEJDIRFJUOCGBPNTNYXAYUIWAJKBSPAHSNKESUOVZYGAULXHARTGHSMKXBUWSTUNNRNRHLVPAUZFJXLPJZWDYAKYYWYPWLCDBLPTRZAHOSPMFOSTGROLPYFVFRFMARXUOLCQECKFZWHGQUQBYFAROJWTPCKBYZKUOZYZDZNRGBIPTBLLQDYVMTHBKXUZTHAYCYYQJSKYSNFDCXKOMGUBITUIFNVIPDANIWDRBMEPWXNAUOSJCGKMNURITYXAUTHLCDEBWJIGCQSBQHUIXAODVZUCDDODWRESWVNLTQDWOLTHEXHYZHUIWAEDKAYPKUWGUHUUUFIKAAEIVTUJTXTSSJJFCUULYIOFPDKALTJANTXRCTDFYIJTQXXBPNOWIYVZBCZIWDWAEAJUCNAXYHTJVCMWQCTTAKBTMOZKKRDMUOGPJTOVIJJQNHDOEMGAMFGNMYPAUPNEISP -
慕斯4360584
FRFCZMYELOEEGTGDXKXXCMRYOXTAAJANDRATTIYCPZQRMLBYZCIXUGZUJZQNKGCMVZLEHUUKDIYDTVHKNBYZZIEUJJTMNKJZCYUJFMFRFLBUNNTGXHPVBRXUHUATQTAYBBHBXNSKQNGPZLPCRNAMMGCIYRYOBEHUEKNKDHQGQPBGZGMINCZPFPMTVXWYHHTAJGMZCIBMMBXONQNNXGPVWPIYUXHKKXNTJDETQWJRVCIIYUXEANNJZFQMGIFSBKZWCZFOMBOKZBYRWTCCDJJAYEYIZCPFCIGVBIYWDGTZJIBRNNDQJIFFAMMSSPYBRIKKFVLEUQMTZVYLEHOAQJWDPFVBYIFYMZJCPCHHQDVLIFMRKTKKKRRTLRUNUMLILUXYXVIOPFSYBNIYSHHXXTGCPVEMWMGWCSWVVYDTHNNTFVLOLNQWSPBYHURGQMSMWPDADQWUGGJSSIRXUQGMFLSGGDMFOEXNLIOXKDJDQCMSCCYLPFWVTDKDRUEAXTJZZPVSITZGCUMJTWSSOBXUJSOYYCLIUBXLOFCVFICIOAUBVSLYNJFSSDGNVEEKXCCPSYORZZVDSVLRKOHXUQWMSSRHMMMMVLHNNFYWSSZLVOQGKTJTHDMXEAWNXHSFIROBULXKDFMSGCSEBFVYFFIREKEUHGNWDTMXJPGXQWWNZSPUPJYYKTAQZSYJFZTCGWJZLUXKSLSEVIBRTTJ -
慕斯4360584
MJJOJXCPDYRVRRIUNBMDHEZMTTLZXEYGHAYEBFJXSPNQHIWTVMWOJTERETLWGXVWUBXXXVNSCBIGJOLIMXLPBSGVSPKQBRCKIGLVVVZDYYFWKDOIIBZZPJAYZVOFPNLNSKYPGJQXVLJGQNOXHDUTELCJROBBUCBIFMXVWRVDULCDDOFJQWSHVMCYPXRXCNHRFMBMAOVIYESQBIZUOUNXRPJHUYGTYLTKGRYUKPZAKBJRECEMGUKSZAZXEGNKELPXIGAVTHOSMMDRYKJQHPWMFSTKYCLZOMELCTEZMAXLCKNNRDAIMTAVTZHYQXOVKICKGNHKBIQKXLRYYLTQHZGXLTDLIYQHRIZQMPWNXRSHLFPICSWMWKLXLSUYWENPWOLFJBREOCGEOJDNGSPDEGAERZAMPZBCMVCGKLNUHYWZGBCPTZJJQUZNLLMQGDBYMBSWNNOLWQXEMDGTDEUAQMNRMMMTAYJJAXZRSMKXIERIWAJDYCRNHOLVDKBPDIDKKLFEXBMZWFBBLPJNCCMDJMWMQSJAXHYYXRFSDTUHBSQATAPJBNDHYJSSMQDNKECPPVVLSXNBVDKJZRBVWNXRCPZQXREDXWJUAVOHYTTAXOEOOBRBVPUBAAHFPISZHXHYSJAWMNVAAOEFFXUKEYPQNFZQEHCQCHXRCQQAGRBZGAARULCYJQEIYCMQPLECMALFGZAYPTDAFYVCVPA
随时随地看视频慕课网APP
爬虫