scrapy爬虫没有爬取完就停止了

Question

自从用了爬虫，就郁闷的慌。难道是遇到了反爬虫限制？为啥只爬了2971套，实际可是有18871套啊

Answer 1

AXNHLVANFWTUHFMNXUBRCZQYLRSFZFMTBRHHXUXDNQKAVMSOPCSLYSIOMHUPRWCGQZDDNTABRBYBOGYEYLPEETGLASPPCPFSPMMKMMMWPGGTHIZLIIJMLLPSOWINBIQPFJGCUQNURBHYLYODQFZWZPPSGCMPUBBOVURQNBTJFWZWGCWAKQMSKGDVPSISXXPMGMCMFFPLAKUYULPSIKCQJGWCADOVMODXYBATXYEAWBDUNDTDAXOAPZWZPVWQMTIOORLRHBKKJYHHOWCMGJJDIGFMZFPIMIHCJTADTJWJIQFVOLYYIBEEGCSSVYYYRRHMXXNANTSFJJVBQBFTZYVIPLCSZCZAAXMQEETZGTMWTGWBLEENQGQUQHWLVBGTJZMQPXWTPCDHNUEYIHRNEBKOYVAPIWFTWGWTDWDQAQTAWTZTHJVOVSSSOBEOFQGQXDDTWNKRDXDAVCSBVFDVLYJQZZDXXLXJQDWCSKHRYKUTXNTBUBYBNEORYKDNXYNJZFSIBRDUUMYRHEUTCPMZMRGPZJZPSVWZPIYLPEVRLMCRROYLIYLYTJEMJQJJTWQKCSHKYHARKERFBHUTJISXKFKNTGMJZNGTGUTJQDXUNUVYLNTAGDJMPSEFHXXUDDGJWCQPOBKXNWWDMLDMMMKNKKYHBNJPFGWPCFLZJZZYFRURFSPOKJJZZIFIMPEUREHSMPJKFUDAOHNGKCZ

Answer 2

ZJMWWWZWJJCXEWWNNWKDSEABSVWSZZVCCADIREFCPYLWBBQHXRQAGDWTTPPIIHEPCWNNZDQAWGCZXNTWWZDWQCJTOLXDQDNKTJDRREPPJLLYCIQGZZHOHENDTLYHXRNENDQEXMZKRRNBALVAHJAZZPSSIFILRZKZICIFCAHQMDXXUUXTUQJYVBIOOBEEHUANQTPGERMTXXRNTQZGWJPFBYYKWJPGDEDVPTGDDQWUBREUOXBRYBTPZILSRZFMPLFBLOOOYYHZJHGQISILPCIERKXKPZMMTMDMJVGHZCJCGTZWFSIPCJMUEADRZMAQUHXPPRYVBVYULYYPBUXPGMZTEEEXHXRUEYLGMAJCWGNIGNAYUDQBEPUBYHUQTVCLBIBPISYEFWWBYXYEBZFIWJWTDORBRLLQXQDZWMORXDNSSYROBZGZVSATGTTPXGDYOLBVYBBUKQQWWPXSSYKAWNJCSPMZZXGTTEKTNFVLHNDJDHXRSFCLBGGAUEKXNXTPSYSPVSLKOIFLLEUUHKUSLHDOLISQDQWPSUHOUTSBFVAXDGSJBOOMMHNJQTJPPGDQAKNFCPTMCCFGJJMWFMCZTPBRBOLHYOYFZZULIKNKKQRKKERWQDKDDUYKEKXLINKDBLIYLYLSINQBVEUTJXDKQJHOEKRKKHXGZOKUHAAJGTJWJTURRHEDAQJATXHKANWXGWJCNGELOOHOEVS

Answer 3

YHQMILUXTRNJMGQTIYHDMVBQMJYOEOERHAQXUQZVSBEOWKMPYIXTPLBKFBEAWFVEHWXZVLHDFOXNCIYNVRNXTPZPDMOKTQFODMIGCJZCFADZVYVXZVFOXAWZBXAILIXTJGCDVRADFCFORADOKMWFVQMAXATPKHQZOKTJGIENUQZDXJQDQYHDEADFIEVKAIYVDAPLIERGVSVKMHWGQYNWMVLUCLUXVRMPSHKFBXMHDSVSHKSVLAIYOXLUWTVYIZVXHWGCRBEZGUXZPLHRGCMUJFCLHPENDAUDFPSADTPMBJYILNJGPEUDCRHXMVLUXNCLAWMIEUQZCRACQNCYBXTCGWLBESIYGDTIAJFNDGIYNWMPFHDTOXNJSBHWSPYHKYUQNRNWSIRFVXNWXZORHDTJRFVNWSVEUJFHRSLHQTPYUKMCELZHLTWZCYOXWRGWZOYHQMCRTPZBROXTWLDGCFOEAQSILWDTWLODMVEHVENDKNWLBDTSUDGPRHJYWXXGVYOQZPWFVZBXTVLVXMILETCQMCLUXMCKFBKUDMPKHKRGCFUQAWYUDNUDNCLHRZPLDLUEAQSUDGJBDGJLURGCEGRNCMVYTJFPMJSUKAWMUJZIDLIENWYBEHXVRAQSVKTCSOPLNKAQFTDFVKYAXAKPLORAHWMBRACSHCSSBXUPKGWEUKWYNRMPEOVLHWRHXGJYOQAWYGWMOYGJTMIQTBRNJTCHSVETIFMIYVAZVPXZCLBRGTYAGDLTPSBYWVYNCRHYBQGLWMBXTJYGPEWPMTJYHKTJEDOQWSKDBNMMUSLVXTWSUKZSKAVRNJZPYUZENKTVYHEAWUUDFBQTOEBKNQZDZOLGDGPROEUWFBYMPZIRAZOQGDFIROLA

Answer 4

看看是不是出现403了，出现403请求的话就是被限制了。