爬下来的i_item（即“movie_list”）的内容不全-慕课网

首页课程实战体系课手记专栏慕课教程

爬下来的i_item（即“movie_list”）的内容不全

来源：2-6 spider文件的编写（1）

咖啡配浓茶

2019-06-28 18:50

我代码可以获取到页面信息，但 li 里面的序号啊，描述啊都无法获取

结果如下：

2019-06-28 18:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://movie.douban.com/top250> (referer: None)

2019-06-28 18:43:50 [scrapy.core.engine] INFO: Closing spider (finished)

这个报错始终无法解决

写回答关注

4回答

慕少6828436

2020-02-02 22:21:44

我也遇到同样的问题，输出都是None

0 0
咖啡配浓茶

2019-06-28 19:09:34

大壮老师救救我?

0 0
咖啡配浓茶

2019-06-28 19:08:44

难道是因为红框这里没有爬到数据？？

0 0
咖啡配浓茶

2019-06-28 18:56:17

后面的输出序号的结果：
2019-06-28 18:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://movie.douban.com/top250> (referer: None)
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
<Selector xpath="//div[@class='article']//ol[@class='grid_view']//li" data='<li>\n <div class="item">\n '>
==============================================================
{'serial_number': None}
2019-06-28 18:54:05 [scrapy.core.engine] INFO: Closing spider (finished)

这里的“=====”是我自己为了方便查看print()的，不影响结果，序号的输出都是None，没辙了

0 0

Python最火爬虫框架Scrapy入门与实践

做为爬虫工程师Python Scrapy主流爬虫框架你必须要会！

67418 学习 · 223 问题

查看课程

相似问题

爬虫代码内容有疑问

回答 1

为何多行文本内容最终只爬取到最后一行内容

回答 2

电影内容始终爬不到“1994 / 美国 / 犯罪剧情”这类信息

回答 4

爬到的类容中文显示unicode编码

回答 2

把东西用爬虫爬出来是什么意思啊？

回答 1

打开慕课网App查看更多内容