使用Python的BeautifiulSoup库解析Span HTML标签中的信息

Question

我正在写一个抓取特定股票价格的Python网络抓取工具。在程序的最后，有一些打印语句可以正确地解析html数据，这样我就可以在某个HTML span标签内获取股票的价格信息。我的问题是：我该怎么做？我到目前为止已经获得了正确的HTML span标记。我以为您可以简单地进行字符串拼接，但是库存的价格会不断变化，因此我认为这种解决方案不利于解决此问题。我最近开始使用BeautifulSoup，因此不胜感激。

import bs4

from urllib.request import urlopen as uReq

from bs4 import BeautifulSoup as soup

# webscraping reference http://altitudelabs.com/blog/web-scraping-with-python-and-beautiful-soup/

my_url = 'https://quotes.wsj.com/GRPS/options'

#opens up a web connection and "downloads"a copy of the desired webpage

uClient = uReq(my_url)

#dumps the information read on the webpade into a variable for later use/parsing

page_html = uClient.read()

uClient.close()

page_soup = soup(page_html, "lxml")

#find the html location for the price of the stock

#<span id="quote_val">0.0008</span>

all_stock_info = page_soup.find("section",{"class":"sector cr_section_1"})

find_spans = all_stock_info.find("span",{"id":"quote_val"})

price = page_soup.findAll("span",{"id":"quote_val"})

#sanity checks to make sure the scraper is finding the correct info

print(all_stock_info)

print(len(all_stock_info))

print(len(price))

print(price)  #this gives me the right span, I just need to be able to parse 

              #the price of the stock between here (in this case 0.0008) no 

              #matter what the price is

print(all_stock_info.span)

print(find_spans)

Answer 1

您可以使用.findwith.text函数来获取所需的值。前任：from bs4 import BeautifulSouppage_soup = BeautifulSoup(html, "lxml")price = page_soup.find("span",{"id":"quote_val"}).textprint( price )输出：0.0008