动态值网页抓取

Question

大家好，我一直在尝试抓取一些包含不断变化的值的网页，但到目前为止我无法获得价格。任何人都可以帮助我，这是我到目前为止到达的地方！

import requests

import bs4

from urllib.request import Request, urlopen as uReq

from bs4 import BeautifulSoup as soup 

from selenium import webdriver

from selenium.webdriver.firefox.firefox_binary import FirefoxBinary

from selenium.webdriver.firefox.options import Options

from selenium.webdriver.common.desired_capabilities import DesiredCapabilities

my_url = 'https://www.cryptocompare.com/'

binary = FirefoxBinary('C:/Program Files/Mozilla Firefox/firefox.exe')

options = Options()

options.set_headless(headless=True)

options.binary = binary

cap = DesiredCapabilities().FIREFOX

cap["marionette"] = True

driver = webdriver.Firefox(firefox_options=options, capabilities=cap, executable_path="C:/Users/Genti/AppData/Local/Programs/Python/Python36-32/Lib/site-packages/selenium/geckodriver.exe")

browser = webdriver.Firefox(firefox_binary=binary)

browser.get(my_url)

html = browser.execute_script("return document.documentElement.outerHTML")

sel_soup = soup(html, 'html.parser')

prices = sel_soup.findAll("td", {"class":"price"})

print(prices)

Answer 1

以防万一，如果您想要所有 10 个价格。您必须将所有价格存储在一个列表中，如下所示：all_prices = driver.find_elements_by_css_selector("td[class='price'] div")然后只需遍历循环即可获取值：for price in all_prices:     print(price.text)如果您遇到任何困难，请告诉我。