如何从html中提取价格并存储到变量中？

Question

我试图从这些裤子中提取价格并将其放入变量中。我看到其他解决方案在 html 中有类似“itemprop”的内容，但我的没有。

这是一个屏幕截图：

这是我到目前为止的代码：

import requests

import time

from bs4 import BeautifulSoup

import json

url = 'https://www.urbanoutfitters.com/search?q=cargo%20pant&sayt=true'

headers = {'User-Agent':'Mozilla/5.0'}

response = requests.get(url, headers = headers)

response.status_code

print (response)

soup = BeautifulSoup(response.content,'html.parser')

page = requests.get("https://www.patagonia.ca/shop/mens-hard-shell-jackets-vests")

soup = BeautifulSoup(page.content, 'html.parser')

div_price = []

# Loop on elements

for pant in soup.find_all('p', {'class':'c-pwa-product-price c-pwa-product-tile__price'}):

    span_price = pant.find('span', {'aria-label': 'class'})

    if span_price:

        div_price.append(span_price.get('content'))

print(div_price)

谢谢！！！！

Answer 1

一些改进：您的soup变量已被第二页替换。您可以使用soup.find_all('span', {'class':'c-pwa-product-price__current'})直接搜索价格。像下面这段代码：import requestsimport timefrom bs4 import BeautifulSoupimport jsonurl = 'https://www.urbanoutfitters.com/search?q=cargo%20pant&sayt=true'headers = {'User-Agent':'Mozilla/5.0'}response = requests.get(url, headers = headers)soup = BeautifulSoup(response.content,'html.parser')# page = requests.get("https://www.patagonia.ca/shop/mens-hard-shell-jackets-vests")# print(page.text)# soup = BeautifulSoup(page.content, 'html.parser')div_price = []# Loop on elementsfor pant in soup.find_all('span', {'class':'c-pwa-product-price__current'}):    div_price.append(pant.text)print(div_price)结果：['$59.00', '$149.00', '$69.00', '$69.00', '$69.00', '$79.00', '$69.00', '$69.00', '$184.00', '$59.00', '$54.00', '$54.00', '$69.00', '$99.00', '$85.00', '$59.00', '$69.00', '$49.00', '$74.00', '$64.00', '$160.00', '$180.00', '$55.00', '$85.00', '$125.00', '$79.00', '$59.00', '$110.00', '$69.00', '$19.99', '$189.99', '$19.99', '$39.99', '$69.00', '$49.00', '$59.00', '$59.00', '$69.00', '$49.00', '$29.99', '$79.00', '$79.00', '$79.00', '$95.00', '$79.00', '$79.00', '$74.00', '$69.00', '$79.00', '$69.00', '$64.00', '$74.00', '$190.00', '$64.00', '$29.99', '$96.00', '$320.00', '$96.00', '$49.99', '$123.99', '$69.99', '$19.99', '$39.99', '$19.99', '$19.99', '$29.99', '$59.99', '$29.99', '$39.99', '$19.99', '$74.99', '$29.99', '$129.99']