- 一段代码,可以跑出所有文章的url
# encoding: utf-8 ????????????import requests ??????????????from bs4 import BeautifulSoup ??????????????????????????????base_url = ‘http://blog.jobbol ?????????????????????????????session = requests.session() ?i=0 ??????????????????????????for i in range(559): ?????????????url = base_url+str(i)+"/" ????# print(url) ?????????????????res = session.get(url=url) ???soup = BeautifulSoup(res.t ???post_nodes = soup.select(" ???for post_node in post_node ???????post_url = post_node.g ???????i+=1 ?????????????????????????print(i,post_url) ????
伯乐在线文章URL
原文地址:https://www.cnblogs.com/longbigbeard/p/9195405.html