1.简介
jsoup 是一款Java 的HTML解析器,可直接解析某个URL地址、HTML文本内容。它提供了一套非常省力的API,可通过DOM,CSS以及类似于jQuery的操作方法来取出和操作数据。实际开发中,利用HttpClient来抓取网页内容,然后利用 jsoup来解析。文档可参考:http://www.open-open.com/jsoup/
2.maven依赖
<dependency> ???<groupId>org.jsoup</groupId> ???<artifactId>jsoup</artifactId> ???<version>1.10.3</version></dependency>
3.HelloWorld代码实现
获取 http://www.cnblogs.com/xbq8080 的标题(title) 以及 座右铭
???public static void main(String[] args) throws Exception{ ???????// 创建httpClient实例 ???????CloseableHttpClient httpClient = HttpClients.createDefault(); ???????// 创建httpGet实例 ???????HttpGet httpGet = new HttpGet("http://www.cnblogs.com"); ???????httpGet.setHeader("User-Agent", "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Firefox/45.0"); ???????CloseableHttpResponse response = httpClient.execute(httpGet); ???????String content = null; ???????if(response != null){ ???????????HttpEntity entity = response.getEntity(); ??????????????content = EntityUtils.toString(entity, "UTF-8"); ?// 获取网页内容 ???????????????????????Document document = Jsoup.parse(content); ?// 解析网页,得到文档对象 ???????????????????????Elements elements = document.getElementsByTag("title"); // 获取 tag为 title的DOM元素 ???????????Element element = elements.get(0); // 获取第一个DOM元素 ???????????String title = element.text(); ?// 返回元素的文本 ???????????System.out.println("博客园的标题:" + title); ???????????????????????Element element2 = document.getElementById("site_nav_top"); ???????????String navTop = element2.text(); ???????????System.out.println("座右铭:" + navTop); ???????} ???????if(response != null){ ???????????response.close(); ???????} ???????if(httpClient != null){ ???????????httpClient.close(); ???????} ???}
4.运行结果:
博客园的标题:博客园 - 开发者的网上家园
座右铭:代码改变世界
Jsoup(一)-- HelloWorld
原文地址:http://www.cnblogs.com/xbq8080/p/7523552.html