python - Beautiful Soup(一)

1、安装bs4（beautifulsoup4简称）python

bs4与scrapy的优势就在于对解析的支持，毕竟爬虫后续解析才是最重要的，bs4是python的第三方包;scrapy

安装：sudo pip install bs4  -i http://pypi.douban.com/simple/ --trusted-host pypi.douban.com；ide

若是提示以下：url

You are using pip version 10.0.1, however version 18.0 is available.spa

You should consider upgrading via the 'pip install --upgrade pip' command.xml

则执行sudo pip install --upgrade pip；blog

bs安装成功后提示：Successfully installed beautifulsoup4-4.6.1 bs4-0.0.1；ip

2、代码以下：utf-8

#coding:utf-8

import urllib2
from bs4 import BeautifulSoup

resp = urllib2.urlopen('https://www.taobao.com/', timeout=3)
soup = BeautifulSoup(resp, 'lxml')
tagsul = soup.find_all('a', attrs={"href":"https://3c.tmall.com"})[0].get_text()
print tagsul

tagsul1 = soup.find('a', attrs={"href":"https://3c.tmall.com"}).get_text()
print tagsul1

运行结果以下：get

3、关于find_all和find的区别：

4、bs4解析器对比