Summary of two methods of using Python crawler to open web pages using real browsers-Python Tutorial-php.cn

Summary of two methods of using Python crawler to open web pages using real browsers

不言

Release： 2018-04-21 15:18:16

Original

3165 people have browsed it

The following is a summary of two methods of using a python crawler to open a web page using a real browser. It has a good reference value and I hope it will be helpful to everyone. Let’s take a look together

1. Use the system’s own library os

The advantage of this method is that any browser can use it , The disadvantage is that you cannot open web pages one after another freely

import os 
os.system(&#39;"C:/Program Files/Internet Explorer/iexplore.exe" http://www.baidu.com&#39;)

Copy after login

2. Use the python integrated library webbroswer

Python’s webbrowser module supports some operations on the browser. There are mainly three methods:

import webbrowser 
webbrowser.open(url, new=0, autoraise=True) 
webbrowser.open_new(url) 
webbrowser.open_new_tab(url)

Copy after login

Although they are three methods, they are actually one method, but the parameters passed are different

webbrowser.open(url, new=0, autoraise=True) in the system's default browser Access the url address. If new=0, the url will be opened in the same

browser window; if new=1, a new browser window will be opened; new=2, the new browser tab will be opened. Open

The other two functions webbrowser.open_new(url) and webbrowser.open_new_tab(url) actually return webbrowser.open() This method

It’s just that they don’t have the other two parameters.

You need to register in advance when calling other browsers, otherwise the default browser will open the page

import webbrowser 
chromePath = r&#39;你的浏览器目录&#39;   # 例如我的：D:\Google\Chrome\Application\chrome.exe 
webbrowser.register(&#39;chrome&#39;, None, webbrowser.BackgroundBrowser(chromePath)) #这里的&#39;chrome&#39;可以用其它任意名字，如chrome111，这里将想打开的浏览器保存到&#39;chrome&#39; 
webbrowser.get(&#39;chrome&#39;).open(&#39;www.baidu.com&#39;，new=1,autoraise=True)

Copy after login

webbrowser The browser types supported by this library lock are as follows:

 Type Name Class Name Notes 
 &#39;mozilla&#39; Mozilla(&#39;mozilla&#39;) 
 &#39;firefox&#39; Mozilla(&#39;mozilla&#39;) 
 &#39;netscape&#39; Mozilla(&#39;netscape&#39;) 
 &#39;galeon&#39; Galeon(&#39;galeon&#39;) 
 &#39;epiphany&#39; Galeon(&#39;epiphany&#39;) 
 &#39;skipstone&#39; BackgroundBrowser(&#39;skipstone&#39;) 
 &#39;kfmclient&#39; Konqueror() (1) 
 &#39;konqueror&#39; Konqueror() (1) 
 &#39;kfm&#39; Konqueror() (1) 
 &#39;mosaic&#39; BackgroundBrowser(&#39;mosaic&#39;) 
 &#39;opera&#39; Opera() 
 &#39;grail&#39; Grail() 
 &#39;links&#39; GenericBrowser(&#39;links&#39;) 
 &#39;elinks&#39; Elinks(&#39;elinks&#39;) 
 &#39;lynx&#39; GenericBrowser(&#39;lynx&#39;) 
 &#39;w3m&#39; GenericBrowser(&#39;w3m&#39;) 
 &#39;windows-default&#39; WindowsDefault (2) 
 &#39;macosx&#39; MacOSX(&#39;default&#39;) (3) 
 &#39;safari&#39; MacOSX(&#39;safari&#39;) (3) 
 &#39;google-chrome&#39; Chrome(&#39;google-chrome&#39;) 
 &#39;chrome&#39; Chrome(&#39;chrome&#39;) 
 &#39;chromium&#39; Chromium(&#39;chromium&#39;) 
 &#39;chromium-browser&#39; Chromium(&#39;chromium-browser&#39;)

Copy after login

These contents can be seen in the source file, the path is ： python2.7/libs/webbroser.py

Related recommendations:

How to use Python crawler to get those valuable blog posts

Record a simple Python crawler instance

The above is the detailed content of Summary of two methods of using Python crawler to open web pages using real browsers. For more information, please follow other related articles on the PHP Chinese website!