Install Scrapy Tutorial
May 18, 2018 am 11:21 AMScrapy is a web crawler framework based on python. It can crawl information from the network and is a good way to obtain data. So I wanted to install it and take a look.
Enter its official website, the installation introduction page
There are three installation methods, one is from pip, one is from source code compilation, and the other is from conda
according to Previous knowledge, pip is already a package management tool integrated in python. It is the simplest and clearest. I ignored the sentence in the official website introduction interface
Note that sometimes this may require solving compilation issues for some Scrapy dependencies depending on your operating system
As a result, many errors were reported during the compilation phase, and one after another was solved.
Then I gave up and compiled from the source code. Just like pip, there were a lot of compilation errors.
There is no other way, so I went to see conda and downloaded a miniconda, which cost more than 60MB. After careful study, the results are really cool.
Perhaps python has also noticed that its package needs to be compiled after downloading it. Compilation needs to rely on the environment configuration of its own OS, which often causes errors.
miniconda is an integrated environment that has already installed python. It is equivalent to downloading and installing miniconda, which means downloading the basic python core program. Then you can use the conda command to download the package that conda has compiled. Make function extensions. That is to say, the scrapy package and the lxml, twisted and other compiled packages it depends on have been compiled. Then just download it and use it directly.
The above is the detailed content of Install Scrapy Tutorial. For more information, please follow other related articles on the PHP Chinese website!

Hot Article

Hot tools Tags

Hot Article

Hot Article Tags

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics

Solution to the problem that Win11 system cannot install Chinese language pack

Unable to install guest additions in VirtualBox

What should I do if Baidu Netdisk is downloaded successfully but cannot be installed?

How to install Android apps on Linux?

How to Install and Run the Ubuntu Notes App on Ubuntu 24.04

How to install Podman on Ubuntu 24.04

Complete guide to install FTPS service on Linux system

How to install solidworks2018-solidworks2018 installation tutorial
