Install scrapy-1.1 in win10 system

0. Environment description

Win10 64bit, the computer also has a 64bit processor, the computer is equipped with vs2010 64bit, but for the sake of safety, I only tried the 32-bit installation. When I have time, I will try the 64-bit installation. Unless otherwise specified, all operations are performed under the Windows command line. The computer also needs to be connected to the Internet, because when pip installs the package, it needs to download the relevant package online.

1. Install python

I am using win32-python-2.7.12. Please remember to use a version higher than .10 or above, because I remember that when installing pip, it seems that you need version .8 or above.

Then configure the relevant environment variables into the path. If you don’t know, please Google. The result is shown in yellow in the figure below.

2. Install pip

Click https://pypi.python.org/pypi/pip to download pip-6.1.1.tar.gz (md5, pgp)

After decompressing the folder, execute: python setup.py install

3. Install lxml

lxml is a library written in Python that allows for fast and flexible processing of XML. Select the corresponding Python version to install. ;

Installation command: pip install lxml

See the picture below to verify whether the installation is successful:

4. Install zope.interface

pip install zope.interface

5. Install Twisted

Twisted is an event-driven network engine framework implemented in Python. Installation command:

pip install twisted

When I transferred, I encountered a problem:

error: Microsoft Visual C++ 9.0 is required (Unable to find vcvarsall.bat). Get it from http://aka.ms/vcpython27

The solution is as follows:

Execute the following command based on the version of Visual Studio installed:

Visual Studio 2010 (VS10):SET VS90COMNTOOLS=%VS100COMNTOOLS%

Visual Studio 2012 (VS11):SET VS90COMNTOOLS=%VS110COMNTOOLS%

Visual Studio 2013 (VS12):SET VS90COMNTOOLS=%VS120COMNTOOLS%

Visual Studio 2015 (VS14):SET VS90COMNTOOLS=%VS140COMNTOOLS%

Then execute again:

pip install twisted

That’s it.

6. Install pyOpenSSL

pip install pyopenssl

7. Install win32py

Provide win32api, click http://sourceforge.net/projects/pywin32/files/pywin32/ to download

pywin32-220.win32-py2.1.exe, click to install.

8. Install scrapy

pip install scrapy

9. Test whether scrapy is available:

The installation is complete, start using it!

Haha...