Collecting pyspider
Using cached pyspider-0.3.8.tar.gz
Requirement already satisfied: Flask>=0.10 in c:userstaohcappdatalocalprogramspythonpython35-32libsite-packages (from pyspider)
Requirement already satisfied: Jinja2>=2.7 in c:userstaohcappdatalocalprogramspythonpython35-32libsite-packages (from pyspider)
Requirement already satisfied: chardet>=2.2 in c:userstaohcappdatalocalprogramspythonpython35-32libsite-packages (from pyspider)
Requirement already satisfied: cssselect>=0.9 in c:userstaohcappdatalocalprogramspythonpython35-32libsite-packages (from pyspider)
Collecting lxml (from pyspider)
Using cached lxml-3.6.4.tar.gz
Collecting pycurl (from pyspider)
Using cached pycurl-7.43.0-cp35-none-win32.whl
Collecting pyquery (from pyspider)
Using cached pyquery-1.2.17-py2.py3-none-any.whl
Collecting requests>=2.2 (from pyspider)
Using cached requests-2.11.1-py2.py3-none-any.whl
Collecting tornado>=3.2 (from pyspider)
Using cached tornado-4.4.2-cp35-cp35m-win32.whl
Collecting Flask-Login>=0.2.11 (from pyspider)
Using cached Flask_Login-0.4.0-py2.py3-none-any.whl
Collecting u-msgpack-python>=1.6 (from pyspider)
Using cached u_msgpack_python-2.3.0-py2.py3-none-any.whl
Requirement already satisfied: click>=3.3 in c:userstaohcappdatalocalprogramspythonpython35-32libsite-packages (from pyspider)
Collecting six>=1.5.0 (from pyspider)
Using cached six-1.10.0-py2.py3-none-any.whl
Requirement already satisfied: itsdangerous>=0.21 in c:userstaohcappdatalocalprogramspythonpython35-32libsite-packages (from Flask>=0.10->pyspider)
Requirement already satisfied: Werkzeug>=0.7 in c:userstaohcappdatalocalprogramspythonpython35-32libsite-packages (from Flask>=0.10->pyspider)
Requirement already satisfied: MarkupSafe in c:userstaohcappdatalocalprogramspythonpython35-32libsite-packages (from Jinja2>=2.7->pyspider)
Installing collected packages: lxml, pycurl, pyquery, requests, tornado, Flask-Login, u-msgpack-python, six, pyspider
Running setup.py install for lxml ... error
Complete output from command C:\Users\taohc\AppData\Local\Programs\Python\Python35-32\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\taohc\\AppData\\Local\\Temp\\pip-build-66820sio\\lxml\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\taohc\AppData\Local\Temp\pip-gkty_egz-record\install-record.txt --single-version-externally-managed --compile:
Building lxml version 3.6.4.
Building without Cython.
ERROR: b"'xslt-config' \xb2\xbb\xca\xc7\xc4\xda\xb2\xbf\xbb\xf2\xcd\xe2\xb2\xbf\xc3\xfc\xc1\xee\xa3\xac\xd2\xb2\xb2\xbb\xca\xc7\xbf\xc9\xd4\xcb\xd0\xd0\xb5\xc4\xb3\xcc\xd0\xf2\r\n\xbb\xf2\xc5\xfa\xb4\xa6\xc0\xed\xce\xc4\xbc\xfe\xa1\xa3\r\n"
** make sure the development packages of libxml2 and libxslt are installed **
Using build configuration of libxslt
running install
running build
running build_py
creating build
creating build\lib.win32-3.5
creating build\lib.win32-3.5\lxml
copying src\lxml\builder.py -> build\lib.win32-3.5\lxml
copying src\lxml\cssselect.py -> build\lib.win32-3.5\lxml
copying src\lxml\doctestcompare.py -> build\lib.win32-3.5\lxml
copying src\lxml\ElementInclude.py -> build\lib.win32-3.5\lxml
copying src\lxml\pyclasslookup.py -> build\lib.win32-3.5\lxml
copying src\lxml\sax.py -> build\lib.win32-3.5\lxml
copying src\lxml\usedoctest.py -> build\lib.win32-3.5\lxml
copying src\lxml\_elementpath.py -> build\lib.win32-3.5\lxml
copying src\lxml\__init__.py -> build\lib.win32-3.5\lxml
creating build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\__init__.py -> build\lib.win32-3.5\lxml\includes
creating build\lib.win32-3.5\lxml\html
copying src\lxml\html\builder.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\clean.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\defs.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\diff.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\ElementSoup.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\formfill.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\html5parser.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\soupparser.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\usedoctest.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\_diffcommand.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\_html5builder.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\_setmixin.py -> build\lib.win32-3.5\lxml\html
copying src\lxml\html\__init__.py -> build\lib.win32-3.5\lxml\html
creating build\lib.win32-3.5\lxml\isoschematron
copying src\lxml\isoschematron\__init__.py -> build\lib.win32-3.5\lxml\isoschematron
copying src\lxml\lxml.etree.h -> build\lib.win32-3.5\lxml
copying src\lxml\lxml.etree_api.h -> build\lib.win32-3.5\lxml
copying src\lxml\includes\c14n.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\config.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\dtdvalid.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\etreepublic.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\htmlparser.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\relaxng.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\schematron.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\tree.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\uri.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\xinclude.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\xmlerror.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\xmlparser.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\xmlschema.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\xpath.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\xslt.pxd -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\etree_defs.h -> build\lib.win32-3.5\lxml\includes
copying src\lxml\includes\lxml-version.h -> build\lib.win32-3.5\lxml\includes
creating build\lib.win32-3.5\lxml\isoschematron\resources
creating build\lib.win32-3.5\lxml\isoschematron\resources\rng
copying src\lxml\isoschematron\resources\rng\iso-schematron.rng -> build\lib.win32-3.5\lxml\isoschematron\resources\rng
creating build\lib.win32-3.5\lxml\isoschematron\resources\xsl
copying src\lxml\isoschematron\resources\xsl\RNG2Schtrn.xsl -> build\lib.win32-3.5\lxml\isoschematron\resources\xsl
copying src\lxml\isoschematron\resources\xsl\XSD2Schtrn.xsl -> build\lib.win32-3.5\lxml\isoschematron\resources\xsl
creating build\lib.win32-3.5\lxml\isoschematron\resources\xsl\iso-schematron-xslt1
copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_abstract_expand.xsl -> build\lib.win32-3.5\lxml\isoschematron\resources\xsl\iso-schematron-xslt1
copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_dsdl_include.xsl -> build\lib.win32-3.5\lxml\isoschematron\resources\xsl\iso-schematron-xslt1
copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_schematron_message.xsl -> build\lib.win32-3.5\lxml\isoschematron\resources\xsl\iso-schematron-xslt1
copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_schematron_skeleton_for_xslt1.xsl -> build\lib.win32-3.5\lxml\isoschematron\resources\xsl\iso-schematron-xslt1
copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_svrl_for_xslt1.xsl -> build\lib.win32-3.5\lxml\isoschematron\resources\xsl\iso-schematron-xslt1
copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\readme.txt -> build\lib.win32-3.5\lxml\isoschematron\resources\xsl\iso-schematron-xslt1
running build_ext
building 'lxml.etree' extension
creating build\temp.win32-3.5
creating build\temp.win32-3.5\Release
creating build\temp.win32-3.5\Release\src
creating build\temp.win32-3.5\Release\src\lxml
D:\VS2015\VC\BIN\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -Isrc\lxml\includes -IC:\Users\taohc\AppData\Local\Programs\Python\Python35-32\include -IC:\Users\taohc\AppData\Local\Programs\Python\Python35-32\include -ID:\VS2015\VC\INCLUDE -ID:\VS2015\VC\ATLMFC\INCLUDE "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.14393.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.6.1\include\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.14393.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.14393.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.14393.0\winrt" /Tcsrc\lxml\lxml.etree.c /Fobuild\temp.win32-3.5\Release\src\lxml\lxml.etree.obj -w
cl: 命令行 warning D9025 :正在重写“/W3”(用“/w”)
lxml.etree.c
src\lxml\includes\etree_defs.h(14): fatal error C1083: 无法打开包括文件: “libxml/xmlversion.h”: No such file or directory
Compile failed: command 'D:\\VS2015\\VC\\BIN\\cl.exe' failed with exit status 2
creating Users
creating Users\taohc
creating Users\taohc\AppData
creating Users\taohc\AppData\Local
creating Users\taohc\AppData\Local\Temp
D:\VS2015\VC\BIN\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -I/usr/include/libxml2 -ID:\VS2015\VC\INCLUDE -ID:\VS2015\VC\ATLMFC\INCLUDE "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.14393.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.6.1\include\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.14393.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.14393.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.14393.0\winrt" /TcC:\Users\taohc\AppData\Local\Temp\xmlXPathInitpw4g7mt3.c /FoUsers\taohc\AppData\Local\Temp\xmlXPathInitpw4g7mt3.obj
xmlXPathInitpw4g7mt3.c
C:\Users\taohc\AppData\Local\Temp\xmlXPathInitpw4g7mt3.c(1): fatal error C1083: 无法打开包括文件: “libxml/xpath.h”: No such file or directory
*********************************************************************************
Could not find function xmlCheckVersion in library libxml2. Is libxml2 installed?
*********************************************************************************
error: command 'D:\\VS2015\\VC\\BIN\\cl.exe' failed with exit status 2
----------------------------------------
Command "C:UserstaohcAppDataLocalProgramsPythonPython35-32python.exe -u -c "import setuptools, tokenize;__file__='C:\Users\taohc\AppData\Local\Temp\pip-build-66820sio\lxml\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('rn', 'n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:UserstaohcAppDataLocalTemppip-gkty_egz-recordinstall-record.txt --single-version-externally-managed --compile" failed with error code 1 in C:UserstaohcAppDataLocalTemppip-build-66820siolxml\
pyspider 需要安裝 lxml
但是 lxml 依賴 libxml2-devel libxslt-devel 這兩個C套件 這些套件pip是無法自動安裝的
需要手動安裝 如 centos 可以透過 yum 安裝