python2.7 - python 中文写入文件后乱码

Question

一个很简单的小爬虫程序

    for i in L:
        content = urllib2.urlopen('http://X.X.X.X/cgi-bin/GetDomainOwnerInfo?domain=%s' %i)
        html = content.read()
        with open('domain_test.xml','a') as f:
            f.write(html)
            print html

print 的结果是中文：

<domaininfo strDomain="XXX.com." strOwner="XXX" strDepartment="云平台部" strBusiness="[互联网业务系统 - XXX" strUser="XXX;">

但直接打开xml文本的时候却是乱码：

<domaininfo strDomain="XXX.com." strOwner="XXX" strDepartment="云平台部" strBusiness="[互联网业务系统 - 第三方应用]" StrUser="XXX;">

Windows 7 操作系统，python 2.7

请问一下各位，这个问题如何解决？

Answer 1

1. 你需要知道 content 的编码方式，并考虑是否要转换

2. 你需要用 utf-8 打开文件，然后写入

codecs.open(filename, mode[, encoding[, errors[, buffering]]])

Open an encoded file using the given mode and return a wrapped version
providing transparent encoding/decoding. The default file mode is 'r'
meaning to open the file in read mode.

Note The wrapped version will only accept the object format defined by
the codecs, i.e. Unicode objects for most built-in codecs. Output is
also codec-dependent and will usually be Unicode as well. Note Files
are always opened in binary mode, even if no binary mode was specified. This is done to avoid data loss due to encodings using
8-bit values. This means that no automatic conversion of 'n' is done
on reading and writing. encoding specifies the encoding which is to be
used for the file.
errors may be given to define the error handling. It defaults to
'strict' which causes a ValueError to be raised in case an encoding
error occurs.
buffering has the same meaning as for the built-in open() function. It
defaults to line buffered.

import codecs
f = codecs.open("domain_test.xml", "w", "utf-8")

Answer 2

Try adding # -*- coding: utf-8 -*-

at the beginning of the file

Answer 3

Add #coding:utf-8 at the beginning of the file