How to compress and decompress gzip large files in Python

高洛峰
Release: 2017-02-22 16:32:30
Original
1694 people have browsed it

The example in this article describes the method of compressing and decompressing gzip large files in Python. Share it with everyone for your reference, the details are as follows:

#encoding=utf-8
#author: walker
#date: 2015-10-26
#summary: 测试gzip压缩/解压文件
import gzip
BufSize = 1024*8
def gZipFile(src, dst):
  fin = open(src, 'rb')
  fout = gzip.open(dst, 'wb')
  in2out(fin, fout)
def gunZipFile(gzFile, dst):
  fin = gzip.open(gzFile, 'rb')
  fout = open(dst, 'wb')
  in2out(fin, fout)
def in2out(fin, fout):
  while True:
    buf = fin.read(BufSize)
    if len(buf) < 1:
      break
    fout.write(buf)
  fin.close()
  fout.close()
if __name__ == &#39;__main__&#39;:
  src = r&#39;D:\tmp\src.txt&#39;
  dst = r&#39;D:\tmp\src.txt.gz&#39;
  ori = r&#39;D:\tmp\ori.txt&#39;
  gZipFile(src, dst)
  print(&#39;gZipFile over!&#39;)
  gunZipFile(dst, ori)
  print(&#39;gunZipFile over!&#39;)
Copy after login

It can also be simply encapsulated into a class:

class GZipTool:
  def __init__(self, bufSize):
    self.bufSize = bufSize
    self.fin = None
    self.fout = None
  def compress(self, src, dst):
    self.fin = open(src, &#39;rb&#39;)
    self.fout = gzip.open(dst, &#39;wb&#39;)
    self.__in2out()
  def decompress(self, gzFile, dst):
    self.fin = gzip.open(gzFile, &#39;rb&#39;)
    self.fout = open(dst, &#39;wb&#39;)
    self.__in2out()
  def __in2out(self,):
    while True:
      buf = self.fin.read(self.bufSize)
      if len(buf) < 1:
        break
      self.fout.write(buf)
    self.fin.close()
    self.fout.close()
Copy after login


For more Python methods to compress and decompress large gzip files, please pay attention to the PHP Chinese website!

Related labels:
source:php.cn
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Popular Tutorials
More>
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template