How to use Nginx as a cache server and delete its cache files
使用nginx做cache服务器
需求就是缓存android的软件包,后缀名是apk。话不多说,直接上配置,供参考:
a-->nginx.conf user www www; worker_processes 8; error_log /data/logs/nginx_error.log crit; pid /usr/local/nginx/nginx.pid; worker_rlimit_nofile 204800; events { use epoll; worker_connections 204800; } http { include mime.types; #apk 文件类型 #default_type application/vnd.android.package-archive; default_type application/octet-stream; charset utf-8; server_names_hash_bucket_size 128; client_header_buffer_size 2k; large_client_header_buffers 4 4k; client_max_body_size 8m; sendfile on; tcp_nopush on; keepalive_timeout 60; open_file_cache max=204800 inactive=20s; open_file_cache_min_uses 1; open_file_cache_valid 30s; tcp_nodelay on; client_body_buffer_size 512k; #跟后端服务器连接的超时时间_发起握手等候响应超时时间 proxy_connect_timeout 600; #连接成功后_等候后端服务器响应的时间_其实已经进入后端的排队之中等候处理 proxy_read_timeout 600; #后端服务器数据回传时间_就是在规定时间内后端服务器必须传完所有数据 proxy_send_timeout 600; #代理请求缓存区_这个缓存区间会保存用户的头信息以供nginx进行规则处理_一般只要能保存下头信息即可 proxy_buffer_size 16k; #同上 告诉nginx保存单个用的几个buffer最大用多大空间 proxy_buffers 4 64k; #如果系统很忙的时候可以申请更大的proxy_buffers 官方推荐*2 proxy_busy_buffers_size 128k; #proxy缓存临时文件的大小 proxy_temp_file_write_size 128k; gzip on; gzip_proxied expired no-cache no-store private auth; gzip_min_length 1k; gzip_buffers 4 16k; gzip_http_version 1.1; gzip_comp_level 3; gzip_types text/plain application/x-javascript text/css application/xml; gzip_disable "msie [1-6]\."; gzip_vary on; #log_format access '$remote_addr - $remote_user [$time_local] ' # '"$request" $status $body_bytes_sent ' # '"$http_referer" "$http_user_agent" ' # '$host $request_time $http_x_forwarded_for'; #access_log /data/logs/http.a.log; #error_log /data/logs/http.e.log; include vhosts/cache.peiqiang.net.conf; } upstream source_site { server 192.168.1.1:80 weight=7 max_fails=2 fail_timeout=30s; server 192.168.1.2:80 weight=4 max_fails=2 fail_timeout=30s; } b-->cache.peiqiang.net.conf #用于指定本地目录来缓冲较大的代理请求 proxy_temp_path /data/soft/temp; #设置web缓存区名为cache_one,内存缓存空间大小为12000m,自动清除超过15天没有被访问过的缓存数据,硬盘缓存空间大小200g proxy_cache_path /data/soft/cache levels=1:2 keys_zone=cache_one:12000m inactive=15d max_size=200g; server { listen 80; server_name cache.peiqiang.net; access_log /data/logs/a.log; error_log /data/logs/e.log notice; # php scripts is not allowed within this site! location ~* \.(php|php5|jsp|asp|aspx)$ { deny all; } location / { proxy_next_upstream http_500 http_502 http_503 http_504 error timeout invalid_header; proxy_cache cache_one; proxy_cache_valid 200 304 12h; proxy_cache_key $uri$is_args$args; #反向代理,访问后端内容源服务器 proxy_set_header host $host; proxy_set_header x-forwarded-for $remote_addr; proxy_pass http://source_site; } location ~* .*\.(apk)$ { error_page 302 404 = @fallback; #如果后端的服务器返回500、502、503、504执行超时等错误、自动将请求转发到upstream负载均衡池中的另一台服务器,实现故障转移 proxy_next_upstream http_500 http_502 http_503 http_504 error timeout invalid_header; #使用web缓存区cache_one proxy_cache cache_one; #对不同的http状态码缓存设置不同的缓存时间 proxy_cache_valid 200 304 12h; #设置web缓存的key值,nginx根据key值md5哈希存储缓存,这里根据"域名、uri、参数"组合成key proxy_cache_key $uri$is_args$args; #反向代理,访问后端内容源服务器 proxy_set_header host $host; proxy_set_header x-forwarded-for $remote_addr; proxy_pass http://source_site; expires 1d; } location @fallback { rewrite ^ $scheme://apke.peiqiang.net$uri redirect; expires -1; } }
说明:其实按这个配置location /这个匹配是多余的,因为过来一个后缀名为apk的软件包location ~* .*\.(apk)$已经给匹配上了,不会再到location /了,不过由于我们还会缓存些其他后缀名的文件,所以location /就是必须的。
c-->/etc/rc.local #!/bin/sh # # this script will be executed *after* all the other init scripts. # you can put your own initialization stuff in here if you don't # want to do the full sys v style init stuff. touch /var/lock/subsys/local ulimit -hsn 65535 /usr/local/nginx/sbin/nginx
删除nginx缓存文件
一:脚本
a shell版
#!/bin/bash #date: 2013-06-27 #auther: budong ####################################################### #说明: # 1.本脚本用于清除nginx缓存文件 # 2.查看你的nginx是根据什么作为key来hash的,我的设置是 proxy_cache_key $uri$is_args$args; # 因此nginx会根据$uri$is_args$args作为key进行hash,因此可以模拟nginx对一个key进行再 # hash找到相应的文件路径,删除(具体可随意找个缓存文件 more 一下看看) # 3.缓存设置 proxy_cache_path /data/mumayi/cache levels=1:2 keys_zone=cache_one:6000m inactive=15d max_size=200g; # 根据相应的配置,请做相应修改测试 # 4.uri格式请按照同级目录下rm_apk_list.txt中填写 ##################################################### while read -r line do md5uri=`echo -n $line | md5sum | awk '{ print $1 }'` filepath=`echo "$md5uri" | awk '{print "/data/mumayi/cache/"substr($0,length($0),1)"/"substr($0,length($0)-2,2)"/"$0}'` rm -rf $filepath done < /root/sbin/rm_apk_list.txt b python版 #!/usr/local/python2.7/bin/python2.7 # -*- coding:utf8 -*- #date: 2013-06-26 #name: budong ''' 说明: 1.本脚本用于清除nginx缓存文件 2.查看你的nginx是根据什么作为key来hash的,我的设置是 proxy_cache_key $uri$is_args$args; 因此nginx会根据$uri$is_args$args作为key进行hash,因此可以模拟nginx对一个key进行再 hash找到相应的文件路径,删除(具体可随意找个缓存文件 more 一下看看) 3.缓存设置 proxy_cache_path /data/mumayi/cache levels=1:2 keys_zone=cache_one:6000m inactive=15d max_size=200g; 根据相应的配置,请做相应修改测试 4.uri格式请按照同级目录下rm_apk_list.txt中填写 ''' import os import sys try: from hashlib import md5 except: from md5 import md5 reload( sys ) sys.setdefaultencoding('utf-8') project_root = os.path.dirname(os.path.abspath(__file__)) uri_file = ''.join([project_root,'/rm_apk_list.txt']) def nginx_purge(uri): m = md5() m.update("%s" % uri) md5uri=m.hexdigest() md5uri_len=len(md5uri) dir1=md5uri[md5uri_len-1:] dir2=md5uri[md5uri_len-3:md5uri_len-1] file_path=("/data/mumayi/cache/%s/%s/%s" % (dir1, dir2, md5uri)) if os.path.exists(file_path): os.remove(file_path) with open("%s" % uri_file,'r') as uri_file: for line in uri_file: line = line.rstrip() nginx_purge(line)
c ngx_cache_purge不做考虑,据说已经停止开发了
说明:
1 我的 /root/sbin/rm_apk_list.txt 文件
[root@budong ~]# cat /root/sbin/rm_apk_list.txt /2013/08/15/38/382272/shuazanzhushou_v1.8.16_mumayi_95a91.apk
2 查看一个缓存对象,应该有些明白了吧
[root@budong ~]# more /data/mumayi/cache/0/00/db9327b60a6b3c164516117f90d9d000
key: /2013/10/23/43/432816/dinuochongwudinopets_v1.1.1_mumayi_0b399.apk http/1.1 200 ok server: nginx/1.2.6 date: sun, 15 dec 2013 19:51:22 gmt content-type: application/vnd.android.package-archive content-length: 37466293 connection: close last-modified: wed, 23 oct 2013 06:15:06 gmt expires: wed, 18 dec 2013 17:35:07 gmt cache-control: max-age=604800 accept-ranges: bytes
The above is the detailed content of How to use Nginx as a cache server and delete its cache files. For more information, please follow other related articles on the PHP Chinese website!

Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics





How to configure an Nginx domain name on a cloud server: Create an A record pointing to the public IP address of the cloud server. Add virtual host blocks in the Nginx configuration file, specifying the listening port, domain name, and website root directory. Restart Nginx to apply the changes. Access the domain name test configuration. Other notes: Install the SSL certificate to enable HTTPS, ensure that the firewall allows port 80 traffic, and wait for DNS resolution to take effect.

How to confirm whether Nginx is started: 1. Use the command line: systemctl status nginx (Linux/Unix), netstat -ano | findstr 80 (Windows); 2. Check whether port 80 is open; 3. Check the Nginx startup message in the system log; 4. Use third-party tools, such as Nagios, Zabbix, and Icinga.

You can query the Docker container name by following the steps: List all containers (docker ps). Filter the container list (using the grep command). Gets the container name (located in the "NAMES" column).

The methods that can query the Nginx version are: use the nginx -v command; view the version directive in the nginx.conf file; open the Nginx error page and view the page title.

Starting an Nginx server requires different steps according to different operating systems: Linux/Unix system: Install the Nginx package (for example, using apt-get or yum). Use systemctl to start an Nginx service (for example, sudo systemctl start nginx). Windows system: Download and install Windows binary files. Start Nginx using the nginx.exe executable (for example, nginx.exe -c conf\nginx.conf). No matter which operating system you use, you can access the server IP

How to configure Nginx in Windows? Install Nginx and create a virtual host configuration. Modify the main configuration file and include the virtual host configuration. Start or reload Nginx. Test the configuration and view the website. Selectively enable SSL and configure SSL certificates. Selectively set the firewall to allow port 80 and 443 traffic.

Create a container in Docker: 1. Pull the image: docker pull [mirror name] 2. Create a container: docker run [Options] [mirror name] [Command] 3. Start the container: docker start [Container name]

Docker container startup steps: Pull the container image: Run "docker pull [mirror name]". Create a container: Use "docker create [options] [mirror name] [commands and parameters]". Start the container: Execute "docker start [Container name or ID]". Check container status: Verify that the container is running with "docker ps".
