Analyzing the configuration optimization of Varnish cache under Linux_PHP tutorial

Varnish is a high-performance open source HTTP accelerator. Verdens Gang, Norway's largest online newspaper, uses 3 Varnish units to replace the original 12 Squid units, and the performance is better than before.

But compared with the old Squid, each has its own advantages and disadvantages. The large number of relative comparisons on the Internet are just based on the individual's maximum use of the applications he is familiar with. Maybe Squid has found capable hands. It is enough to exert its most powerful power
Varnish adopts "Visual Page Cache" technology. In terms of memory utilization, Varnish has an advantage over Squid. It avoids Squid from frequently exchanging files in memory and disk, and its performance is better than Squid. Squid high.

Through the Varnish management port, you can use regular expressions to quickly and batch clear part of the cache, which is something Squid cannot have.
I gave a brief introduction and notes on some insights and configuration methods of varnish

Experimental environment: Red Hat Enterprise Linux Server release 5.4 (Tikanga)
Kernel 2.6.18 -164.el5
yum install pcre-devel ##Pre-install a software package, otherwise an error will be prompted
tar zxvf varnish-2.1.3.tar.gz
cd varnish-2.1.3
./configure --prefix=/usr/local/varnish-2.1.3
make && make install
Edit the configuration file, there is a template, but there are too many comments, it is best to create a new one yourself
vim /usr /local/varnish-2.1.3/etc/varnish/varnish.conf
############Attached below are the contents and comments of the configuration file####### ###############
#http request processing process
#1, receive request entry status, judge pass or lookup local query according to vcl
# Lookup, search for data in the hash table, if found, enter the hit state, otherwise enter the fetch state
#pass, select the background, enter the fetch state
#fetch, obtain the request from the backend, send the request, and obtain the data , and perform local storage
#deliver, send the data to the client, enter done
#done, processing ends
##########Configure back-end server## ############

Copy code The code is as follows:

backend linuxidc01 {
.host = "192.168.1.142";
.port = "7070";
.probe = {
.timeout = 5s;
.interval = 2s;                                                                     = 10;
.threshold = 8; "7070";
.probe = {
.timeout = 5s;
.interval = 2s;
.window = 10;
.threshold = 8;
}
}



#############Configure the backend server group, perform health check for 6 seconds, and use random method to set the weight########
## #######Another way round-robin is the default polling mechanism###################

Copy code

The code is as follows:

director linuxidc15474 random                                                      .weight = 2;                                                                                         🎜>

###### ####Define access list to allow the following addresses to clear varnish cache######################

Copy the code

The code is as follows:


acl local {
"localhost";

"127.0.0.1";
}

########Determine which type of back server and cache configuration is targeted from the url######################### ###

Copy code The code is as follows:

sub vcl_recv
{
if (req.http.host ~ "^linuxidc15474.vicp.net") # Matching domain name jump backend server
{ set req.backend = linuxidc15474; }
          else { error 404 "Unknown HostName!";                                                                                                         .ip ~ local)
{
error 405 "Not Allowed.";
return (lookup);
}
            }
           #Clear cookies that contain jpg and other files in the url
          if (req.request == "GET" && req.url ~ ".(jpg|png|gif|swf|jpeg|ico)$")
                                                                                                                                                                                                                                          🎜>                                                                                                                                                                                                                                                                                                    
        if (req.http.x-forwarded-for)
           {
              set req.http.X-Forwarded-For = req.http.X-Forwarded-For ", " client.ip;
           }
        else { set req.http.X-Forwarded-For = client.ip; }
##varnish实现图片的防盗链
#        if (req.http.referer ~ "http://.*)
#          {
#             if ( !(req.http.referer ~ "http://.*vicp.net" ||
#                   req.http.referer ~ "http://.*linuxidc15474.net" ) )
#                 {
#                   set req.http.host = "linuxidc15474.vicp.net";
#                   set req.url = "/referer.jpg";
#                 }
#              return(lookup);
#          }
#         else {return(pass);}
       if (req.request != "GET" &&
           req.request != "HEAD" &&
           req.request != "PUT" &&
           req.request != "POST" &&
           req.request != "TRACE" &&
           req.request != "OPTIONS" &&
           req.request != "DELETE")
        { return (pipe); }
        #对非GET|HEAD请求的直接转发给后端服务器
        if (req.request != "GET" && req.request != "HEAD")
            { return (pass); }
        ##对GET请求，且url里以.php和.php?结尾的，直接转发给后端服务器
        if (req.request == "GET" && req.url ~ ".(php)($|?)")
            { return (pass); }
        ##对请求中有验证及cookie，直接转发给后端服务器
        if (req.http.Authorization || req.http.Cookie)
            { return (pass);}
         {
           ##除以上的访问请求，从缓存中查找
           return (lookup);
         }
       ##指定的font目录不进行缓存
       if (req.url ~ "^/fonts/")
           { return (pass); }
}
sub vcl_pipe
            { return (pipe); }
##进入pass模式，请求被送往后端，后端返回数据给客户端，但不进入缓存处理
sub vcl_pass
            { return (pass); }
sub vcl_hash
      {
          set req.hash += req.url;
        if (req.http.host)
           { set req.hash += req.http.host; }
        else { set req.hash += server.ip; }
      return (hash);
      }
##在lookup后如果在cache中找到请求的缓存，一般以下面几个关键词结束
sub vcl_hit
          {
              if (!obj.cacheable)
                { return (pass); }
                   return (deliver); { return (fetch); }
# Let the varnish server cache type, call
sub vcl_fetch
after getting the data from the backend { if (!beresp.cacheable)
{ return (pass); } if (beresp.http.set-cookie)
{Return (PASS);}
## Web server indicates the content that is not cached, the Varnish server does not cache
if (BeResp.http. Pragma ~ "no-cache" || beresp.http.Cache-Control ~ "no-cache" || beresp.http.Cache-Control ~ "private")
{ return (pass); }
# #Cache files containing jpg, png and other formats during access. The cache time is 7 days and s is seconds
if (req.request == "GET" && req.url ~ ".(js|css |mp3|jpg|png|gif|swf|jpeg|ico)$")
                                                                                                                                               > if (req.request == "GET" && req.url ~ "/[0-9].htm$")
{ set beresp.ttl = 300s; }
return (deliver);
}
####Add to view cache hits in the page header information########
sub vcl_deliver
{
set resp.http.x-hits = obj .hits ;
if (obj.hits > 0)
{ set resp.http. "MISS cqtel-bbs"; }
}


#########################The above is the configuration file of varnish############# #############
Create user:
groupadd www
useradd www -g www
Create the cache location of varnish_cache
mkdir /data/varnish_cache
Start varnish
ulimit -SHn 8192 ####Set the file descriptor, because the performance of my machine is not good, you can set it according to your own configuration
/usr/ local/varnish-2.1.3/sbin/varnishd -u www -g www -f /usr/local/varnish-2.1.3/etc/varnish/varnish.conf -a 0.0.0.0:80 -s file,/data /varnish_cache/varnish_cache.data,100M -w 1024,8192,10 -t 3600 -T 127.0.0.1:3500
####-u What to run -g What group to run -f varnish configuration file- a Bind IP and port -s varnish cache file location and size -w minimum, maximum thread and timeout time -T varnish management port, mainly used to clear cache
#End varnishd process
pkill varnishd
Start varnishncsa to write Varnish access logs to the log file:
/usr/local/varnish-2.1.3/bin/varnishncsa -w /data/logs/varnish.log &
Daily Run at 0 o'clock, cut Varnish logs by day, generate a compressed file, and delete the old logs from last month (/var/logs/cutlog.sh):
vim /usr/local/varnish-2.1.3/ etc/varnish/cut_varnish_log.sh
Write the following script:
#!/bin/sh
# This file run at 00:00
date=$(date -d "yesterday" +" %Y-%m-%d")
pkill -9 varnishncsa
mv /data/logs/varnish.log /data/logs/${date}.log
/usr/local/varnish- 2.1.3/bin/varnishncsa -w /data/logs/varnish.log &
mkdir -p /data/logs/varnish/
gzip -c /data/logs/${date}.log > /data/logs/varnish/${date}.log.gz
rm -f /data/logs/${date}.log
rm -f /data/logs/varnish/$(date -d "-1 month" +"%Y-%m*").log.gz
Scheduled task:
crontab -e
00 00 * * * /usr/local/varnish-2.1.3/ etc/varnish/cut_varnish_log.sh

Optimize Linux kernel parameters
vi /etc/sysctl.conf
net.ipv4.tcp_fin_timeout = 30
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.ip_local_port_range = 5000 65000
Make the configuration effective
/sbin/ sysctl -p

Batch clear cache using regular expressions through Varnish management port
Clear all caches
/usr/local/varnish-2.1.3/bin/varnishadm -T 127.0.0.1: 3500 url.purge *$
Clear all caches in the image directory
/usr/local/varnish-2.1.3/bin/varnishadm -T 127.0.0.1:3500 url.purge /image/
127.0. 0.1:3500 is the cleared cache server address www.linuxidc.com is the cleared domain name /static/image/tt.jsp is the cleared URL address list
/usr/local/varnish-2.1.3/bin/ varnishadm -T 127.0.0.1:3500 purge "req.http.host ~ www.linuxidc.com$ && req.url ~ /static/image/tt.jsp"
+++++++++++ ++++++++++++++++++++++++++++++++++++++++++++++++ ++++++
A PHP function to clear Squid cache

Copy code The code is as follows:

< ?php
function purge($ip, $url)
{
$errstr = '';
$errno = '';
$fp = fsockopen ($ip, 80, $ errno, $errstr, 2);
if (!$fp)
{
return false;
}
else
{
$out = "PURGE $url HTTP /1.1rn";
$out .= "Host:blog.s135.comrn";
$out .= "Connection: closernrn";
fputs ($fp, $out);
$out = fgets($fp, 4096);
fclose ($fp);
return true;
} index.php");
?>


++++++++++++++++++++++++++++++++++++++++++++ +++++++++++++++++++++++++
Configure Varnish to automatically start at boot
vim /etc/rc.d/rc.local
Write the following content in the last line:
ulimit -SHn 8192
/usr/local/varnish-2.1.3/sbin/varnishd -u www -g www -f /usr/local/varnish-2.1.3 /etc/varnish/varnish.conf -a 0.0.0.0:80 -s file,/data/varnish_cache/varnish_cache.data,100M -w 1024,8192,10 -t 3600 -T 127.0.0.1:3500
/ usr/local/varnish-2.1.3/bin/varnishncsa -w /data/logs/varnish.log &
View the number of Varnish server connections and hit rate:
/usr/local/varnish-2.1.3/ BIN/VARNISHSTATTAT
The above is the status of Varnish,
1675 0.00 0.06 Client Requests Received client requests for the server receiving side
179 0.00 0.01 Cache Hits are the hits cache, and the data is returned from the cache to the customer. The number of passes, that is, the hit rate
11 0.00 0.00 Cache misses To skip the pass cache, the number of times data is obtained from the backend service application and returned to the user
Use help to see which Varnish commands can be used:
/ usr/local/varnish-2.1.3/bin/varnishadm -T 127.0.0.1:3500 help

http://www.bkjia.com/PHPjc/327719.htmlwww.bkjia.comtruehttp: //www.bkjia.com/PHPjc/327719.htmlTechArticleVarnish is a high-performance open source HTTP accelerator. Verdens Gang, Norway’s largest online newspaper, uses 3 Varnish units instead. The original 12 Squids perform better than before. But with the old sq...