Home Operation and Maintenance Linux Operation and Maintenance How to solve some common problems caused by dealing with high concurrency in server maintenance

How to solve some common problems caused by dealing with high concurrency in server maintenance

Jul 24, 2017 am 10:49 AM
lead to concurrent server

Let’s follow the scenario here. After all, the scenario is the best way to experience practicality. First, let’s talk about the server configuration and environment

Alibaba Cloud ECS cloud host, 8G memory, 4-core CPU, 20M bandwidth, 20G system disk + 200G data disk, CentOS6.564 bit, installed integrated lnmp environment

Scenario: WeChat sends red envelopes

This scenario is very common. Generally, customers will push an advertisement from the WeChat official account on the hour. At this time, the server concurrency is about 3000 to Around 5,000. Speaking of which, this is not actually considered high concurrency, but the server still crashed and it took about 5 minutes to return to normal. This is a bit inappropriate, let’s analyze the reasons. The CPU utilization is not high and the memory usage is normal. In the Alibaba Cloud control panel, the network egress traffic is full. It seems that the problem is caused by network reasons.

First of all, I checked the static resources and found that most of the pictures were not optimized, so I took them off and performed lossless compression. I probably omitted about 1M in size. After submitting, they still crashed and the server frequently displayed 502.

Check the static resource css and js of the page again, and replace the commonly used js library with CDN to reduce the number of requests. After submission, there is still not much change, and the 502 remains the same.

So check the number of nginx connections and use the command

netstat -n | awk '/^tcp/ {++S[$NF]} END {for(a in S) print a, S[a]}'
Copy after login

The result shows

TIME_WAIT 3828SYN_SENT 1FIN_WAIT1 107FIN_WAIT2 27ESTABLISHED 661SYN_RECV 23CLOSING 15LAST_ACK 284
Copy after login

Good boy, TIME_WAITE is very high, be sure to do it here Let’s talk about the meaning of TIME_WAITE: TIME_WAIT: A release has been initialized on the other side. What does this mean? This means that the server has been actively shut down and is waiting for a response from the client. If the client does not respond, a wait will occur and this value will increase. Obviously, we need to reduce the value of TIME_WAIT at this time.

Here you only need to modify some parameters of sysctl.conf. Edit the /etc/sysctl.conf file and check

whether it is such a setting. If the corresponding one cannot be found, add it in the file Just add it at the end. After saving, execute

/sbin/sysctl -p
Copy after login

configuration to take effect.

Continue to check the number of nginx connections after 20 minutes. The result

TIME_WAIT 87SYN_SENT 1FIN_WAIT1 60FIN_WAIT2 19ESTABLISHED 477SYN_RECV 12CLOSING 2LAST_ACK 100
Copy after login

returns to normal and the network bandwidth has also dropped.

But the good times did not last long. When I started grabbing red envelopes at the second hour, 502 appeared again. Checking the process found that mysqld's CPU usage was very high, causing the CPU to be fully loaded and the server to crash. Modify the mysql configuration file and adjust max_connection to 30000. Other related parameters were adjusted and optimized, and the situation was alleviated, but within a few minutes the CPU was fully loaded again.

Weird! So I checked the process in mysql and found that there were frequent SQL queries, and the data volume of the several tables queried was around 100,000. It was judged that it was because no index was set. After consulting the back-end development, it turned out that only the primary key was set. Modify it immediately. Five minutes after submitting it, the CPU dropped and stabilized at around 10%, and 502 no longer appeared.

The above is the detailed content of How to solve some common problems caused by dealing with high concurrency in server maintenance. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Repo: How To Revive Teammates
4 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
4 weeks ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

How can concurrency and multithreading of Java functions improve performance? How can concurrency and multithreading of Java functions improve performance? Apr 26, 2024 pm 04:15 PM

Concurrency and multithreading techniques using Java functions can improve application performance, including the following steps: Understand concurrency and multithreading concepts. Leverage Java's concurrency and multi-threading libraries such as ExecutorService and Callable. Practice cases such as multi-threaded matrix multiplication to greatly shorten execution time. Enjoy the advantages of increased application response speed and optimized processing efficiency brought by concurrency and multi-threading.

Application of concurrency and coroutines in Golang API design Application of concurrency and coroutines in Golang API design May 07, 2024 pm 06:51 PM

Concurrency and coroutines are used in GoAPI design for: High-performance processing: Processing multiple requests simultaneously to improve performance. Asynchronous processing: Use coroutines to process tasks (such as sending emails) asynchronously, releasing the main thread. Stream processing: Use coroutines to efficiently process data streams (such as database reads).

How to install PHP FFmpeg extension on server? How to install PHP FFmpeg extension on server? Mar 28, 2024 pm 02:39 PM

How to install PHPFFmpeg extension on server? Installing the PHPFFmpeg extension on the server can help us process audio and video files in PHP projects and implement functions such as encoding, decoding, editing, and processing of audio and video files. This article will introduce how to install the PHPFFmpeg extension on the server, as well as specific code examples. First, we need to ensure that PHP and FFmpeg are installed on the server. If FFmpeg is not installed, you can follow the steps below to install FFmpe

A guide to unit testing Go concurrent functions A guide to unit testing Go concurrent functions May 03, 2024 am 10:54 AM

Unit testing concurrent functions is critical as this helps ensure their correct behavior in a concurrent environment. Fundamental principles such as mutual exclusion, synchronization, and isolation must be considered when testing concurrent functions. Concurrent functions can be unit tested by simulating, testing race conditions, and verifying results.

Equipped with AMD EPYC 4004 series processors, ASUS launches a variety of server and workstation products Equipped with AMD EPYC 4004 series processors, ASUS launches a variety of server and workstation products Jul 23, 2024 pm 09:34 PM

According to news from this website on July 23, ASUS has launched a variety of server and workstation-level products powered by AMD EPYC 4004 series processors. Note from this site: AMD launched the AM5 platform and Zen4 architecture EPYC 4004 series processors in May, offering up to 16-core 3DV-Cache specifications. ASUSProER100AB6 server ASUSProER100AB6 is a 1U rack server product equipped with EPYC Xiaolong 4004 series processor, suitable for the needs of IDC and small and medium-sized enterprises. ASUSExpertCenterProET500AB6 workstation ASUSExpertCenterProET500AB6 is a

What are the commonly used concurrency tools in Java function libraries? What are the commonly used concurrency tools in Java function libraries? Apr 30, 2024 pm 01:39 PM

The Java concurrency library provides a variety of tools, including: Thread pool: used to manage threads and improve efficiency. Lock: used to synchronize access to shared resources. Barrier: Used to wait for all threads to reach a specified point. Atomic operations: indivisible units, ensuring thread safety. Concurrent queue: A thread-safe queue that allows multiple threads to operate simultaneously.

Solving concurrency issues in PHP multi-threaded functions Solving concurrency issues in PHP multi-threaded functions May 01, 2024 pm 09:45 PM

Concurrency issues in PHP multi-threaded functions can be solved by using synchronization tools (such as mutex locks) to manage multi-threaded access to shared resources. Use functions that support mutual exclusion options to ensure that the function is not called again while another thread is executing. Wrap non-reentrant functions in synchronized blocks to protect function calls.

How does Java database connection handle transactions and concurrency? How does Java database connection handle transactions and concurrency? Apr 16, 2024 am 11:42 AM

Transactions ensure database data integrity, including atomicity, consistency, isolation, and durability. JDBC uses the Connection interface to provide transaction control (setAutoCommit, commit, rollback). Concurrency control mechanisms coordinate concurrent operations, using locks or optimistic/pessimistic concurrency control to achieve transaction isolation to prevent data inconsistencies.

See all articles