Koa service current limiting method example
The requirement of current limiting is to limit the number of simultaneous executions. After this number is exceeded, it must be cached in a queue. This article mainly introduces the practice of Koa service current limiting method. The editor thinks it is quite good. Now I will share it with you and give you a reference. Let’s follow the editor to take a look, I hope it can help everyone.
I recently received a request. It is very simple, just set up a server, call a provided interface when receiving the request, and then return the result. Because of the performance issues of this interface, the number of requests at the same time cannot exceed a certain number, and the current must be limited in the service.
koa middleware does not call next
The original idea is to count in koa middleware, and cache the next function when there are more than 6. When the ongoing task ends, call next to continue other requests.
Later I found that in koa middleware, if the next function request is not executed, it will not stop. Instead, the subsequent middleware will no longer be called and the content will be returned directly.
const Koa = require('koa');
const app = new Koa();
app.use((ctx, next) => {
console.log('middleware 1');
setTimeout(() => {
next();
}, 3000);
ctx.body = 'hello';
});
app.use((ctx, next) => {
console.log('middleware 2');
});
app.listen(8989);The above code first prints ‘middleware 1’ on the console => The browser receives ‘hello’ => The console prints ‘middleware 2’.
Another thing to note here is that after a request has ended (finish), its next method can still be called, and the subsequent middleware will continue to run (but the modification to ctx will not take effect , because the request has been returned). Similarly, the close request (close) behaves in the same way.
Use await to make the request wait
Delaying the execution of the next function cannot achieve the purpose. The next natural thing to think of is to use await to wait for the current request. The await function returns a Promise. We store the resolve function in this Promise in the queue and delay the call.
const Koa = require('koa');
const app = new Koa();
const queue = [];
app.use(async (ctx, next) => {
setTimeout(() => {
queue.shift()();
}, 3000);
await delay();
ctx.body = 'hello';
});
function delay() {
return new Promise((resolve, reject) => {
queue.push(resolve);
});
}
app.listen(8989);The above code returns a Promise in the delay function, and the resolve function of the Promise is stored in the queue. Set the timer to execute the resolve function in the queue after 3 seconds, so that the request can continue to be executed.
Is the current flow limited for routes or for requests?
After the basic principle of current limiting is implemented, the next question is where should the current limiting code be written? Basically, there are two locations:
Current limiting for interfaces
Due to our needs, current limiting is due to the limited performance of the requested interface. So we can limit the flow of this request separately:
async function requestSomeApi() {
// 如果已经超过了最大并发
if (counter > maxAllowedRequest) {
await delay();
}
counter++;
const result = await request('http://some.api');
counter--;
queue.shift()();
return result;
}There is also a convenient reusable version below.
async function limitWrapper(func, maxAllowedRequest) {
const queue = [];
const counter = 0;
return async function () {
if (counter > maxAllowedRequest) {
await new Promise((resolve, reject) => {
queue.push(resolve);
});
}
counter++;
const result = await func();
counter--;
queue.shift()();
return result;
}
}Current limiting for routing
This method is to write a koa middleware and limit the current in the middleware:
async function limiter(ctx, next) => {
// 如果超过了最大并发数目
if (counter >= maxAllowedRequest) {
// 如果当前队列中已经过长
await new Promise((resolve, reject) => {
queue.push(resolve);
});
}
store.counter++;
await next();
store.counter--;
queue.shift()();
};After Just use this middleware in the router for different routes:
router.use('/api', rateLimiter);
Comparison
implemented current limiting for the interface. I felt that the logic was a bit confusing, so I used In order to limit the flow of routing, everything works perfectly.
Until I received another request, I had to request this interface three times to return the result array of the three requests. Now the problem comes, we can't call the interface directly because the current is limited. You cannot directly call the function of the request interface because our current limit is based on routing. then what should we do? We can only request this route and request it ourselves. . .
Things to note
Listen to the close event and remove the request from the queue
Requests that have been stored in the queue may be canceled by the user Condition. As mentioned before, even if the request is canceled in koa, subsequent middleware will still run, which means that interfaces that require current limiting will also be executed, causing waste.
You can listen to the close event to achieve this purpose. We need to mark each request with a hash value:
ctx.res.on('close', () => {
const index = queue.findIndex(item => item.hash === hash);
if (index > -1) {
queue.splice(index, 1);
}
});Set the timeout
In order to prevent the user from waiting too long For a long time, you need to set a timeout, which is easy to implement in koa:
const server = app.listen(config.port); server.timeout = DEFAULT_TIMEOUT;
The current queue is too long
If the current queue is too long, even if you join the queue will time out. Therefore, we also need to deal with the situation where the queue is too long:
if (queue.length > maxAllowedRequest) {
ctx.body = 'error message';
return;
}Related recommendations:
The Road of Java Architect--Current Limiting Technology and Various Programming Languages
nginx current limiting algorithm
Use redis for current limiting
The above is the detailed content of Koa service current limiting method example. For more information, please follow other related articles on the PHP Chinese website!
Hot AI Tools
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Undress AI Tool
Undress images for free
Clothoff.io
AI clothes remover
Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
1653
14
1413
52
1304
25
1251
29
1224
24
How to recover deleted contacts on WeChat (simple tutorial tells you how to recover deleted contacts)
May 01, 2024 pm 12:01 PM
Unfortunately, people often delete certain contacts accidentally for some reasons. WeChat is a widely used social software. To help users solve this problem, this article will introduce how to retrieve deleted contacts in a simple way. 1. Understand the WeChat contact deletion mechanism. This provides us with the possibility to retrieve deleted contacts. The contact deletion mechanism in WeChat removes them from the address book, but does not delete them completely. 2. Use WeChat’s built-in “Contact Book Recovery” function. WeChat provides “Contact Book Recovery” to save time and energy. Users can quickly retrieve previously deleted contacts through this function. 3. Enter the WeChat settings page and click the lower right corner, open the WeChat application "Me" and click the settings icon in the upper right corner to enter the settings page.
How to write a novel in the Tomato Free Novel app. Share the tutorial on how to write a novel in Tomato Novel.
Mar 28, 2024 pm 12:50 PM
Tomato Novel is a very popular novel reading software. We often have new novels and comics to read in Tomato Novel. Every novel and comic is very interesting. Many friends also want to write novels. Earn pocket money and edit the content of the novel you want to write into text. So how do we write the novel in it? My friends don’t know, so let’s go to this site together. Let’s take some time to look at an introduction to how to write a novel. Share the Tomato novel tutorial on how to write a novel. 1. First open the Tomato free novel app on your mobile phone and click on Personal Center - Writer Center. 2. Jump to the Tomato Writer Assistant page - click on Create a new book at the end of the novel.
How to enter bios on Colorful motherboard? Teach you two methods
Mar 13, 2024 pm 06:01 PM
Colorful motherboards enjoy high popularity and market share in the Chinese domestic market, but some users of Colorful motherboards still don’t know how to enter the bios for settings? In response to this situation, the editor has specially brought you two methods to enter the colorful motherboard bios. Come and try it! Method 1: Use the U disk startup shortcut key to directly enter the U disk installation system. The shortcut key for the Colorful motherboard to start the U disk with one click is ESC or F11. First, use Black Shark Installation Master to create a Black Shark U disk boot disk, and then turn on the computer. When you see the startup screen, continuously press the ESC or F11 key on the keyboard to enter a window for sequential selection of startup items. Move the cursor to the place where "USB" is displayed, and then
The secret of hatching mobile dragon eggs is revealed (step by step to teach you how to successfully hatch mobile dragon eggs)
May 04, 2024 pm 06:01 PM
Mobile games have become an integral part of people's lives with the development of technology. It has attracted the attention of many players with its cute dragon egg image and interesting hatching process, and one of the games that has attracted much attention is the mobile version of Dragon Egg. To help players better cultivate and grow their own dragons in the game, this article will introduce to you how to hatch dragon eggs in the mobile version. 1. Choose the appropriate type of dragon egg. Players need to carefully choose the type of dragon egg that they like and suit themselves, based on the different types of dragon egg attributes and abilities provided in the game. 2. Upgrade the level of the incubation machine. Players need to improve the level of the incubation machine by completing tasks and collecting props. The level of the incubation machine determines the hatching speed and hatching success rate. 3. Collect the resources required for hatching. Players need to be in the game
Summary of methods to obtain administrator rights in Win11
Mar 09, 2024 am 08:45 AM
A summary of how to obtain Win11 administrator rights. In the Windows 11 operating system, administrator rights are one of the very important permissions that allow users to perform various operations on the system. Sometimes, we may need to obtain administrator rights to complete some operations, such as installing software, modifying system settings, etc. The following summarizes some methods for obtaining Win11 administrator rights, I hope it can help you. 1. Use shortcut keys. In Windows 11 system, you can quickly open the command prompt through shortcut keys.
How to set font size on mobile phone (easily adjust font size on mobile phone)
May 07, 2024 pm 03:34 PM
Setting font size has become an important personalization requirement as mobile phones become an important tool in people's daily lives. In order to meet the needs of different users, this article will introduce how to improve the mobile phone use experience and adjust the font size of the mobile phone through simple operations. Why do you need to adjust the font size of your mobile phone - Adjusting the font size can make the text clearer and easier to read - Suitable for the reading needs of users of different ages - Convenient for users with poor vision to use the font size setting function of the mobile phone system - How to enter the system settings interface - In Find and enter the "Display" option in the settings interface - find the "Font Size" option and adjust it. Adjust the font size with a third-party application - download and install an application that supports font size adjustment - open the application and enter the relevant settings interface - according to the individual
Detailed explanation of Oracle version query method
Mar 07, 2024 pm 09:21 PM
Detailed explanation of Oracle version query method Oracle is one of the most popular relational database management systems in the world. It provides rich functions and powerful performance and is widely used in enterprises. In the process of database management and development, it is very important to understand the version of the Oracle database. This article will introduce in detail how to query the version information of the Oracle database and give specific code examples. Query the database version of the SQL statement in the Oracle database by executing a simple SQL statement
What should I do if my Douyin live broadcast has no traffic? The reason why the live broadcast room is restricted
Mar 27, 2024 pm 10:51 PM
With the development of the Internet, live streaming has become a new marketing method in the e-commerce industry. Among many live broadcast platforms, Douyin Live has attracted much attention due to its large user base and powerful social communication effect. However, when carrying out Douyin live broadcasts to bring goods, some anchors face an embarrassing problem: there is no traffic in the live broadcast room and no one cares about the goods. So, when Douyin’s live broadcast has no traffic, how should we solve this problem? 1. What should I do if the Douyin live broadcast has no traffic? Improve content quality: The content of the live broadcast room is the key to attracting users. Anchors can start with product introductions, brand stories, interactive links, etc. to improve the quality and attractiveness of live content and make users want to buy. To reach a wider audience and meet their needs and interests, through direct
