Table of Contents
回复讨论(解决方案)
Home Backend Development PHP Tutorial mysql分表后 如何分页 (总共160个表1500万数据)

mysql分表后 如何分页 (总共160个表1500万数据)

Jun 23, 2016 pm 01:40 PM

mysql分表后,有160个表,有1500万数据,要怎么做分页列表?
之前是想用union all合并160个表的结果集。。但直接卡的数据都出不来。。
请问这里应该怎么做分页,谢谢~~~


回复讨论(解决方案)

你这是自己做的分表,那么分表条件是什么呢?
如果分页的结果不能通过分表条件框定范围,那你的分表是失败的

不是说不能用 union,而是 union 的不是全部,而是经分表条件筛选后的部分表

你这是自己做的分表,那么分表条件是什么呢?
如果分页的结果不能通过分表条件框定范围,那你的分表是失败的

不是说不能用 union,而是 union 的不是全部,而是经分表条件筛选后的部分表



徐版主好~我表里的数据主要字段是URL地址,有1600个域名,我是根据域名分成了160个表。

你这是自己做的分表,那么分表条件是什么呢?
如果分页的结果不能通过分表条件框定范围,那你的分表是失败的

不是说不能用 union,而是 union 的不是全部,而是经分表条件筛选后的部分表



我的sql语句是这样的 (字段不多且都有用就用的*号):

你这是自己做的分表,那么分表条件是什么呢?
如果分页的结果不能通过分表条件框定范围,那你的分表是失败的

不是说不能用 union,而是 union 的不是全部,而是经分表条件筛选后的部分表


我的sql语句是这样的 (字段不多且都有用就用的*号):
select * from t1 union all select * from t2 union all select * from t3.....union all select * from t160

既然你是按域名分表的,那么也就是按域名检索了
所以可以想象到,如果一个域名不在否一个表中的话,那么这个表是不需要参与检索的
这样一来你的检索范围不就缩小了很多了吗?

当一个表中包含有若干个不同域名时,你需要建一个目录表,指明某一类域名在某个表中
检索时先查目录表,得到可能在哪些表中,然后再在这些表中查找

如果你使用 mysql 提供的分表功能,那么就要简单多了

既然你是按域名分表的,那么也就是按域名检索了
所以可以想象到,如果一个域名不在否一个表中的话,那么这个表是不需要参与检索的
这样一来你的检索范围不就缩小了很多了吗?

当一个表中包含有若干个不同域名时,你需要建一个目录表,指明某一类域名在某个表中
检索时先查目录表,得到可能在哪些表中,然后再在这些表中查找

如果你使用 mysql 提供的分表功能,那么就要简单多了



这个域名和表名的对应关系我有做,但是现在打开这个分页列表,应该是所有表所有域名的数据,再分页,不是某部分域名或某部分表。

你这个有特殊排序条件吗?没有的话直接逐表读取所需数据就行了。

你这个有特殊排序条件吗?没有的话直接逐表读取所需数据就行了。


没排序,只要把所有数据列出来就好了,是160个表1500万数据都得弄出来做分页。。。逐表读取的话不行吧?!

要是整体的分页显示那就更简单了
1、每个表的记录数是已知的,应在每次发生变化时记录到目录表中
2、无论是否排序(如果排序只是表的次序不同)至多会 union 两个分表

如假定共3个分表,记录数分别为 90,120,80 总记录数为 290
设分页是每页显示40条,则 
第1页 表一的 1 到 40
第2页 表一的 41 到 80
第3页 表一的 81 到 90 + 表二的 1 到 30
第4页 表二的 31 到 70
第5页 表二的 71 到 110
第6页 表二的 111 到 120 +  表三的 1 到 30
.....
计算起来非常简单




要是整体的分页显示那就更简单了
1、每个表的记录数是已知的,应在每次发生变化时记录到目录表中
2、无论是否排序(如果排序只是表的次序不同)至多会 union 两个分表

如假定共3个分表,记录数分别为 90,120,80 总记录数为 290
设分页是每页显示40条,则 
第1页 表一的 1 到 40
第2页 表一的 41 到 80
第3页 表一的 81 到 90 + 表二的 1 到 30
第4页 表二的 31 到 70
第5页 表二的 71 到 110
第6页 表二的 111 到 120 +  表三的 1 到 30
.....
计算起来非常简单


谢谢徐版主耐心回答。
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Explain JSON Web Tokens (JWT) and their use case in PHP APIs. Explain JSON Web Tokens (JWT) and their use case in PHP APIs. Apr 05, 2025 am 12:04 AM

JWT is an open standard based on JSON, used to securely transmit information between parties, mainly for identity authentication and information exchange. 1. JWT consists of three parts: Header, Payload and Signature. 2. The working principle of JWT includes three steps: generating JWT, verifying JWT and parsing Payload. 3. When using JWT for authentication in PHP, JWT can be generated and verified, and user role and permission information can be included in advanced usage. 4. Common errors include signature verification failure, token expiration, and payload oversized. Debugging skills include using debugging tools and logging. 5. Performance optimization and best practices include using appropriate signature algorithms, setting validity periods reasonably,

Explain the concept of late static binding in PHP. Explain the concept of late static binding in PHP. Mar 21, 2025 pm 01:33 PM

Article discusses late static binding (LSB) in PHP, introduced in PHP 5.3, allowing runtime resolution of static method calls for more flexible inheritance.Main issue: LSB vs. traditional polymorphism; LSB's practical applications and potential perfo

How does session hijacking work and how can you mitigate it in PHP? How does session hijacking work and how can you mitigate it in PHP? Apr 06, 2025 am 12:02 AM

Session hijacking can be achieved through the following steps: 1. Obtain the session ID, 2. Use the session ID, 3. Keep the session active. The methods to prevent session hijacking in PHP include: 1. Use the session_regenerate_id() function to regenerate the session ID, 2. Store session data through the database, 3. Ensure that all session data is transmitted through HTTPS.

Describe the SOLID principles and how they apply to PHP development. Describe the SOLID principles and how they apply to PHP development. Apr 03, 2025 am 12:04 AM

The application of SOLID principle in PHP development includes: 1. Single responsibility principle (SRP): Each class is responsible for only one function. 2. Open and close principle (OCP): Changes are achieved through extension rather than modification. 3. Lisch's Substitution Principle (LSP): Subclasses can replace base classes without affecting program accuracy. 4. Interface isolation principle (ISP): Use fine-grained interfaces to avoid dependencies and unused methods. 5. Dependency inversion principle (DIP): High and low-level modules rely on abstraction and are implemented through dependency injection.

How to automatically set permissions of unixsocket after system restart? How to automatically set permissions of unixsocket after system restart? Mar 31, 2025 pm 11:54 PM

How to automatically set the permissions of unixsocket after the system restarts. Every time the system restarts, we need to execute the following command to modify the permissions of unixsocket: sudo...

How to debug CLI mode in PHPStorm? How to debug CLI mode in PHPStorm? Apr 01, 2025 pm 02:57 PM

How to debug CLI mode in PHPStorm? When developing with PHPStorm, sometimes we need to debug PHP in command line interface (CLI) mode...

Explain late static binding in PHP (static::). Explain late static binding in PHP (static::). Apr 03, 2025 am 12:04 AM

Static binding (static::) implements late static binding (LSB) in PHP, allowing calling classes to be referenced in static contexts rather than defining classes. 1) The parsing process is performed at runtime, 2) Look up the call class in the inheritance relationship, 3) It may bring performance overhead.

See all articles