1亿条数据在PHP中实现Mysql数据库分表100张,mysql100张
1亿条数据在PHP中实现Mysql数据库分表100张,mysql100张
当数据量猛增的时候,大家都会选择库表散列等等方式去优化数据读写速度。笔者做了一个简单的尝试,1亿条数据,分100张表。具体实现过程如下:
首先创建100张表:
<span><span> 1</span> <span>$i=0; </span><span> 2</span> while($i<span><</span><span>=99</span><span>){ </span><span> 3</span> <span>echo "$newNumber \r\n"; </span><span> 4</span> <span>$sql</span><span>="CREATE TABLE `code_"</span><span>.$i."` ( </span><span> 5</span> <span> `full_code` char(10) NOT NULL, </span><span> 6</span> <span> `create_time` int(10) unsigned NOT NULL, </span><span> 7</span> <span> PRIMARY KEY (`full_code`), </span><span> 8</span> <span>) ENGINE</span><span>=MyISAM </span><span>DEFAULT CHARSET</span><span>=utf8"; </span><span> 9</span> <span>mysql_query($sql); </span><span>10</span> <span>$i++; </span></span>
下面说一下我的分表规则,full_code作为主键,我们对full_code做hash
函数如下:
<span><span>1</span> <span>$table_name=get_hash_table('code',$full_code); </span><span>2</span> <span>function get_hash_table($table,$code,$s=100){ </span><span>3</span> <span>$hash = sprintf("%u", crc32($code)); </span><span>4</span> <span>echo $hash; </span><span>5</span> <span>$hash1 = intval(fmod($hash, $s)); </span><span>6</span> <span> return $table."_".$hash1; </span><span>7</span> } </span>
这样插入数据前通过get_hash_table获取数据存放的表名。
最后我们使用merge存储引擎来实现一张完整的code表
<span><span>1</span> <span>CREATE TABLE IF NOT EXISTS `code` ( </span><span>2</span> <span>`full_code` char(10) NOT NULL, </span><span>3</span> <span>`create_time` int(10) unsigned NOT NULL, </span><span>4</span> <span>INDEX(full_code) </span><span>5</span> ) TYPE=MERGE UNION=(code_0,code_1,code_2.......) INSERT_METHOD=LAST ; </span>
这样我们通过select * from code就可以得到所有的full_code数据了。

Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

AI Hentai Generator
Generate AI Hentai for free.

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics



MySQL is suitable for beginners because it is simple to install, powerful and easy to manage data. 1. Simple installation and configuration, suitable for a variety of operating systems. 2. Support basic operations such as creating databases and tables, inserting, querying, updating and deleting data. 3. Provide advanced functions such as JOIN operations and subqueries. 4. Performance can be improved through indexing, query optimization and table partitioning. 5. Support backup, recovery and security measures to ensure data security and consistency.

Create a database using Navicat Premium: Connect to the database server and enter the connection parameters. Right-click on the server and select Create Database. Enter the name of the new database and the specified character set and collation. Connect to the new database and create the table in the Object Browser. Right-click on the table and select Insert Data to insert the data.

MySQL is an open source relational database management system. 1) Create database and tables: Use the CREATEDATABASE and CREATETABLE commands. 2) Basic operations: INSERT, UPDATE, DELETE and SELECT. 3) Advanced operations: JOIN, subquery and transaction processing. 4) Debugging skills: Check syntax, data type and permissions. 5) Optimization suggestions: Use indexes, avoid SELECT* and use transactions.

The future of PHP will be achieved by adapting to new technology trends and introducing innovative features: 1) Adapting to cloud computing, containerization and microservice architectures, supporting Docker and Kubernetes; 2) introducing JIT compilers and enumeration types to improve performance and data processing efficiency; 3) Continuously optimize performance and promote best practices.

Steps to perform SQL in Navicat: Connect to the database. Create a SQL Editor window. Write SQL queries or scripts. Click the Run button to execute a query or script. View the results (if the query is executed).

You can create a new MySQL connection in Navicat by following the steps: Open the application and select New Connection (Ctrl N). Select "MySQL" as the connection type. Enter the hostname/IP address, port, username, and password. (Optional) Configure advanced options. Save the connection and enter the connection name.

MySQL and SQL are essential skills for developers. 1.MySQL is an open source relational database management system, and SQL is the standard language used to manage and operate databases. 2.MySQL supports multiple storage engines through efficient data storage and retrieval functions, and SQL completes complex data operations through simple statements. 3. Examples of usage include basic queries and advanced queries, such as filtering and sorting by condition. 4. Common errors include syntax errors and performance issues, which can be optimized by checking SQL statements and using EXPLAIN commands. 5. Performance optimization techniques include using indexes, avoiding full table scanning, optimizing JOIN operations and improving code readability.

PHP and Python each have their own advantages, and the choice should be based on project requirements. 1.PHP is suitable for web development, with simple syntax and high execution efficiency. 2. Python is suitable for data science and machine learning, with concise syntax and rich libraries.
