How to quickly export millions of data to CSV in PHP

In PHP, you can use the server's cache to quickly export CSV with millions of data. Today I will teach you how to quickly export CSV. You can refer to it if you need it.

php implements million-level data export. The server's cache is used to achieve this.

Implementation:

1: Create a test table, And add test data

1: Create a test table

Here I created a test table, the fields are: id, name, age, email

2: Join the test Data

(1) First manually add several rows of data to the table

Then execute the following command to add data in batches

INSERT INTO test (name,age,email) SELECT name,age,email FROM test;

Execute the above command multiple times to test the data will be exponential Increase, so that you can get a lot of test data

2: PHP implements exporting millions of data (my query command here is the query command that comes with the Yii framework)

//让程序一直运行
set_time_limit(0);
//设置程序运行内存
ini_set('memory_limit', '128M');
//导出文件名
$fileName = '测试导出数据';
header('Content-Encoding: UTF-8');
header("Content-type:application/vnd.ms-excel;charset=UTF-8");
header('Content-Disposition: attachment;filename="' . $fileName . '.csv"');
//打开php标准输出流
$fp = fopen('php://output', 'a');
//添加BOM头，以UTF8编码导出CSV文件，如果文件头未添加BOM头，打开会出现乱码。
fwrite($fp, chr(0xEF).chr(0xBB).chr(0xBF));
//添加导出标题
fputcsv($fp, ['姓名', '岁数', '邮箱']);
$nums = 10000; //每次导出数量
$count = Test::find()->count();
$step = ceil($count/$nums);//循环次数
for($i = 0; $i < $step; $i++) {
    $result = Test::find()
        ->select([&#39;name&#39;, &#39;age&#39;, &#39;email&#39;])
        ->limit($nums)
        ->offset($i * $nums)
        ->asArray()
        ->all();
    foreach ($result as $item) {
        fputcsv($fp, $item);
    }
    //每1万条数据就刷新缓冲区
    ob_flush();
    flush();
}
exit;

Test as above Afterwards, you can find that it only takes about ten seconds to export about one million data, and the efficiency is pretty good

The above is the detailed content of How to quickly export millions of data to CSV in PHP. For more information, please follow other related articles on the PHP Chinese website!