Regarding the problem of data export timeout-php手册-php.cn

In actual work, we often need to export reports. When the amount of exported data is too large, we often encounter timeout and memory overflow problems.
Solution 1

Timeout available: set_time_limit(0) solved.
Memory overflow is available: ini_set('memory_limit', 'custom memory').

Solution 2

Optimizers use databases or files to cache intermediate results.

Solution 3

Use Ajax to make multiple requests, write files, and download files. The effect is as shown above (the effect picture is a gif and cannot be uploaded, please use the link below to view).

(Option 3) Provide you with a Demo

Design ideas

1. We split it into 100 requests. The request is successful and the progress bar advances by 1%.
2. Each request requires writing to the file, and then appending to the file.
3. When the file is written, the download button is displayed, click to download.

Function points

1. Two progress bar styles.
2. Jquery Ajax.
3. Write data to CSV.
4. Download the file.

Page style: Bootstrap.

The code is as follows: <?php /** * Export CSV file * @param array $data Data * @param array $header_data First row of data * @param string $file_name File name * @param int $type $type Category * * @return string */ Function _export_csv($data = [], $header_data = [], $file_name = '', $type = 0) { $fp = fopen($file_name, 'a+'); If (($type != 1) && !empty($header_data)) { foreach ($header_data as $key => $value) { $header_data[$key] = iconv('utf-8', 'gbk', $value); } fputcsv($fp, $header_data); } $num = 0; //Every $limit line, refresh the output buffer, not too big, not too small $limit = 100000; //Get data line by line without wasting memory $count = count($data); If ($count > 0) { for ($i = 0; $i < $count; $i++) { $num++; // Refresh the output buffer to prevent problems caused by too much data If ($limit == $num) { flush(); $num = 0; } $row = $data[$i]; foreach ($row as $key => $value) { $row[$key] = iconv('utf-8', 'gbk', $value); } fputcsv($fp, $row); } } fclose($fp); } /** * Download file * @param string $file_url file address * * @return string */ function _download_file ($file_url = '') { if (!isset($file_url) || trim($file_url)=='') { die('File URL is empty.'); } if (!file_exists($file_url)) { die('File does not exist.'); } $file_name = 'down_'.date('YmdHis', time()); $file_type = fopen($file_url,'r'); //打开文件 //输入文件标签 header("Content-type: application/octet-stream"); header("Accept-Ranges: bytes"); header("Accept-Length: ".filesize($file_url)); header("Content-Disposition: attachment; filename=".$file_name); //输出文件内容 echo fread($file_type, filesize($file_url)); fclose($file_type); } //以后是逻辑代码，大家可以根据自己的需求进行编写。 $path = '文件的绝对地址'; //path 是存放文件的绝对地址。 if (isset($_POST['start'])) { //每一个单独的请求，要保证文件名是唯一的，因为后面要继续进行追加。 $file_name = 'demo.csv'; //获取数据，根据自己的业务逻辑，去数据库获取数据。 $data = []; $header_data = ['执行时间', '随机数']; //首行数据，表头 //模拟数据如下： for ($i=0; $i<=100; $i++) { $data[$i]['time'] = date('Y-m-d H:i:s', time()); $data[$i]['num'] = mt_rand(1000,9999); } $type = ($_POST['start'] != '0') ? 1 : 0 ; //开始将数据写入到文件中 _export_csv($data, $header_data, $path.$file_name, $type); //假设第100次写入完毕，那么就可以进行下载文件啦。 //可以先获取需要导出的总量，然后根据实际情况进行拆分数据，每次获取成功，进度条会显示进度。 if ($_POST['start'] == 100) { die(json_encode(['code' => 'ok', 'file_path' => '/index.php?op=down&f='.$file_name])); } else { die(json_encode(['code' => 'no'])); } } //简单的导出逻辑，可根据实际情况，进行开发。 if (($_GET['op'] == 'down') && !empty($_GET['f'])) { _download_file($path.$_GET['f']); exit; } ?> <!DOCTYPE html> <html lang="zh-CN"> <head> <meta charset="utf-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initial-scale=1"> <meta name="description" content="Demo"> <meta name="keywords" content="">  <link rel="stylesheet" href="//cdn.bootcss.com/bootstrap/3.3.5/css/bootstrap.min.css">  <script src="//cdn.bootcss.com/jquery/1.11.3/jquery.min.js"></script>  <title>Demo</title> </head> <body> <div class="container"> <div class="row"> <div class="col-lg-12" style="margin-top:20px"> <a id="export_file" href="javascript:void(0);" class="btn btn-primary btn-lg active" role="button">导出CSV文件</a> <a id="download_file" style="display:none;" href="javascript:void(0);" class="btn btn-default btn-lg active" role="button">下载文件</a> </div> </div> <div id="process_one" class="row" style="display:none"> <div class="col-lg-12" style="margin-top:20px"> <div class="progress"> <div id="progress-bar-one" class="progress-bar progress-bar-striped active" role="progressbar" aria-valuemin="0" aria-valuemax="100" style="width: 0%"> </div> </div> </div> </div> <div id="process_two" class="row" style="display:none"> <div class="col-lg-12" style="margin-top:20px"> <div class="progress"> <div id="progress-bar-two" class="progress-bar" role="progressbar" aria-valuemin="0" aria-valuemax="100" style="width: 0%;"> 60% </div> </div> </div> </div> </div> <script> $(document).ready(function () { //Export CSV file $("#export_file").click(function(){ _get_data(0); }); // The method of getting data 数据 Function _get_data(start) $.ajax({ type: "POST", Url: 'Index.php', data: { ‘start’ : start }, async: true, DataType: "json", beforeSend: function () { $("#download_file").css('display', 'none'); success: function (result) { If (result.code == 'ok') { through $("#process_one").css('display', 'none'); start ++; _get_data(start); $("#progress-bar-one").css("width", start+'%'); $("#progress-bar-two").css("width", start+'%'); $("#progress-bar-two").html(start+'%'); } }, error: function() { alert("Server Error~"); } }); } }); </script> </body> </html>温馨提示：
Demo 仅供参考，具体开发，请根据需求，严谨处理。

Thanks ~

来源：http://mp.weixin.qq.com/s?__biz=MjM5NDM4MDIwNw==&mid=2448834649&idx=1&sn=3be1ef996a9fcf3f4082decd6434a048#rd

更多【干货分享】，请关注我的个人订阅号。

Regarding the problem of data export timeout