如何解析300M+的XML文件？
背景：
1、手上有几个大的xml文件，基本都在300M至600M之间；
2、XML内容包括title,co-author,abstract,Affiliation等；
3、用的是xmlreader进行解析；
遇到的问题：
如果解析所有内容，经常只能把XML文件的一部分解析出来，似乎是内存不够的迹象；
如果只把title或Affiliation单独解析出来，就能全部解析XML文件；
附上代码：
<code>set_time_limit(0);
header("Content-Type: text/html;charset=utf-8");
$num=0;
$reader = new XMLReader();
$reader->open("JACS.xml");
while ($reader->read()) {
if($reader->nodeType==XMLREADER::ELEMENT) {
if ($reader->localName == "PubmedArticle") {
$num++;
echo 'Number:'.$num;
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "PubDate") {
while ($reader->read()){
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Year") {
$reader->read();
echo 'PublicationDate:'.$reader->value.' ';
break;
}
}
}
while ($reader->read()){
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Month") {
$reader->read();
echo $reader->value.' ';
break;
}
}
}
while ($reader->read()){
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Day") {
$reader->read();
echo $reader->value;
break;
}
}
}
echo '<br>';
break;
}
}
}
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Title") {
$reader->read();
echo 'JournalName:'.$reader->value.'<br>';
break;
}
}
}
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "ArticleTitle") {
$reader->read();
echo 'ArticleTitle:'.$reader->value.'<br>';
break;
}
}
}
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "AbstractText") {
$reader->read();
echo 'Abstract:'.$reader->value.'<br><br>';
break;
}
}
}
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Affiliation") {
$reader->read();
echo 'Affiliation:'.$reader->value.'<br><br>';
break;
}
}
}
}
}
}
$reader->close();
}
</code>回复内容：
背景：
1、手上有几个大的xml文件，基本都在300M至600M之间；
2、XML内容包括title,co-author,abstract,Affiliation等；
3、用的是xmlreader进行解析；
遇到的问题：
如果解析所有内容，经常只能把XML文件的一部分解析出来，似乎是内存不够的迹象；
如果只把title或Affiliation单独解析出来，就能全部解析XML文件；
附上代码：
<code>set_time_limit(0);
header("Content-Type: text/html;charset=utf-8");
$num=0;
$reader = new XMLReader();
$reader->open("JACS.xml");
while ($reader->read()) {
if($reader->nodeType==XMLREADER::ELEMENT) {
if ($reader->localName == "PubmedArticle") {
$num++;
echo 'Number:'.$num;
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "PubDate") {
while ($reader->read()){
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Year") {
$reader->read();
echo 'PublicationDate:'.$reader->value.' ';
break;
}
}
}
while ($reader->read()){
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Month") {
$reader->read();
echo $reader->value.' ';
break;
}
}
}
while ($reader->read()){
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Day") {
$reader->read();
echo $reader->value;
break;
}
}
}
echo '<br>';
break;
}
}
}
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Title") {
$reader->read();
echo 'JournalName:'.$reader->value.'<br>';
break;
}
}
}
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "ArticleTitle") {
$reader->read();
echo 'ArticleTitle:'.$reader->value.'<br>';
break;
}
}
}
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "AbstractText") {
$reader->read();
echo 'Abstract:'.$reader->value.'<br><br>';
break;
}
}
}
while ($reader->read()) {
if ($reader->nodeType == XMLREADER::ELEMENT) {
if ($reader->localName == "Affiliation") {
$reader->read();
echo 'Affiliation:'.$reader->value.'<br><br>';
break;
}
}
}
}
}
}
$reader->close();
}
</code>
可以参考一下 这个 PHP处理比较大的XML文件
为啥要装那么大 txt打开那么大也死机了 多分几个文件吧
Hot AI Tools
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Undress AI Tool
Undress images for free
Clothoff.io
AI clothes remover
AI Hentai Generator
Generate AI Hentai for free.
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
CakePHP Project Configuration
Sep 10, 2024 pm 05:25 PM
In this chapter, we will understand the Environment Variables, General Configuration, Database Configuration and Email Configuration in CakePHP.
PHP 8.4 Installation and Upgrade guide for Ubuntu and Debian
Dec 24, 2024 pm 04:42 PM
PHP 8.4 brings several new features, security improvements, and performance improvements with healthy amounts of feature deprecations and removals. This guide explains how to install PHP 8.4 or upgrade to PHP 8.4 on Ubuntu, Debian, or their derivati
CakePHP Date and Time
Sep 10, 2024 pm 05:27 PM
To work with date and time in cakephp4, we are going to make use of the available FrozenTime class.
CakePHP File upload
Sep 10, 2024 pm 05:27 PM
To work on file upload we are going to use the form helper. Here, is an example for file upload.
CakePHP Routing
Sep 10, 2024 pm 05:25 PM
In this chapter, we are going to learn the following topics related to routing ?
Discuss CakePHP
Sep 10, 2024 pm 05:28 PM
CakePHP is an open-source framework for PHP. It is intended to make developing, deploying and maintaining applications much easier. CakePHP is based on a MVC-like architecture that is both powerful and easy to grasp. Models, Views, and Controllers gu
CakePHP Creating Validators
Sep 10, 2024 pm 05:26 PM
Validator can be created by adding the following two lines in the controller.
How To Set Up Visual Studio Code (VS Code) for PHP Development
Dec 20, 2024 am 11:31 AM
Visual Studio Code, also known as VS Code, is a free source code editor — or integrated development environment (IDE) — available for all major operating systems. With a large collection of extensions for many programming languages, VS Code can be c
