Home Java javaTutorial Comparison of file copying performance between io and nio in java

Comparison of file copying performance between io and nio in java

Nov 22, 2016 pm 02:11 PM
java

1. In the traditional JAVA IO system, the process of reading disk file data is as follows:

Take the FileInputStream class as an example. This class has a read(byte b[]) method. byte b[] is the data we want to store and read. Get the user space buffer. Referring to the source code of the read(byte b[]) method, we can see that it will call the readBytes(b, 0, b.length) method internally, and the readBytes(b, 0, b.length) method is a native method (i.e. Local method), and finally initiate a system call through this local method, that is, calling the read() method of the system kernel. The kernel reads data from the disk to the kernel buffer. In this process, the disk controller reads the data from the disk through DMA operation. Get the kernel buffer, this process does not depend on the CPU. The user process then copies the data from the kernel buffer to the user space buffer. The user process then reads data from the user space buffer. Because user processes cannot directly access the hardware. Therefore, the kernel needs to act as a middleman to read the file.

The whole process is shown in the figure below: Comparison of file copying performance between io and nio in java

2. Since JAVA 1.4, JAVA has introduced the concept of file channel in NIO. The biggest difference from traditional IO is that traditional IO is based on Byte (byte) and Stream ( Stream), and NIO is based on Buffer (buffer) and Channel (channel). The API provides a FileChannel class and Selector (selector), which is associated with the traditional IO stream. The file channel can be obtained by FileInputStream or FileOutputStream, and we can read and write files through the channel.

3. JAVA NIO also introduces the concept of file memory mapping: most modern operating systems support virtual memory mapping, so that we can map the kernel space address and the user space virtual address to the same physical address, so that the DMA hardware (can only access physical memory address) can fill the buffer visible to both the kernel and user space processes. As shown in the figure below:

Comparison of file copying performance between io and nio in java

Let’s take a look at the time-consuming comparison of file copying using IO, BufferedIO and NIO respectively: 11 MB audio file

Time-consuming for file copying using traditional IO method: 21ms
Using NIO file channel The method takes 16ms to implement file copy
Using NIO file memory mapping and file channel to implement file copying takes 7ms
Using FileUtils file copy tool class takes 53ms

package com.maystar.utils;
import java.io. File;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.nio.MappedByteBuffer;
import java.nio.channels.FileChannel;

import org.apache.commons.io.FileUtils;

public class FileCopyTest {

​ public static void main(String[] args) throws Exception {

​ ​ String sourcePath = "F:\glzmv.mp3";

​ ​ String destPath1 = "F:\glzmvCopy1.mp3";

String destPath2 = “F:\glzmvCopy2.mp3”; ;
long t1 = System.currentTimeMillis();

            traditionalCopy(sourcePath,destPath1);                                                   using           using using ’s ’ s ’ using using ‐ to copy through through ‐ ‐ ‐t ‐ t2 to 1) + "ms") ;
                                                                                                                       nioCopy (   ); t3-t2) + " ms");
nioCopy2(sourcePath,destPath3);

long t4 = System.currentTimeMillis();

System.out.println("Time-consuming to implement file copy using NIO file memory mapping and file channel:" + (t 4 -t3) + "ms");
                                                                                                                                              nioCopy3 ( ) nioCopy3(sourcePath, destPath4); ) + "ms");
}
  private static void nioCopy3(String sourcePath, String destPath) throws Exception {
                                                                                                               ,, , , ,                                                                                                     File dest = new File(destPath);


FileUtils. copyFile(source, dest);//View source code commons-io-2.4 also uses nio operations to implement operations similar to nioCopy, but the efficiency is lower than nioCopy. The reason is that after executing doCopyFile in FileUtils.copyFile, the IOUtils tool class is closed. Stream operations call corresponding constructors according to different types of streams.
                                                                                                                                                                                                                                                                File dest = new File(destPath);

if(!dest.exists( )) {
                                                                                                                                                                       (dest);
                                                                                FileChannel sourceCh =         getChannel();                     FileChannel destCh = fos.getChannel();

        MappedByteBuffer mbb = sourceCh.map(FileChannel.MapMode.READ_ONLY, 0, sourceCh.size()); sourceCh.close();

destCh .close();
                                                                                                                                                                          .close();         File source = new File(sourcePath); 
     
         File dest = new File(destPath); 
     
         if(!dest.exists()) { 
    
            dest.createNewFile(); 
    
        } 
    
        FileInputStream fis = new FileInputStream(source); 
    
        FileOutputStream fos = new FileOutputStream(dest); 
    
        byte [] buf = new byte [fis.available()]; 
    
        int len = 0; 
    
        while((len = fis.read(buf)) != -1) { 
    
            fos.write(buf, 0, len); 
    
        } 
    
        fis.close(); 
    
        fos.close(); 
    
     } 
    
     private  static  void nioCopy(String sourcePath, String destPath) throws Exception{ 
    
        File source = new File(sourcePath); 
    
        File dest = new File(destPath); 
    
        if(!dest.exists()) { 
    
            dest.createNewFile(); 
    
        } 
    
        FileInputStream fis = new FileInputStream(source); 
    
        FileOutputStream fos = new FileOutputStream(dest); 
    
        FileChannel sourceCh = fis.getChannel(); 
       
    
        FileChannel destCh = fos.getChannel(); 
        destCh.transferFrom(sourceCh, 0, sourceCh.size()); 
    
        sourceCh.close(); 
    
        destCh.close(); 
    
     } 
    
 } 


Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Hot Topics

Java Tutorial
1655
14
PHP Tutorial
1253
29
C# Tutorial
1227
24
Break or return from Java 8 stream forEach? Break or return from Java 8 stream forEach? Feb 07, 2025 pm 12:09 PM

Java 8 introduces the Stream API, providing a powerful and expressive way to process data collections. However, a common question when using Stream is: How to break or return from a forEach operation? Traditional loops allow for early interruption or return, but Stream's forEach method does not directly support this method. This article will explain the reasons and explore alternative methods for implementing premature termination in Stream processing systems. Further reading: Java Stream API improvements Understand Stream forEach The forEach method is a terminal operation that performs one operation on each element in the Stream. Its design intention is

PHP: A Key Language for Web Development PHP: A Key Language for Web Development Apr 13, 2025 am 12:08 AM

PHP is a scripting language widely used on the server side, especially suitable for web development. 1.PHP can embed HTML, process HTTP requests and responses, and supports a variety of databases. 2.PHP is used to generate dynamic web content, process form data, access databases, etc., with strong community support and open source resources. 3. PHP is an interpreted language, and the execution process includes lexical analysis, grammatical analysis, compilation and execution. 4.PHP can be combined with MySQL for advanced applications such as user registration systems. 5. When debugging PHP, you can use functions such as error_reporting() and var_dump(). 6. Optimize PHP code to use caching mechanisms, optimize database queries and use built-in functions. 7

PHP vs. Python: Understanding the Differences PHP vs. Python: Understanding the Differences Apr 11, 2025 am 12:15 AM

PHP and Python each have their own advantages, and the choice should be based on project requirements. 1.PHP is suitable for web development, with simple syntax and high execution efficiency. 2. Python is suitable for data science and machine learning, with concise syntax and rich libraries.

PHP vs. Other Languages: A Comparison PHP vs. Other Languages: A Comparison Apr 13, 2025 am 12:19 AM

PHP is suitable for web development, especially in rapid development and processing dynamic content, but is not good at data science and enterprise-level applications. Compared with Python, PHP has more advantages in web development, but is not as good as Python in the field of data science; compared with Java, PHP performs worse in enterprise-level applications, but is more flexible in web development; compared with JavaScript, PHP is more concise in back-end development, but is not as good as JavaScript in front-end development.

PHP vs. Python: Core Features and Functionality PHP vs. Python: Core Features and Functionality Apr 13, 2025 am 12:16 AM

PHP and Python each have their own advantages and are suitable for different scenarios. 1.PHP is suitable for web development and provides built-in web servers and rich function libraries. 2. Python is suitable for data science and machine learning, with concise syntax and a powerful standard library. When choosing, it should be decided based on project requirements.

Java Program to Find the Volume of Capsule Java Program to Find the Volume of Capsule Feb 07, 2025 am 11:37 AM

Capsules are three-dimensional geometric figures, composed of a cylinder and a hemisphere at both ends. The volume of the capsule can be calculated by adding the volume of the cylinder and the volume of the hemisphere at both ends. This tutorial will discuss how to calculate the volume of a given capsule in Java using different methods. Capsule volume formula The formula for capsule volume is as follows: Capsule volume = Cylindrical volume Volume Two hemisphere volume in, r: The radius of the hemisphere. h: The height of the cylinder (excluding the hemisphere). Example 1 enter Radius = 5 units Height = 10 units Output Volume = 1570.8 cubic units explain Calculate volume using formula: Volume = π × r2 × h (4

PHP's Impact: Web Development and Beyond PHP's Impact: Web Development and Beyond Apr 18, 2025 am 12:10 AM

PHPhassignificantlyimpactedwebdevelopmentandextendsbeyondit.1)ItpowersmajorplatformslikeWordPressandexcelsindatabaseinteractions.2)PHP'sadaptabilityallowsittoscaleforlargeapplicationsusingframeworkslikeLaravel.3)Beyondweb,PHPisusedincommand-linescrip

PHP: The Foundation of Many Websites PHP: The Foundation of Many Websites Apr 13, 2025 am 12:07 AM

The reasons why PHP is the preferred technology stack for many websites include its ease of use, strong community support, and widespread use. 1) Easy to learn and use, suitable for beginners. 2) Have a huge developer community and rich resources. 3) Widely used in WordPress, Drupal and other platforms. 4) Integrate tightly with web servers to simplify development deployment.

See all articles