简体中文(ZH-CN) English(EN) 繁体中文(ZH-TW) 日本語(JA) 한국어(KO) Melayu(MS) Français(FR) Deutsch(DE)
Home > Java > javaTutorial > body text

Java Example - Web Scraping

黄舟
Release： 2017-01-20 11:58:43
Original
1318 people have browsed it

The following example demonstrates how to use the URL() constructor of the net.URL class to crawl a web page: 

/*
 author by w3cschool.cc
 Main.java
 */import java.io.BufferedReader;import java.io.BufferedWriter;import java.io.FileWriter;import java.io.InputStreamReader;import java.net.URL;public class Main {
   public static void main(String[] args) 
   throws Exception {
      URL url = new URL("http://www.w3cschool.cc");
      BufferedReader reader = new BufferedReader
      (new InputStreamReader(url.openStream()));
      BufferedWriter writer = new BufferedWriter
      (new FileWriter("data.html"));
      String line;
      while ((line = reader.readLine()) != null) {
         System.out.println(line);
         writer.write(line);
         writer.newLine();
      }
      reader.close();
      writer.close();
   }}
Copy after login

The output result of running the above code is (the source code of the web page, stored in the current directory data.html file under): 

<!DOCTYPE html> <html> <head> <meta charset="UTF-8"/> 
<meta http-equiv="X-UA-Compatible" content="IE=11,IE=10,IE=9,IE=8"/>……
Copy after login

The above is the Java example-web page crawling content. For more related content, please pay attention to the PHP Chinese website (www.php.cn)!


Related labels：
Java ，网页抓取
source：php.cn
Previous article：Java Example - Connect to the specified host using Socket Next article：A small example of generating and parsing QR code images using ZXing in Java
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Latest Articles by Author
Latest Issues
How to use multiple filters with the Google Analytics Data API (GA4) using PHP So that's my first question, I'll try to follow the community rules. I'm trying to use mul...
From 2023-11-04 14:39:38
0
1
188
How to run python script from HTML in google chrome? I'm building a chrome extension and I want to run a python script from my PC by clicking a...
From 2023-11-02 23:34:24
0
1
400
BeautifulSoup ingests all data, but .findAll() only returns links to one parent I'm trying to scrape a website using BeautifulSoup in Python. All data is ingested, includ...
From 2023-09-14 12:14:43
0
1
169
Network error: net::ERR_BLOCKED_BY_CLIENT and 403 error mongodb I have code for a React website that I pulled from git on Windows to my Mac. All my code w...
From 2023-09-13 21:32:40
0
1
220
The rephrased title is: Extract the original file of the image I'm trying to get the src of a specific image on a web page. When I enter my code, the out...
From 2023-09-13 19:36:22
0
1
271
Related Topics
More>
Popular Recommendations
Popular Tutorials
More>
Related Tutorials
Popular Recommendations
Latest courses
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template
About us Disclaimer Sitemap
php.cn：Public welfare online PHP training，Help PHP learners grow quickly！