golang query html-Golang-php.cn

golang query html

WBOY

Release： 2023-05-19 10:46:07

Original

736 people have browsed it

Preface

The development of programming languages has brought us infinite possibilities. As a modern programming language, Go language has many advantages such as efficiency, simplicity, and cross-platform. It is widely used in server-side programming, cloud computing, containers and other fields. This article will introduce how to use third-party libraries to query HTML documents in Go.

1. Go language and HTML

HTML is a markup language used to build web pages. It can specify the structure and style of elements and be used with other technologies such as CSS and JavaScript to achieve complex interactive effects. Go language is a compiled, statically typed, concurrency-safe programming language known for its efficiency. Although the Go language itself does not directly support HTML parsing, we can accomplish this task by using third-party libraries.

2. HTML parsing in Go language

In Go language, we can use a variety of tools to parse HTML documents, such as golang.org/x/net/html, github.com/PuerkitoBio/goquery, etc. These tools provide a set of methods and structures for parsing, traversing, and modifying HTML documents.

2.1 Use golang.org/x/net/html

golang.org/x/net/html is one provided by Go language A standard library that provides a rich API for parsing HTML documents. Next, we'll demonstrate how to use the library to query node data in an HTML document.

The following is a simple HTML document:

<!DOCTYPE html>
<html>
  <head>
    <title>A Simple HTML Document</title>
  </head>
  <body>
    <h1>This is a heading</h1>
    <p>This is a paragraph.</p>
    <p>This is another paragraph.</p>
  </body>
</html>

Copy after login

We now want to query the text content of all paragraph nodes ( tags) in this document. First, we need to parse the HTML document into a DOM tree structure, and then query the node data by recursively traversing the DOM tree.

package main

import (
    "fmt"
    "golang.org/x/net/html"
    "strings"
)

var htmlString = `
<!DOCTYPE html>
<html>
  <head>
    <title>A Simple HTML Document</title>
  </head>
  <body>
    <h1>This is a heading</h1>
    <p>This is a paragraph.</p>
    <p>This is another paragraph.</p>
  </body>
</html>
`

func main() {
    reader := strings.NewReader(htmlString)
    doc, err := html.Parse(reader)
    if err != nil {
        fmt.Println("Failed to parse HTML string:", err)
        return
    }
    var find func(*html.Node)
    find = func(n *html.Node) {
        if n.Type == html.ElementNode && n.Data == "p" {
            fmt.Println(n.FirstChild.Data)
        } else {
            for c := n.FirstChild; c != nil; c = c.NextSibling {
                find(c)
            }
        }
    }
    find(doc)
}

Copy after login

In the above code, we use strings.NewReader() to convert the string to the io.Reader interface type and pass it to html.Parse() Function to parse HTML documents. Then, we define a recursive function named find() to traverse the DOM tree and find nodes that meet the conditions. When a paragraph node is encountered, we output the text content of that node. Finally, we call the find() function to query and output the text content of all paragraph nodes.

2.2 Use github.com/PuerkitoBio/goquery

github.com/PuerkitoBio/goquery is a very popular Go language library. It provides a simple and convenient way for HTML parsing and querying. We can use goquery to traverse and query HTML documents without having to delve into the structure of the DOM tree.

The following is a sample HTML document:

<!DOCTYPE html>
<html>
  <head>
    <title>A Simple HTML Document</title>
  </head>
  <body>
    <h1>This is a heading</h1>
    <p>This is a paragraph.</p>
    <p>This is another paragraph.</p>
  </body>
</html>

Copy after login

We now want to query the text content of all paragraph nodes in the document, which can be easily achieved using goquery:

package main

import (
    "fmt"
    "github.com/PuerkitoBio/goquery"
    "strings"
)

var htmlString = `
<!DOCTYPE html>
<html>
  <head>
    <title>A Simple HTML Document</title>
  </head>
  <body>
    <h1>This is a heading</h1>
    <p>This is a paragraph.</p>
    <p>This is another paragraph.</p>
  </body>
</html>
`

func main() {
    reader := strings.NewReader(htmlString)
    doc, err := goquery.NewDocumentFromReader(reader)
    if err != nil {
        fmt.Println("Failed to parse HTML string:", err)
        return
    }
    doc.Find("p").Each(func(i int, s *goquery.Selection) {
        fmt.Println(s.Text())
    })
}

Copy after login

In the above code, we use strings.NewReader() to convert the string to the io.Reader interface type and pass it to the goquery.NewDocumentFromReader() function to Parse HTML documents. Then, we use doc.Find("p") to query all paragraph nodes and output their text content through the s.Text() method.

3. Summary

This article introduces how to query the content of HTML documents in Go language. We explored two different approaches, using golang.org/x/net/html and github.com/PuerkitoBio/goquery. These tools are not only able to parse HTML documents, but also provide a rich API for traversing and manipulating the DOM tree. No matter which method you choose, you can easily obtain data from HTML documents, helping you build more elegant and efficient applications.

The above is the detailed content of golang query html. For more information, please follow other related articles on the PHP Chinese website!