Home > Database > Mysql Tutorial > How to Correct Unicode Double-Encoding in UTF-8 Tables?

How to Correct Unicode Double-Encoding in UTF-8 Tables?

Barbara Streisand
Release: 2024-11-01 14:28:03
Original
587 people have browsed it

How to Correct Unicode Double-Encoding in UTF-8 Tables?

Unicode Double-Encoding Correction in UTF-8 Tables

Encountering anomalies like "ñ" instead of "ñ" signifies a potential double-encoding issue with UTF-8 characters. This occurs when a CSV file is erroneously loaded under the assumption that it's Latin1-encoded, resulting in multibyte characters being misidentified as single characters and subsequently encoded in UTF-8 again.

Solution

To rectify this double-encoding, a MySQL function is available:

<code class="sql">CONVERT(CAST(CONVERT(field USING latin1) AS BINARY) USING utf8)</code>
Copy after login

This function takes characters encoded in Latin1, casts them as binary, and then converts them back to UTF-8, effectively removing the double-encoding.

Correction via UPDATE Statement

To correct the affected fields, you can use the function in an UPDATE statement:

<code class="sql">UPDATE tablename SET
    field = CONVERT(CAST(CONVERT(field USING latin1) AS BINARY) USING utf8);</code>
Copy after login

By executing this statement, the problematic characters will be restored to their correct UTF-8 representation.

The above is the detailed content of How to Correct Unicode Double-Encoding in UTF-8 Tables?. For more information, please follow other related articles on the PHP Chinese website!

source:php.cn
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Latest Articles by Author
Popular Tutorials
More>
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template