Table of Contents
1 Introduction
2 Binary problem
3 Solution
Home Database Mysql Tutorial A brief discussion on the issue of MySQL backup character set

A brief discussion on the issue of MySQL backup character set

Feb 18, 2017 am 11:17 AM

[Introduction] 1 Introduction Choosing the character set when backing up MySQL is a difficult problem, especially for businesses with variable character sets. Mysqldump uses utf8 by default, and utf8 is also officially recommended. But in fact, for Chinese, a considerable number of gbk encoded characters do not have corresponding unicode encoding, which means that this part of the character set

1 Introduction

It is a difficult problem to select the character set when backing up MySQL. Especially businesses with variable character sets. Mysqldump uses utf8 by default, and utf8 is also officially recommended. But in fact, for Chinese, a considerable part of gbk encoded characters do not have corresponding unicode encoding, which means that using utf8 backup for this part of the character set will cause data loss. So is there a solution?

Of course, the most direct way is to add the mapping of this part of the encoding. However, the number of this part of the character set is not a small number, and what is even more annoying is that there seems to be no authoritative mapping standard for this part of the character set. So, is there any other way?

In fact, if you use binary for backup, there will be no character set conversion process, and the above problems will not exist. So, does using binary solve all the problems of gbk? The answer is NO.

2 Binary problem

Before talking about binary problem. There are 2 questions that need to be clarified. For MySQL backup, it is divided into two parts: schema information and actual data. Schema information is always encoded in utf8, except for the default value. This is where the problem comes from.

2.1 utf8 backup

(1) File .frm will store the schema information of the table and store the default value of each field through an actual record. The information corresponding to Schema (including comment) is stored using utf8, but the default value is stored using the character set specified by the table.

(2) When executing the show create table statement, mysqld will convert the default value in frm from the encoding specified by the table to utf8 encoding.

(3) When mysqld executes the create table statement, the default value will be converted from utf8 to the character set specified by the table.

2.2 Binary backup

If binary is specified for backup. When importing, before creating the table, although character_set_client is specified as utf8, collation_connection is still binary. Therefore, the conversion from utf8 to the character set specified by the table will not be performed when storing the default value. If the table is specified as gbk encoding, the import will inevitably fail.

Example:

CREATE TABLE `t1`(
`iNetbarId` int(11) NOT NULL DEFAULT '0',
`iUin` bigint(20) NOT NULL DEFAULT '0',
`vNetbarName` varchar(80) NOT NULL DEFAULT '“-”',
PRIMARY KEY (`iNetbarId`)
) ENGINE=InnoDB DEFAULT CHARSET=gbk;
 
insert into t1 values(1,1,'xxxx');
Copy after login

A brief discussion on the issue of MySQL backup character set

You can see that the table that was exported normally was imported with an error of 1067 Invalid default value.

3 Solution

When mysqldump, before executing the create table statement, increase the setting of character_set_connection.

/*!40101 SET character_set_connection = utf8 */

A brief discussion on the issue of MySQL backup character set

A brief discussion on the issue of MySQL backup character set

##This is also considered a MySQL bug, since the schema information Use utf8 from beginning to end. Before executing create table, you should set the connection character set variable to utf8 instead of just setting the client's character set variable.

The above is a brief discussion on the issue of MySQL backup character set. For more related content, please pay attention to the PHP Chinese website (www.php.cn)!



Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Repo: How To Revive Teammates
1 months ago By 尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
4 weeks ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

PHP's big data structure processing skills PHP's big data structure processing skills May 08, 2024 am 10:24 AM

Big data structure processing skills: Chunking: Break down the data set and process it in chunks to reduce memory consumption. Generator: Generate data items one by one without loading the entire data set, suitable for unlimited data sets. Streaming: Read files or query results line by line, suitable for large files or remote data. External storage: For very large data sets, store the data in a database or NoSQL.

How to optimize MySQL query performance in PHP? How to optimize MySQL query performance in PHP? Jun 03, 2024 pm 08:11 PM

MySQL query performance can be optimized by building indexes that reduce lookup time from linear complexity to logarithmic complexity. Use PreparedStatements to prevent SQL injection and improve query performance. Limit query results and reduce the amount of data processed by the server. Optimize join queries, including using appropriate join types, creating indexes, and considering using subqueries. Analyze queries to identify bottlenecks; use caching to reduce database load; optimize PHP code to minimize overhead.

How to use MySQL backup and restore in PHP? How to use MySQL backup and restore in PHP? Jun 03, 2024 pm 12:19 PM

Backing up and restoring a MySQL database in PHP can be achieved by following these steps: Back up the database: Use the mysqldump command to dump the database into a SQL file. Restore database: Use the mysql command to restore the database from SQL files.

How to insert data into a MySQL table using PHP? How to insert data into a MySQL table using PHP? Jun 02, 2024 pm 02:26 PM

How to insert data into MySQL table? Connect to the database: Use mysqli to establish a connection to the database. Prepare the SQL query: Write an INSERT statement to specify the columns and values ​​to be inserted. Execute query: Use the query() method to execute the insertion query. If successful, a confirmation message will be output.

How to fix mysql_native_password not loaded errors on MySQL 8.4 How to fix mysql_native_password not loaded errors on MySQL 8.4 Dec 09, 2024 am 11:42 AM

One of the major changes introduced in MySQL 8.4 (the latest LTS release as of 2024) is that the "MySQL Native Password" plugin is no longer enabled by default. Further, MySQL 9.0 removes this plugin completely. This change affects PHP and other app

How to use MySQL stored procedures in PHP? How to use MySQL stored procedures in PHP? Jun 02, 2024 pm 02:13 PM

To use MySQL stored procedures in PHP: Use PDO or the MySQLi extension to connect to a MySQL database. Prepare the statement to call the stored procedure. Execute the stored procedure. Process the result set (if the stored procedure returns results). Close the database connection.

How to create a MySQL table using PHP? How to create a MySQL table using PHP? Jun 04, 2024 pm 01:57 PM

Creating a MySQL table using PHP requires the following steps: Connect to the database. Create the database if it does not exist. Select a database. Create table. Execute the query. Close the connection.

The difference between oracle database and mysql The difference between oracle database and mysql May 10, 2024 am 01:54 AM

Oracle database and MySQL are both databases based on the relational model, but Oracle is superior in terms of compatibility, scalability, data types and security; while MySQL focuses on speed and flexibility and is more suitable for small to medium-sized data sets. . ① Oracle provides a wide range of data types, ② provides advanced security features, ③ is suitable for enterprise-level applications; ① MySQL supports NoSQL data types, ② has fewer security measures, and ③ is suitable for small to medium-sized applications.

See all articles