Table of Contents
1 Introduction
2 Binary problem
3 Solution
Home Database Mysql Tutorial A brief discussion on the issue of MySQL backup character set

A brief discussion on the issue of MySQL backup character set

Feb 18, 2017 am 11:17 AM

[Introduction] 1 Introduction Choosing the character set when backing up MySQL is a difficult problem, especially for businesses with variable character sets. Mysqldump uses utf8 by default, and utf8 is also officially recommended. But in fact, for Chinese, a considerable number of gbk encoded characters do not have corresponding unicode encoding, which means that this part of the character set

1 Introduction

It is a difficult problem to select the character set when backing up MySQL. Especially businesses with variable character sets. Mysqldump uses utf8 by default, and utf8 is also officially recommended. But in fact, for Chinese, a considerable part of gbk encoded characters do not have corresponding unicode encoding, which means that using utf8 backup for this part of the character set will cause data loss. So is there a solution?

Of course, the most direct way is to add the mapping of this part of the encoding. However, the number of this part of the character set is not a small number, and what is even more annoying is that there seems to be no authoritative mapping standard for this part of the character set. So, is there any other way?

In fact, if you use binary for backup, there will be no character set conversion process, and the above problems will not exist. So, does using binary solve all the problems of gbk? The answer is NO.

2 Binary problem

Before talking about binary problem. There are 2 questions that need to be clarified. For MySQL backup, it is divided into two parts: schema information and actual data. Schema information is always encoded in utf8, except for the default value. This is where the problem comes from.

2.1 utf8 backup

(1) File .frm will store the schema information of the table and store the default value of each field through an actual record. The information corresponding to Schema (including comment) is stored using utf8, but the default value is stored using the character set specified by the table.

(2) When executing the show create table statement, mysqld will convert the default value in frm from the encoding specified by the table to utf8 encoding.

(3) When mysqld executes the create table statement, the default value will be converted from utf8 to the character set specified by the table.

2.2 Binary backup

If binary is specified for backup. When importing, before creating the table, although character_set_client is specified as utf8, collation_connection is still binary. Therefore, the conversion from utf8 to the character set specified by the table will not be performed when storing the default value. If the table is specified as gbk encoding, the import will inevitably fail.

Example:

CREATE TABLE `t1`(
`iNetbarId` int(11) NOT NULL DEFAULT '0',
`iUin` bigint(20) NOT NULL DEFAULT '0',
`vNetbarName` varchar(80) NOT NULL DEFAULT '“-”',
PRIMARY KEY (`iNetbarId`)
) ENGINE=InnoDB DEFAULT CHARSET=gbk;
 
insert into t1 values(1,1,'xxxx');
Copy after login

A brief discussion on the issue of MySQL backup character set

You can see that the table that was exported normally was imported with an error of 1067 Invalid default value.

3 Solution

When mysqldump, before executing the create table statement, increase the setting of character_set_connection.

/*!40101 SET character_set_connection = utf8 */

A brief discussion on the issue of MySQL backup character set

A brief discussion on the issue of MySQL backup character set

##This is also considered a MySQL bug, since the schema information Use utf8 from beginning to end. Before executing create table, you should set the connection character set variable to utf8 instead of just setting the client's character set variable.

The above is a brief discussion on the issue of MySQL backup character set. For more related content, please pay attention to the PHP Chinese website (www.php.cn)!



Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
1 months ago By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Best Graphic Settings
1 months ago By 尊渡假赌尊渡假赌尊渡假赌
Will R.E.P.O. Have Crossplay?
1 months ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

MySQL: Simple Concepts for Easy Learning MySQL: Simple Concepts for Easy Learning Apr 10, 2025 am 09:29 AM

MySQL is an open source relational database management system. 1) Create database and tables: Use the CREATEDATABASE and CREATETABLE commands. 2) Basic operations: INSERT, UPDATE, DELETE and SELECT. 3) Advanced operations: JOIN, subquery and transaction processing. 4) Debugging skills: Check syntax, data type and permissions. 5) Optimization suggestions: Use indexes, avoid SELECT* and use transactions.

How to open phpmyadmin How to open phpmyadmin Apr 10, 2025 pm 10:51 PM

You can open phpMyAdmin through the following steps: 1. Log in to the website control panel; 2. Find and click the phpMyAdmin icon; 3. Enter MySQL credentials; 4. Click "Login".

MySQL: An Introduction to the World's Most Popular Database MySQL: An Introduction to the World's Most Popular Database Apr 12, 2025 am 12:18 AM

MySQL is an open source relational database management system, mainly used to store and retrieve data quickly and reliably. Its working principle includes client requests, query resolution, execution of queries and return results. Examples of usage include creating tables, inserting and querying data, and advanced features such as JOIN operations. Common errors involve SQL syntax, data types, and permissions, and optimization suggestions include the use of indexes, optimized queries, and partitioning of tables.

Why Use MySQL? Benefits and Advantages Why Use MySQL? Benefits and Advantages Apr 12, 2025 am 12:17 AM

MySQL is chosen for its performance, reliability, ease of use, and community support. 1.MySQL provides efficient data storage and retrieval functions, supporting multiple data types and advanced query operations. 2. Adopt client-server architecture and multiple storage engines to support transaction and query optimization. 3. Easy to use, supports a variety of operating systems and programming languages. 4. Have strong community support and provide rich resources and solutions.

How to use single threaded redis How to use single threaded redis Apr 10, 2025 pm 07:12 PM

Redis uses a single threaded architecture to provide high performance, simplicity, and consistency. It utilizes I/O multiplexing, event loops, non-blocking I/O, and shared memory to improve concurrency, but with limitations of concurrency limitations, single point of failure, and unsuitable for write-intensive workloads.

MySQL and SQL: Essential Skills for Developers MySQL and SQL: Essential Skills for Developers Apr 10, 2025 am 09:30 AM

MySQL and SQL are essential skills for developers. 1.MySQL is an open source relational database management system, and SQL is the standard language used to manage and operate databases. 2.MySQL supports multiple storage engines through efficient data storage and retrieval functions, and SQL completes complex data operations through simple statements. 3. Examples of usage include basic queries and advanced queries, such as filtering and sorting by condition. 4. Common errors include syntax errors and performance issues, which can be optimized by checking SQL statements and using EXPLAIN commands. 5. Performance optimization techniques include using indexes, avoiding full table scanning, optimizing JOIN operations and improving code readability.

MySQL's Place: Databases and Programming MySQL's Place: Databases and Programming Apr 13, 2025 am 12:18 AM

MySQL's position in databases and programming is very important. It is an open source relational database management system that is widely used in various application scenarios. 1) MySQL provides efficient data storage, organization and retrieval functions, supporting Web, mobile and enterprise-level systems. 2) It uses a client-server architecture, supports multiple storage engines and index optimization. 3) Basic usages include creating tables and inserting data, and advanced usages involve multi-table JOINs and complex queries. 4) Frequently asked questions such as SQL syntax errors and performance issues can be debugged through the EXPLAIN command and slow query log. 5) Performance optimization methods include rational use of indexes, optimized query and use of caches. Best practices include using transactions and PreparedStatemen

How to recover data after SQL deletes rows How to recover data after SQL deletes rows Apr 09, 2025 pm 12:21 PM

Recovering deleted rows directly from the database is usually impossible unless there is a backup or transaction rollback mechanism. Key point: Transaction rollback: Execute ROLLBACK before the transaction is committed to recover data. Backup: Regular backup of the database can be used to quickly restore data. Database snapshot: You can create a read-only copy of the database and restore the data after the data is deleted accidentally. Use DELETE statement with caution: Check the conditions carefully to avoid accidentally deleting data. Use the WHERE clause: explicitly specify the data to be deleted. Use the test environment: Test before performing a DELETE operation.

See all articles