中小型企业可参考的类MySQL双主架构方案_MySQL
企業
方案
架構
在企业中,一般系统架构的瓶颈会出现在数据库这一部分,mysql主从架构在很大程度上解决了这部分瓶颈,但是在mysql主从同步的架构也存在很多问题；比如:1. 关于数据写入部分(也就是主库)往往很难做到扩展,虽然很多大公司在逻辑业务方面就进行对数据的拆分,比如商品库存按照区域去拆分(一个区域走一个库存也就是一个主库,然后定时同步总的库存),按照商品类型去划分(一个类型的商品走一套数据库),但是这对于很多中小型公司来说实现起来还是比较困难的； 2. 主从同步一般都是一个主库,一旦主库出现问题,就有可能直接导致整个主从同步架构崩盘,虽然发现后也是可以慢慢恢复的,但是这个恢复时间对于很多公司来说是难以接受的,今天的这篇博文就是主要给解决主库单点故障这个问题提供一个思路:
主要思路是:
1.一台主库(我们称之为master-01)提供服务,只负责数据的写入；
2.拿出一台数据库服务器(我们称之为Master-02)资源做master-01主库的从库(之间做主从同步)；
3.两台主库之间做高可用,可以采用keepalived等方案(一定要保证master-01同时也要作为keepalived的主)
4.程序在调用主库IP地址的地方写为高可用的VIP地址；
5.所有提供服务的从服务器与master-02进行主从同步；
6.建议采用高可用策略的时候,当master-01出现问题切换到master-02的时候,即使master-01恢复了,也不要让它去自动承接VIP地址,否则可能造成数据的混写；
这样做可以在一定程度上保证主库的高可用,在一台主库down掉之后,可以在极短的时间内切换到另一台主库上(尽可能减少主库宕机对业务造成的影响),减少了主从同步给线上主库带来的压力；但是也有几个不足的地方:比如master-02可能会一直处于空闲状态(其实完全可以让它承担一部分从库的角色来负责一部分查询请求的),2. 这样真正提供服务的从库要等master-02先同步完了数据后才能去master-02上去同步数据,这样可能会造成一定程度的同步延迟时间的加长；3. 如果master-01一旦恢复正常,会不会导致数据写入混乱(这个可以在keepalived中设置响应的规则,让其不”夺权”,我们认为的去调整操作即可
架构的简易图如下:
具体实施方案:
1. 在所有需要提供服务的服务器上安装MySQL服务(建议源码安装)
1.1 yum安装依赖包
<ol class="dp-sql"><li class="alt"><span><span>yum -y install cmake make gcc gcc-c++ ncurses-devel bison openssl-devel </span></span></li></ol>
登入後複製
1.2 添加MySQL所需要的用户/组
<ol class="dp-sql"> <li class="alt"><span><span>groupadd mysql </span></span></li> <li><span>useradd -g mysql -r mysql </span></li> </ol>
登入後複製
1.3 下载MySQL源码包
<ol class="dp-sql"><li class="alt"><span><span>wget http://dev.mysql.com/get/Downloads/MySQL-5.5/mysql-5.5.36.tar.gz </span></span></li></ol>
登入後複製
1.4 创建MySQL安装所需要的目录
<ol class="dp-sql"><li class="alt">
<span>mkdir /data/mydata/{data</span>,<span>tmp</span>,<span>logs} –pv </span>
</li></ol>登入後複製
1.5 解压编译安装MySQL
<ol class="dp-sql"> <li class="alt"><span><span>tar xf mysql-5.5.36.tar.gz </span></span></li> <li><span>cd mysql-5.5.36 </span></li> <li class="alt"> <span>cmake . -DCMAKE_INSTALL_PREFIX=/usr/</span><span class="keyword">local</span><span>/mysql \ </span> </li> <li><span> -DMYSQL_DATADIR=/data/mydata/data \ </span></li> <li class="alt"><span> -DSYSCINFDIR=/etc \ </span></li> <li><span> -DWITH_INNOBASE_STORAGE_ENGINE=1 \ </span></li> <li class="alt"><span> -DWITH_ARCHIVE_STORAGE_ENGINE=1 \ </span></li> <li><span> -DWITH_BLACKHOLE_STORAGE_ENGINE=1 \ </span></li> <li class="alt"><span> -DWITH_READLINE=1 \ </span></li> <li><span> -DWITH_SSL=system \ </span></li> <li class="alt"><span> -DWITH_ZLIB=system \ </span></li> <li><span> -DWITH_LIBWARP=0 \ </span></li> <li class="alt"><span> -DWITH_UNIX_ADDR=/tmp/mysql.sock \ </span></li> <li><span> -DDEFAULT_CHARASET=uft8 \ </span></li> <li class="alt"><span> -DDEFAULT_COLLATTON=utf9_general_ci \ </span></li> <li><span>make && make install </span></li> </ol>
登入後複製
1.6 为MySQL提供启动脚本
<ol class="dp-sql"><li class="alt"><span><span>cp support-files/mysql.server /etc/rc.d/init.d/mysqld </span></span></li></ol>
登入後複製
1.7 为master-01主库提供配置文件(32G内存较为保守(满连接占用25G左右内存)的配置文件）
<ol class="dp-c"> <li class="alt"><span><span>[client] </span></span></li> <li><span>port = 3306 </span></li> <li class="alt"> <span>socket = /</span><span class="keyword">var</span><span>/lib/mysql/mysql.sock </span> </li> <li> <span class="keyword">default</span><span>-character-set = utf-8 </span> </li> <li class="alt"><span>[mysqld] </span></li> <li><span>server-id = 1 </span></li> <li class="alt"><span>port = 3306 </span></li> <li><span>user = mysql </span></li> <li class="alt"><span>basedir = /usr/local/mysql </span></li> <li><span>datadir = /data/mydata/data </span></li> <li class="alt"><span>tmpdir = /data/mydata/tmp </span></li> <li> <span>socket = /</span><span class="keyword">var</span><span>/lib/mysql/mysql.sock </span> </li> <li class="alt"><span>skip-external-locking </span></li> <li><span>skip-name-resolve </span></li> <li class="alt"> <span class="keyword">default</span><span>-storage-engine = INNODB </span> </li> <li><span>character-set-server = utf8 </span></li> <li class="alt"><span>wait-timeout = 100 </span></li> <li><span>connect_timeout = 20 </span></li> <li class="alt"><span>interactive_timeout = 100 </span></li> <li><span>back_log = 300 </span></li> <li class="alt"><span>myisam_recover </span></li> <li><span>event_scheduler = on </span></li> <li class="alt"><span>log-bin=/data/mydata/logs/mysql-bin </span></li> <li><span>binlog_format = row </span></li> <li class="alt"><span>max_binlog_size = 64M </span></li> <li><span>binlog_cache_size = 1M </span></li> <li class="alt"><span>slave-net-timeout = 10 </span></li> <li><span>skip-slave-start </span></li> <li class="alt"><span>slow_query_log = 1 </span></li> <li><span>long_query_time = 1 </span></li> <li class="alt"><span>slow_query_log_file = /data/mydata/mysqllog/logs/mysql.slow </span></li> <li><span>log-error = /data/mydata/mysqllog/logs/error.log </span></li> <li class="alt"><span>max_connections = 1000 </span></li> <li><span>max_user_connections = 1000 </span></li> <li class="alt"><span>max_connect_errors = 10000 </span></li> <li> <span>key_buffer_size = 32M #以MyISAM为主的服务器</span>,<span>要调大此值 </span> </li> <li class="alt"><span>max_allowed_packet = 64M </span></li> <li><span>table_cache = 4096 </span></li> <li class="alt"><span>table_open_cache = 4096 </span></li> <li><span>table_definition_cache = 4096 </span></li> <li class="alt"><span>sort_buffer_size = 512K </span></li> <li><span>read_buffer_size = 512K </span></li> <li class="alt"><span>read_rnd_buffer_size = 512K </span></li> <li><span>join_buffer_size = 512K </span></li> <li class="alt"><span>tmp_table_size = 64M </span></li> <li><span>max_heap_table_size = 64M </span></li> <li class="alt"><span>query_cache_type = 0 </span></li> <li><span>query_cache_size = 0 </span></li> <li class="alt"><span>bulk_insert_buffer_size = 16M </span></li> <li><span>thread_cache_size = 64 </span></li> <li class="alt"><span>thread_concurrency = 16 #CPU核数*2 </span></li> <li><span>thread_stack = 256K </span></li> <li class="alt"><span>innodb_data_home_dir = /data/mydata/data </span></li> <li><span>innodb_log_group_home_dir = /data/mydata/mysqllog/logs </span></li> <li class="alt"><span>innodb_data_file_path = ibdata1:1G:autoextend </span></li> <li><span>innodb_buffer_pool_size = 16G </span></li> <li class="alt"><span>innodb_buffer_pool_instances = 4 </span></li> <li><span>innodb_additional_mem_pool_size = 16M </span></li> <li class="alt"><span>innodb_log_file_size = 512M </span></li> <li><span>innodb_log_buffer_size = 32M </span></li> <li class="alt"><span>innodb_log_files_in_group = 3 </span></li> <li><span>innodb_flush_log_at_trx_commit = 2 </span></li> <li class="alt"><span>innodb_lock_wait_timeout = 10 </span></li> <li><span>innodb_sync_spin_loops = 40 </span></li> <li class="alt"><span>innodb_max_dirty_pages_pct = 90 </span></li> <li><span>innodb_support_xa = 1 </span></li> <li class="alt"><span>innodb_thread_concurrency = 0 </span></li> <li><span>innodb_thread_sleep_delay = 500 </span></li> <li class="alt"><span>innodb_file_io_threads = 4 </span></li> <li><span>innodb_concurrency_tickets = 1000 </span></li> <li class="alt"><span>log_bin_trust_function_creators = 1 </span></li> <li><span>innodb_flush_method = O_DIRECT </span></li> <li class="alt"><span>innodb_file_per_table #是否采用单表单空间 </span></li> <li><span>innodb_write_io_threads = 8 </span></li> <li class="alt"><span>innodb_read_io_threads = 8 </span></li> <li><span>innodb_io_capacity = 1000 </span></li> <li class="alt"> <span>innodb_file_format = Barracuda #不开启单表单空间</span>,<span>此选项无效 </span> </li> <li><span>innodb_purge_threads = 1 </span></li> <li class="alt"><span>innodb_purge_batch_size = 32 </span></li> <li><span>innodb_old_blocks_pct = 75 </span></li> <li class="alt"><span>innodb_change_buffering = all </span></li> <li><span>transaction_isolation = READ-COMMITTED </span></li> <li class="alt"><span>[mysqldump] </span></li> <li><span>quick </span></li> <li class="alt"><span>max_allowed_packet = 32M </span></li> <li><span>[mysql] </span></li> <li class="alt"><span>no-auto-rehash </span></li> <li><span>[myisamchk] </span></li> <li class="alt"><span>key_buffer_size = 64M </span></li> <li><span>sort_buffer_size = 256M </span></li> <li class="alt"><span>read_buffer = 2M </span></li> <li><span>write_buffer = 2M </span></li> <li class="alt"><span>[mysqlhotcopy] </span></li> <li><span>interactive-timeout </span></li> <li class="alt"><span>[mysqld_safe] </span></li> <li><span>open-files-limit = 10240 </span></li> </ol>
登入後複製
1.8 为master-02提供配置文件
<ol class="dp-sql"> <li class="alt"><span><span>master-02的配置文件仅需在master-01上稍作修改 </span></span></li> <li><span>server-id = 20 </span></li> <li class="alt"> <span>log_slave_updates = 1 #添加(将复制事件写入binlog</span>,<span>一台服务器既做主库又做从库此选项必须要开启) </span> </li> <li><span>replicate-same-server-id=0 #添加(防止MySQL循环更新) </span></li> <li class="alt"><span>relay_log_recovery = 1 #添加(MySQLrelay_log的自动修复功能) </span></li> </ol>
登入後複製
1.9 为从库提供配置文件(8G)
<ol class="dp-sql"> <li class="alt"><span><span>[client] </span></span></li> <li><span>port = 3306 </span></li> <li class="alt"><span>socket = /var/lib/mysql/mysql.sock </span></li> <li> <span class="keyword">default</span><span>-</span><span class="keyword">character</span><span>-</span><span class="keyword">set</span><span> = utf8 </span> </li> <li class="alt"><span>[mysqld] </span></li> <li><span>server-id = 2 </span></li> <li class="alt"><span>port = 3306 </span></li> <li> <span class="func">user</span><span> = mysql </span> </li> <li class="alt"> <span>basedir = /usr/</span><span class="keyword">local</span><span>/mysql </span> </li> <li><span>datadir = /data/mydata/data </span></li> <li class="alt"><span>tmpdir = /data/mydata/tmp </span></li> <li><span>socket = /var/lib/mysql/mysql.sock </span></li> <li class="alt"><span>skip-external-locking </span></li> <li> <span>skip-</span><span class="keyword">name</span><span>-resolve </span> </li> <li class="alt"> <span class="keyword">default</span><span>-storage-engine = INNODB </span> </li> <li> <span class="keyword">character</span><span>-</span><span class="keyword">set</span><span>-server = utf8 </span> </li> <li class="alt"><span>wait-timeout = 100 </span></li> <li><span>connect_timeout = 20 </span></li> <li class="alt"><span>interactive_timeout = 100 </span></li> <li><span>back_log = 300 </span></li> <li class="alt"><span>myisam_recover </span></li> <li> <span>event_scheduler = </span><span class="keyword">on</span><span> </span> </li> <li class="alt"><span>log-bin=/data/mydata/logs/mysql-bin </span></li> <li><span>binlog_format = row </span></li> <li class="alt"><span>max_binlog_size = 64M </span></li> <li><span>binlog_cache_size = 1M </span></li> <li class="alt"><span>slave-net-timeout = 10 </span></li> <li><span>relay_log_recovery = 1 </span></li> <li class="alt"><span>slow_query_log = 1 </span></li> <li><span>long_query_time = 1 </span></li> <li class="alt"><span>slow_query_log_file = /data/mydata/mysqllog/logs/mysql.slow </span></li> <li><span>log-error = /data/mydata/mysqllog/logs/error.log </span></li> <li class="alt"><span>max_connections = 500 </span></li> <li><span>max_user_connections = 500 </span></li> <li class="alt"><span>max_connect_errors = 10000 </span></li> <li> <span>key_buffer_size = 32M #以MyISAM为主的服务器</span>,<span>要调大此值 </span> </li> <li class="alt"><span>max_allowed_packet = 64M </span></li> <li><span>table_cache = 2048 </span></li> <li class="alt"><span>table_open_cache = 2048 </span></li> <li><span>table_definition_cache = 2048 </span></li> <li class="alt"><span>sort_buffer_size = 128K </span></li> <li><span>read_buffer_size = 128K </span></li> <li class="alt"><span>read_rnd_buffer_size = 128K </span></li> <li><span>join_buffer_size = 128K </span></li> <li class="alt"><span>tmp_table_size = 16M </span></li> <li><span>max_heap_table_size = 16M </span></li> <li class="alt"><span>query_cache_type = 0 </span></li> <li><span>query_cache_size = 0 </span></li> <li class="alt"><span>bulk_insert_buffer_size = 16M </span></li> <li><span>thread_cache_size = 64 </span></li> <li class="alt"><span>thread_concurrency = 4 #CPU核数*2 </span></li> <li><span>thread_stack = 128K </span></li> <li class="alt"><span>innodb_data_home_dir = /data/mydata/data </span></li> <li><span>innodb_log_group_home_dir = /data/mydata/mysqllog/logs </span></li> <li class="alt"><span>innodb_data_file_path = ibdata1:1G:autoextend </span></li> <li><span>innodb_buffer_pool_size = 2G </span></li> <li class="alt"><span>innodb_buffer_pool_instances = 4 </span></li> <li><span>innodb_additional_mem_pool_size = 4M </span></li> <li class="alt"><span>innodb_log_file_size = 512M </span></li> <li><span>innodb_log_buffer_size = 16M </span></li> <li class="alt"><span>innodb_log_files_in_group = 3 </span></li> <li><span>innodb_flush_log_at_trx_commit = 2 </span></li> <li class="alt"><span>innodb_lock_wait_timeout = 10 </span></li> <li><span>innodb_sync_spin_loops = 40 </span></li> <li class="alt"><span>innodb_max_dirty_pages_pct = 90 </span></li> <li><span>innodb_support_xa = 1 </span></li> <li class="alt"><span>innodb_thread_concurrency = 0 </span></li> <li><span>innodb_thread_sleep_delay = 500 </span></li> <li class="alt"><span>innodb_file_io_threads = 4 </span></li> <li><span>innodb_concurrency_tickets = 1000 </span></li> <li class="alt"><span>log_bin_trust_function_creators = 1 </span></li> <li><span>innodb_flush_method = O_DIRECT </span></li> <li class="alt"><span>innodb_file_per_table #是否采用单表单空间 </span></li> <li><span>innodb_write_io_threads = 8 </span></li> <li class="alt"><span>innodb_read_io_threads = 8 </span></li> <li><span>innodb_io_capacity = 1000 </span></li> <li class="alt"> <span>innodb_file_format = Barracuda #不开启单表单空间</span>,<span>此选项无效 </span> </li> <li><span>innodb_purge_threads = 1 </span></li> <li class="alt"><span>innodb_purge_batch_size = 32 </span></li> <li><span>innodb_old_blocks_pct = 75 </span></li> <li class="alt"> <span>innodb_change_buffering = </span><span class="op">all</span><span> </span> </li> <li> <span>transaction_isolation = </span><span class="keyword">READ</span><span>-</span><span class="keyword">COMMITTED</span><span> </span> </li> <li class="alt"><span>[mysqldump] </span></li> <li><span>quick </span></li> <li class="alt"><span>max_allowed_packet = 32M </span></li> <li><span>[mysql] </span></li> <li class="alt"> <span class="keyword">no</span><span>-auto-rehash </span> </li> <li><span>[myisamchk] </span></li> <li class="alt"><span>key_buffer_size = 64M </span></li> <li><span>sort_buffer_size = 256M </span></li> <li class="alt"><span>read_buffer = 2M </span></li> <li><span>write_buffer = 2M </span></li> <li class="alt"><span>[mysqlhotcopy] </span></li> <li><span>interactive-timeout </span></li> <li class="alt"><span>[mysqld_safe] </span></li> <li> <span class="keyword">open</span><span>-files-limit = 10240 </span> </li> </ol>
登入後複製
1.10 初始化MySQL
<ol class="dp-xml"><li class="alt"><span><span>/usr/local/mysql/scripts/mysql_install_db </span><span class="attribute">--user</span><span>=</span><span class="attribute-value">mysql</span><span> </span><span class="attribute">--datadir</span><span>=/data/mydata/data/ </span><span class="attribute">--basedir</span><span>=/usr/local/mysql </span></span></li></ol>
登入後複製
1.11 为启动脚本赋予可执行权限并启动MySQL
<ol class="dp-xml"> <li class="alt"><span><span>chmod +x /etc/rc.d/init.d/mysqld </span></span></li> <li><span>/etc/init.d/mysqld start </span></li> </ol>
登入後複製
2. 配置master-01
2.1 添加主从同步账户
<ol class="dp-xml"> <li class="alt">mysql> grant replication slave on *.* to 'repl'@'192.168.237.%' idetified by '123456'； </li> <li> <span>mysql</span><span class="tag">></span><span> flush privileges</span>；<span> </span> </li> </ol>
登入後複製
2.2 查看主库的状态
<ol class="dp-xml"> <li class="alt">mysql> show master status； </li> <li><span>+------------------+----------+--------------+------------------+ </span></li> <li class="alt"><span>| File | Position | Binlog_Do_DB | Binlog_Ignore_DB | </span></li> <li><span>+------------------+----------+--------------+------------------+ </span></li> <li class="alt"><span>| mysql-bin.000009 | 652 | | | </span></li> <li><span>+------------------+----------+--------------+------------------+ </span></li> <li class="alt"><span>1 row in set (0.01 sec) </span></li> </ol>
登入後複製
2.3 因为这是测试环境,可以保证没数据写入,否则需要先锁表-->查看状态-->备份数据-->查看状态(保证没变)-->解锁表
3. 配置master-02
3.1 配置master-02为master-01的从
<ol class="dp-xml"> <li class="alt"><span><span>#若是线上有数据需要先导入数据 </span></span></li> <li> <span>mysql</span><span class="tag">></span><span> CHANGE MASTER TO </span> </li> <li class="alt"> <span> -</span><span class="tag">></span><span> </span><span class="attribute">MASTER_HOST</span><span>=</span><span class="attribute-value">'192.168.237.128'</span>,<span> </span> </li> <li> <span> -</span><span class="tag">></span><span> </span><span class="attribute">MASTER_PORT</span><span>=</span><span class="attribute-value">3306</span>,<span> </span> </li> <li class="alt"> <span> -</span><span class="tag">></span><span> </span><span class="attribute">MASTER_USER</span><span>=</span><span class="attribute-value">'repl'</span>,<span> </span> </li> <li> <span> -</span><span class="tag">></span><span> </span><span class="attribute">MASTER_PASSWORD</span><span>=</span><span class="attribute-value">'123456'</span>,<span> </span> </li> <li class="alt"> <span> -</span><span class="tag">></span><span> </span><span class="attribute">MASTER_LOG_FILE</span><span>=</span><span class="attribute-value">'mysql-bin.000009'</span>,<span> </span> </li> <li> <span> -</span><span class="tag">></span><span> </span><span class="attribute">MASTER_LOG_POS</span><span>=</span><span class="attribute-value">652</span>；<span> </span> </li> <li class="alt"> <span>Query OK</span>,<span> 0 rows affected (0.03 sec) </span> </li> <li> <span>mysql</span><span class="tag">></span><span> start slave</span>；<span> </span> </li> <li class="alt"> <span>mysql</span><span class="tag">></span><span> show slave status \G </span> </li> <li><span> Slave_IO_Running: Yes #确保为yes </span></li> <li class="alt"><span> Slave_SQL_Running: Yes #确保为yes </span></li> </ol>
登入後複製
3.2 配置master-02的同步用户
<ol class="dp-xml"> <li class="alt">mysql> grant replication slave on *.* to 'repl’@’192.168.237.%' identified by '123456'； </li> <li> <span>mysql</span><span class="tag">></span><span> flush privileges</span>；<span> </span> </li> </ol>
登入後複製
3.3 查看master-02的状态
<ol class="dp-xml"> <li class="alt">mysql> show master status； </li> <li><span>+------------------+----------+--------------+------------------+ </span></li> <li class="alt"><span>| File | Position | Binlog_Do_DB | Binlog_Ignore_DB | </span></li> <li><span>+------------------+----------+--------------+------------------+ </span></li> <li class="alt"><span>| mysql-bin.000004 | 689 | | | </span></li> <li><span>+------------------+----------+--------------+------------------+ </span></li> <li class="alt"><span>1 row in set (0.00 sec) </span></li> </ol>
登入後複製
4. 从库根据上面步骤配置为master-02的从即可(为了节省篇幅不再一一赘述)
5. 在master-01上创建一个数据库测试同步效果
6. 去master-02跟从库上分别查看是否已经同步过数据来
好了,至此数据同步已经完成,关于keepalived实现双主高可用,我会在下篇keepalived实现MySQL高可用总给大家写出!!!
本網站聲明
本文內容由網友自願投稿，版權歸原作者所有。本站不承擔相應的法律責任。如發現涉嫌抄襲或侵權的內容，請聯絡admin@php.cn
熱AI工具
Undresser.AI Undress
人工智慧驅動的應用程序，用於創建逼真的裸體照片
AI Clothes Remover
用於從照片中去除衣服的線上人工智慧工具。
Undress AI Tool
免費脫衣圖片
Clothoff.io
AI脫衣器
Video Face Swap
使用我們完全免費的人工智慧換臉工具，輕鬆在任何影片中換臉！
熱門文章
Windows 11 KB5054979中的新功能以及如何解決更新問題
3 週前
By DDD
如何修復KB5055523無法在Windows 11中安裝？
2 週前
By DDD
Inzoi：如何申請學校和大學
3 週前
By DDD
如何修復KB5055518無法在Windows 10中安裝？
2 週前
By DDD
Roblox：Dead Rails - 如何召喚和擊敗Nikola Tesla
4 週前
By 尊渡假赌尊渡假赌尊渡假赌
熱工具
記事本++7.3.1
好用且免費的程式碼編輯器
SublimeText3漢化版
中文版，非常好用
禪工作室 13.0.1
強大的PHP整合開發環境
Dreamweaver CS6
視覺化網頁開發工具
SublimeText3 Mac版
神級程式碼編輯軟體(SublimeText3)
深度學習架構的比較分析
May 17, 2023 pm 04:34 PM
深度學習的概念源自於人工神經網路的研究，含有多個隱藏層的多層感知器是一種深度學習結構。深度學習透過組合低層特徵形成更抽象的高層表示，以表徵資料的類別或特徵。它能夠發現資料的分佈式特徵表示。深度學習是機器學習的一種，而機器學習是實現人工智慧的必經之路。那麼，各種深度學習的系統架構之間有哪些差異呢？ 1.全連接網路（FCN）完全連接網路（FCN）由一系列完全連接的層組成，每個層中的每個神經元都連接到另一層中的每個神經元。其主要優點是“結構不可知”，即不需要對輸入做出特殊的假設。雖然這種結構不可知使得完
多路徑多領域通吃！ GoogleAI發布多領域學習通用模型MDL
May 28, 2023 pm 02:12 PM
面向視覺任務（如影像分類）的深度學習模型，通常使用單一視覺域（如自然影像或電腦生成的影像）的資料進行端到端的訓練。一般情況下，一個為多個領域完成視覺任務的應用程式需要為每個單獨的領域建立多個模型，分別獨立訓練，不同領域之間不共享數據，在推理時，每個模型將處理特定領域的輸入資料。即使是面向不同領域，這些模型之間的早期層的有些特徵都是相似的，所以，對這些模型進行聯合訓練的效率更高。這能減少延遲和功耗，降低儲存每個模型參數的記憶體成本，這種方法稱為多領域學習（MDL）。此外，MDL模型也可以優於單
Spring Data JPA 的架構和工作原理是什麼？
Apr 17, 2024 pm 02:48 PM
SpringDataJPA基於JPA架構，透過映射、ORM和事務管理與資料庫互動。其儲存庫提供CRUD操作，派生查詢簡化了資料庫存取。此外，它使用延遲加載，僅在必要時檢索數據，從而提高了效能。
1.3ms耗時！清華最新開源行動裝置神經網路架構 RepViT
Mar 11, 2024 pm 12:07 PM
论文地址：https://arxiv.org/abs/2307.09283代码地址：https://github.com/THU-MIG/RepViTRepViT在移动端ViT架构中表现出色，展现出显著的优势。接下来，我们将探讨本研究的贡献所在。文中提到，轻量级ViTs通常比轻量级CNNs在视觉任务上表现得更好，这主要归功于它们的多头自注意力模块(MSHA)可以让模型学习全局表示。然而，轻量级ViTs和轻量级CNNs之间的架构差异尚未得到充分研究。在这项研究中，作者们通过整合轻量级ViTs的有效
此「錯」並非真的錯：從四篇經典論文入手，理解Transformer架構圖「錯」在何處
Jun 14, 2023 pm 01:43 PM
前段時間，一則指出Google大腦團隊論文《AttentionIsAllYouNeed》中Transformer架構圖與程式碼不一致的推文引發了大量的討論。對於Sebastian的這項發現，有人認為屬於無心之過，但同時也會令人感到奇怪。畢竟，考慮到Transformer論文的流行程度，這個不一致問題早就該被提及1000次。 SebastianRaschka在回答網友評論時說，「最最原始」的程式碼確實與架構圖一致，但2017年提交的程式碼版本進行了修改，但同時沒有更新架構圖。這也是造成「不一致」討論的根本原因。
AI基礎架構：IT和資料科學團隊協作的重要性
May 18, 2023 pm 11:08 PM
人工智慧(AI)已經改變了許多行業的遊戲規則，使企業能夠提高效率、決策和客戶體驗。隨著人工智慧的不斷發展和變得越來越複雜，企業投資於合適的基礎設施來支援其開發和部署至關重要。這個基礎設施的一個關鍵方面是IT和數據科學團隊之間的協作，因為兩者在確保人工智慧計畫的成功方面都發揮著關鍵作用。人工智慧的快速發展導致對運算能力、儲存和網路能力的需求不斷增加。這種需求為傳統IT基礎架構帶來了壓力，而傳統IT基礎架構並非設計用於處理AI所需的複雜和資源密集型工作負載。因此，企業現在正在尋求建構能夠支持AI工作負
golang框架架構的學習曲線有多陡峭？
Jun 05, 2024 pm 06:59 PM
Go框架架構的學習曲線取決於對Go語言和後端開發的熟悉程度以及所選框架的複雜性：對Go語言的基礎知識有較好的理解。具有後端開發經驗會有所幫助。複雜度不同的框架導致學習曲線差異。
手撕Llama3第1層: 從零開始實現llama3
Jun 01, 2024 pm 05:45 PM
一、Llama3的架構在本系列文章中，我們從頭開始實作llama3。 Llama3的整體架構：圖片Llama3的模型參數：讓我們來看看這些參數在LlaMa3模型中的實際數值。圖片[1]上下文視窗（context-window）在實例化LlaMa類別時，變數max_seq_len定義了context-window。類別中還有其他參數，但這個參數與transformer模型的關係最為直接。這裡的max_seq_len是8K。圖片[2]字彙量（Vocabulary-size）和注意力層（AttentionL
