Home Database Mysql Tutorial 利用SQL Server 2008中的SSIS进行大规模的数据库查询操作

利用SQL Server 2008中的SSIS进行大规模的数据库查询操作

Jun 07, 2016 pm 05:40 PM
Batch query

这些天更深入的研究了SQLServer2008中的SSIS,这个属于商业智能(BI,BusinessIntelligence),我也是略知一二,深入研究并加以熟练应用,能够给工作带来很多便

这些天更深入的研究了SQL Server 2008中的SSIS,这个属于商业智能(BI,Business Intelligence),我也是略知一二,深入研究并加以熟练应用,能够给工作带来很多便利。在这里非常感谢我的同事—我们都亲切的称呼他“筑哥”,在这个深入学习的过程中,筑哥给了很多关键性的指导工作,再次感谢筑哥!

利用SSIS可以批量对数据库进行查询:

业务需求简介:

    运营中的游戏服务器,香港服务器,近三百台MySQL数据库服务器,有MySQL 4也有MySQL 5,网站空间,各个服务器的数据库结构一致,我需要对这些数据库结构一致的服务器进行相同的SQL语句查询,可以通过写脚本的方式,在每台服务器上运行,然后再推送到一台中心服务器,在对汇总的数据进行查询分析。如果利用SSIS这个功能去实现的话,只需要在一台装有SQL Server 2008的服务器上即可操作完成,

  为了演示,我也是对部分SQL查询语句加入limit限制,只取回少量数据即可实现功能上的演示,香港服务器租用,这里实现了将所有远程数据库服务器上的数据采集到本地SQL Server2008服务器上,属于数据采集的工作,还有后半部分数据分析查询并生各种报表(Excel、记事本)的工作,暂时不加以介绍,以下是我的执行过程部分截图:

1、控制流:

 

 

2、同步服务器列表(数据流任务):

 

3、apexlog0(数据流任务):

 在这里我只把流程图贴出来了,如有读者感兴趣的,咱们可以一起交流学习。

附 本地同名文档,

关于后半部分生成报表的文档,我会抽时间写出来,供大家一起分享。

2012年 08月 25日 星期六 11:33:23 HKT 添加控制流完整截图:

 

 

本文出自 “开源一员” 博客,请务必保留此出处

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Best Graphic Settings
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. How to Fix Audio if You Can't Hear Anyone
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

How do you alter a table in MySQL using the ALTER TABLE statement? How do you alter a table in MySQL using the ALTER TABLE statement? Mar 19, 2025 pm 03:51 PM

The article discusses using MySQL's ALTER TABLE statement to modify tables, including adding/dropping columns, renaming tables/columns, and changing column data types.

How do I configure SSL/TLS encryption for MySQL connections? How do I configure SSL/TLS encryption for MySQL connections? Mar 18, 2025 pm 12:01 PM

Article discusses configuring SSL/TLS encryption for MySQL, including certificate generation and verification. Main issue is using self-signed certificates' security implications.[Character count: 159]

How do you handle large datasets in MySQL? How do you handle large datasets in MySQL? Mar 21, 2025 pm 12:15 PM

Article discusses strategies for handling large datasets in MySQL, including partitioning, sharding, indexing, and query optimization.

What are some popular MySQL GUI tools (e.g., MySQL Workbench, phpMyAdmin)? What are some popular MySQL GUI tools (e.g., MySQL Workbench, phpMyAdmin)? Mar 21, 2025 pm 06:28 PM

Article discusses popular MySQL GUI tools like MySQL Workbench and phpMyAdmin, comparing their features and suitability for beginners and advanced users.[159 characters]

How do you drop a table in MySQL using the DROP TABLE statement? How do you drop a table in MySQL using the DROP TABLE statement? Mar 19, 2025 pm 03:52 PM

The article discusses dropping tables in MySQL using the DROP TABLE statement, emphasizing precautions and risks. It highlights that the action is irreversible without backups, detailing recovery methods and potential production environment hazards.

How do you represent relationships using foreign keys? How do you represent relationships using foreign keys? Mar 19, 2025 pm 03:48 PM

Article discusses using foreign keys to represent relationships in databases, focusing on best practices, data integrity, and common pitfalls to avoid.

How do you create indexes on JSON columns? How do you create indexes on JSON columns? Mar 21, 2025 pm 12:13 PM

The article discusses creating indexes on JSON columns in various databases like PostgreSQL, MySQL, and MongoDB to enhance query performance. It explains the syntax and benefits of indexing specific JSON paths, and lists supported database systems.

How do I secure MySQL against common vulnerabilities (SQL injection, brute-force attacks)? How do I secure MySQL against common vulnerabilities (SQL injection, brute-force attacks)? Mar 18, 2025 pm 12:00 PM

Article discusses securing MySQL against SQL injection and brute-force attacks using prepared statements, input validation, and strong password policies.(159 characters)

See all articles