Nosql之普罗米修斯猜想
Nosql带领我们进入到一个新的数据库世界，字面上我们不要理解为是Nosql，应该正确理解为Noto..
Nosql带领我们进入到一个新的数据库世界，字面上我们不要理解为是“No sql”，应该正确理解为“Not only sql”就是说我们不仅仅使用sql来查询和处理数据，还可以利用编程语言和其他技术来管理我们的数据，数据是多种多样的，就跟达尔文的进化论类似，数据也会进化，从远古的甲骨文，到现代的二进制，还有最近流行起来的二维码，不同的数据其管理方法也是不一样的。由原来无库时代->层次状数据库->网状数据库->关系型数据库->非关系型数据库-> 未来超级数据库，这也是进化而来，前些日子看了放映的大片《普罗米修斯》，里面有一个震撼的场面“星际云图”，虚拟主机，如下图所示，在一个有限空间里展示出了整个宇宙分布，每个星系每个星球都非常逼真而清晰，自己知道自己所在的位置，这样的信息是如何保存起来的呢？
这可能不太适合使用关系型数据库来管理，说说为什么！
1.数据量：星际云图如果要实现，首先存储起来的数据量可想而知，这不是几个oracle就可以装下的。需要强大的存储设备。
2.运算量：数据转换为图形，计算各自的信息与资源，展示出来，这也不是仅仅追加硬件就可以的，早晚会碰触到天花板。
3.传输流量：数据如果是不流动的只能称之为标本，要计算出星球自己所在的位置和运行轨迹，并且要让其他的天体也知道每个行星的位置和自己的位置，这种输入/输出数据量可以想象是巨大的。
4.存储方式：这种星际云图已经不能单纯使用table来存放数据了，因为它是一种非结构化数据，最简单理解是一种三维数据，而表只能表示出二维数据，更甚者如果加上时间就是四维数据了。
如果要设计一个符合条件的Nosql数据库那么需要重点关注是什么呢？
1.解决数据量：那么我想不用多说分布式存储可能是目前可行的一个好方法，香港空间，因为集中存储总有一天会碰触到天花板，不管是空间上 or 资金上 or I/O。而分布式存储可以适当降低成本，最重要的是可以大幅度提高I/O性能。
2.解决运算量：这个方案可以采用集群作战方式，也就是人海战术，最关键的是如何协调好大家一起来井然有序的工作，需要一个中央控制系统来协调集群工作。
3.解决传输流量：可以使用超级黑电缆，这种黑电缆速率40Gb/s，低延迟，高带宽。有一个不成熟的想法，来源于Exadata RAC架构，它是用一整块背板（集成电路板）把两台机器背靠背拼起来，数据走在总线上。我们是不是可以把集群中的节点也用总线的方式串起来，香港虚拟主机，这样基本上就跟上了内存IO效率啦。
4.解决存储方式：星际云图它是一种三维或者是多维的数据集合，我想这种数据可以用数学上的坐标方法来量化，每个星球有自己的坐标集合，若干个星球可以组成一个星系，就这样逐渐的拼接起来构建出图中震撼画面。
Leonarding
2012.12.19
天津&winter
分享技术~成就梦想
Blog：
本文出自 “leonarding Blog” 博客，请务必保留此出处
Hot AI Tools
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Undress AI Tool
Undress images for free
Clothoff.io
AI clothes remover
AI Hentai Generator
Generate AI Hentai for free.
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
1371
52
PHP's big data structure processing skills
May 08, 2024 am 10:24 AM
Big data structure processing skills: Chunking: Break down the data set and process it in chunks to reduce memory consumption. Generator: Generate data items one by one without loading the entire data set, suitable for unlimited data sets. Streaming: Read files or query results line by line, suitable for large files or remote data. External storage: For very large data sets, store the data in a database or NoSQL.
Five major development trends in the AEC/O industry in 2024
Apr 19, 2024 pm 02:50 PM
AEC/O (Architecture, Engineering & Construction/Operation) refers to the comprehensive services that provide architectural design, engineering design, construction and operation in the construction industry. In 2024, the AEC/O industry faces changing challenges amid technological advancements. This year is expected to see the integration of advanced technologies, heralding a paradigm shift in design, construction and operations. In response to these changes, industries are redefining work processes, adjusting priorities, and enhancing collaboration to adapt to the needs of a rapidly changing world. The following five major trends in the AEC/O industry will become key themes in 2024, recommending it move towards a more integrated, responsive and sustainable future: integrated supply chain, smart manufacturing
C++ development experience sharing: Practical experience in C++ big data programming
Nov 22, 2023 am 09:14 AM
In the Internet era, big data has become a new resource. With the continuous improvement of big data analysis technology, the demand for big data programming has become more and more urgent. As a widely used programming language, C++’s unique advantages in big data programming have become increasingly prominent. Below I will share my practical experience in C++ big data programming. 1. Choosing the appropriate data structure Choosing the appropriate data structure is an important part of writing efficient big data programs. There are a variety of data structures in C++ that we can use, such as arrays, linked lists, trees, hash tables, etc.
Application of algorithms in the construction of 58 portrait platform
May 09, 2024 am 09:01 AM
1. Background of the Construction of 58 Portraits Platform First of all, I would like to share with you the background of the construction of the 58 Portrait Platform. 1. The traditional thinking of the traditional profiling platform is no longer enough. Building a user profiling platform relies on data warehouse modeling capabilities to integrate data from multiple business lines to build accurate user portraits; it also requires data mining to understand user behavior, interests and needs, and provide algorithms. side capabilities; finally, it also needs to have data platform capabilities to efficiently store, query and share user profile data and provide profile services. The main difference between a self-built business profiling platform and a middle-office profiling platform is that the self-built profiling platform serves a single business line and can be customized on demand; the mid-office platform serves multiple business lines, has complex modeling, and provides more general capabilities. 2.58 User portraits of the background of Zhongtai portrait construction
Discussion on the reasons and solutions for the lack of big data framework in Go language
Mar 29, 2024 pm 12:24 PM
In today's big data era, data processing and analysis have become an important support for the development of various industries. As a programming language with high development efficiency and superior performance, Go language has gradually attracted attention in the field of big data. However, compared with other languages such as Java and Python, Go language has relatively insufficient support for big data frameworks, which has caused trouble for some developers. This article will explore the main reasons for the lack of big data framework in Go language, propose corresponding solutions, and illustrate it with specific code examples. 1. Go language
AI, digital twins, visualization... Highlights of the 2023 Yizhiwei Autumn Product Launch Conference!
Nov 14, 2023 pm 05:29 PM
Yizhiwei’s 2023 autumn product launch has concluded successfully! Let us review the highlights of the conference together! 1. Intelligent inclusive openness, allowing digital twins to become productive Ning Haiyuan, co-founder of Kangaroo Cloud and CEO of Yizhiwei, said in his opening speech: At this year’s company’s strategic meeting, we positioned the main direction of product research and development as “intelligent inclusive openness” "Three core capabilities, focusing on the three core keywords of "intelligent inclusive openness", we further proposed the development goal of "making digital twins a productive force". 2. EasyTwin: Explore a new digital twin engine that is easier to use 1. From 0.1 to 1.0, continue to explore the digital twin fusion rendering engine to have better solutions with mature 3D editing mode, convenient interactive blueprints, and massive model assets
Getting Started Guide: Using Go Language to Process Big Data
Feb 25, 2024 pm 09:51 PM
As an open source programming language, Go language has gradually received widespread attention and use in recent years. It is favored by programmers for its simplicity, efficiency, and powerful concurrent processing capabilities. In the field of big data processing, the Go language also has strong potential. It can be used to process massive data, optimize performance, and can be well integrated with various big data processing tools and frameworks. In this article, we will introduce some basic concepts and techniques of big data processing in Go language, and show how to use Go language through specific code examples.
Big data processing in C++ technology: How to use in-memory databases to optimize big data performance?
May 31, 2024 pm 07:34 PM
In big data processing, using an in-memory database (such as Aerospike) can improve the performance of C++ applications because it stores data in computer memory, eliminating disk I/O bottlenecks and significantly increasing data access speeds. Practical cases show that the query speed of using an in-memory database is several orders of magnitude faster than using a hard disk database.
