NoSQL Is Dead, Long Live NoSQL
source link: https://blog.couchbase.com/nosql-is-dead-long-live-nosql/
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Dynamo accelerated the NoSQL revolution that’s driving the database industry.
Recently, Amazon announced PartiQL – A SQL-Compatible Query Language for their flagship NoSQL database Amazon DynamoDB. This has brought the NoSQL “re:evolution” full circle. It’s wonderful to see the collaborative research from UCSD and Couchbase enabling the industry to move forward.
NoSQL had a good run. MapReduce triggered it in 2004. Dynamo and BigTable accelerated it in 2007. NoSQL meant no support for SQL, no support for multi-document transactions, no schema management, no procedural language, and many more No’s. However, NoSQL wasn’t a rebel without a cause. It promised reliability, scalability, and flexibility. Someone quipped: “If you are not ready to scale, you’re not ready to succeed!”. To the amusement of SQL folks, MongoDB claimed it’s webscale. Despite the reservations and opposition from the database community, the NoSQL movement marched on. Many wondered if it’s useful for Amazon, Google, and Facebook, who else would find it useful?
Here we are. With more than 200 NoSQL databases.
NoSQL systems haven’t remained simple key-value stores with get/set, map/reduce operations. MongoDB added an aggregation framework, a modern storage engine, and dropped ACID. DynamoDB added transactions, indexes, and now a SQL-like language. Cassandra started with CQL, an SQL-like language, made significant changes with 3.0, and has been adding new datatypes, DDLs and DMLs. Couchbase started with simple APIs, added views. In 2015, Couchbase introduced N1QL — SQL for JSON, global secondary indexes, and later added analytical service with N1QL support, and distributed transactions.
If you’re read The Innovator’s Dilemma, it should remind you of the Toyota and the mini mills stories. Incumbents left the low end of the market to Toyota Corona and mini mills which freed them to focus on higher margin markets. In the database industry, the Incumbents regarded NoSQL with the same derision or claimed they had SQL-less databases a long time ago! Still, there have been some half-hearted attempts by the incumbents to get into the market. Oracle even invested in NoSQL by buying Sleepycat Software, maker of the BerkeleyDB NoSQL database. IBM added JSON and MongoDB support to Informix and DB2. This is the equivalent of GM releasing the Geo Metro — let’s release a basic model at the lower end of the market and be done with it. Microsoft probably made the best attempt by building CosmosDB (formerly DocumentDB) from the ground up.
NoSQL isn’t simply the absence of SQL. Just like Toyota and mini mills, NoSQL has the core strengths. Toyota’s strength was the single-mold frame which enabled them to produce the car in Japan, ship it 6000 miles and still be affordable for the low end of the car buyers. The single-mold frame also provided them the base to iterate and innovate to improve the car. Mini mills continue to move up the stack to produce better quality steel and the integrated steel mills usually responded by fleeing the market and avoiding competition. One fine day, GM filed bankruptcy and the integrated steel mills went out of business.
So, what is the core differentiator of NoSQL? Distributed database from the core. Traditional RDBMS systems were built to run on a single machine and extended for hot-standby situations and then stretched for scale. NoSQL systems are designed to run on a cluster of machines from the get go. Hardware and software failures are expected and handled at a systemic level. In fact, COUCH in COUCHBASE stands for Cluster Of Unreliable Commodity Hardware. The core of NoSQL starts with a distributed database providing reliability and scale-out. Sure, there have been distributed database systems for 40 years. They focused on warehousing, not OLTP.
NoSQL started with the measly get()/set() APIs: just enough to cover the basic use cases with shopping carts, session stores, and profile managers. There was no way that their functionality could match the sophistication of SQL. The mockery of NoSQL from the traditional database vendors is reminiscent of the response from GM and integrated steel mills. The “high priests” of Oracle and IBM were happy to seed this low end market to a bunch of “know nothings.”
NoSQL databases have since added indexes, SQL with joins, aggregates, window functions, search and transactions. OK. This is just Couchbase. But, others have some of these. At Couchbase, we work with customers migrating off Oracle, Db2, Informix, SQL Server, and Sybase. These are great databases, but their core is different. Built for one, extended for a few. NoSQL systems are built for massive scale and reliability. Even when the higher-level index, query, and search capabilities are added, this core still has to operate at scale and be reliable. With all these capabilities, NoSQL has become the mainstay in the enterprises. Mission-critical workloads and thousands of clusters routinely run Couchbase, MongoDB, Elastic, and other NoSQL systems. NoSQL systems have made the modern database ready and affordable for modern enterprises.
SQL itself has been unreasonably effective. Many NoSQL systems have been extended to support many aspects of SQL. The competition between the NoSQL systems to provide better SQL — which means better syntax, functionality, performance, optimizer, and scale — is fierce. As these systems grow to create an even better database, let’s welcome Amazon DynamoDB to the fold and say: NoSQL is dead, long live NoSQL.
References
Author
Recommend
-
49
Inspiration This blog post is inspired by Aras Pranckevičius ' recent publication of a talk aimed at junior programmers, designed to get them to come to terms with new...
-
34
Microsoft has already said that .NET Core is the future of .NET, which means if you haven’t started, you’ll need to start migrating your existing .NET Framework applications to .NET Core. We’ll go over a few reasons to be...
-
20
Ruma is dead, long live Ruma! April 10, 2020 by Jonas Platte Rumais a Mat...
-
14
Wednesday, 16 December 2020 17:43 Tape is dead – long live tape! By Stephen Withers ...
-
8
The internet drove to extinction a world full of niche businesses. But even as power is concentrated in ever-fewer large internet platforms, the future belongs to global brands with narrow appeal – the niche multinationals. ...
-
23
Recently I came across yet another post about the adoption of Scala in the IT world nowadays. The article is “The Rise and Fall of Scala” on DZone. In that post the author...
-
13
An investor once shared with me a simple framework for the fundamental skills of venture capital:👁 See (the deal)🧠 Analyze (the deal)❤️ Win (the deal)Success in VC demands all three. But that doesn’t...
-
12
TimeManager is dead, long live the Temporal Controller! TimeManager turns 10 this year. The code base has made the transition from QGIS 1.x to 2.x and now 3.x and it would be wrong to say that it doesn’t show ;-) Now, it loo...
-
15
The Intranet is Dead. Long Live the Intranet. The SharePoint Intranet Vision and Strategy %3CLINGO-SUB%20id%3D%22lingo-sub-1696759%22%20slang%3D%2...
-
7
AssistedInject is dead, long live AssistedInject! After ~5 years of existing and ~4 years as an open source project, our AssistedInject library has been deleted. Mourn not, however, for the same functionality is
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK