Welcome!

Linux Containers Authors: Yeshim Deniz, Pat Romanski, Liz McMillan, Elizabeth White, Stefana Muller

Related Topics: @DXWorldExpo, Microservices Expo, Linux Containers

@DXWorldExpo: Blog Post

NoSQL Databases and Large Web Applications By @MapR | @CloudExpo [#BigData]

What You Need to Know

NoSQL Databases to Support Large Web Applications

NoSQL databases are powerful tools for supporting big data applications, maximizing scalability, performance, and availability. Their unique features and easy implementation render them well-equipped to meet a variety of enterprise needs in a range of use cases.

NoSQL is a database technology that was developed to address critical issues today such as a huge increase in data volume, a high frequency of data access, and support for varying data formats. Relational database management systems (RDBMS), on the other hand, were not designed to face these challenges on a huge scale - nor were they built to take advantage of inexpensive commodity storage and processing power. NoSQL databases are increasingly viewed as the most suitable option for modern, high-demand applications.

NoSQL originated as an endeavor to build a database for modern applications that can scale rapidly. Popularized in 2009, NoSQL has seen dramatic growth in just a handful of years. All NoSQL databases were designed to increase the scaling, performance, and availability of large-scale applications, especially web applications. Pursuant to this goal, many RDBMS features have been left out, and instead, certain features were added to better support large data sets. One important component of NoSQL databases is the "sharding" of data. This feature helps the scale-out architecture of NoSQL technology to support a huge number of records - a problem area for the traditional relational model. By using thousands of servers in a clustered environment, NoSQL-based applications can support millions of users on terabytes of data with rapid response time.

NoSQL databases come in several forms:

  • Key-value store: This is the simplest NoSQL database. It stores each item with a lookup attribute (known as a "key") and associated value.
  • Wide-column stores: Also known as "column family stores," this type of NoSQL database can be described as a multi-dimensional sorted map which is persistent, distributed, and sparse. More simply, they have a data model that most closely resembles tables in an RDBMS.
  • Document database: This type of database consists of a key with an associated complex data structure. This complex data structure is known as a "document," which can itself hold key-value pairs, nested documents, or even key-array pairs.
  • Graph database: This is typically used to store data represented in the form of a graph, such as social connections.

So what are some suitable use cases for NoSQL? Here are a few situations that call for the powerful features of NoSQL databases:

  • Rapidly growing data sets: If your data continues to grow rapidly like in an Internet of Things environment, then you want a horizontal scaling architecture so you can simply add more servers to accommodate that growth. Horizontal scaling in a distributed environment is always a challenge for traditional database management systems.
  • Scalable BI and analytical applications: The volume and velocity of data is growing rapidly in many enterprises, and RDBMSs are under-equipped to handle analytical applications treating large volumes of data. A lot of time is wasted in loading, unloading, and querying warehouses in support of analytics. By moving some analytics tasks to a NoSQL database, you can free up your high end warehouses for time-sensitive, business-critical analytics.
  • Real-time analytics applications: Real-time analytics applications - including stock market analysis, fraud detection, and risk analysis - are often critical to manage. Data is typically collected from different sources and then analyzed in real time. NoSQL databases, especially when used with Apache Hadoop, are well-suited to support such operations.
  • Simple lookup-based database applications: Many business applications require only basic data storage and retrieval - so they do not want to take on the overhead or size of traditional RDBMSs. NoSQL databases avoid the unnecessary overhead in these simple applications.

For a simple yet highly capable tool to support large-scale web applications, NoSQL databases are your best bet. With their powerful capabilities, they can meet the needs of a variety of applications. MapR-DB, the wide-column NoSQL database that leverages the popular Apache HBase API, is a technology that can handle many different use cases while providing enterprise-grade reliability, extreme scalability, and high performance.

More Stories By Dale Kim

Dale is Director of Industry Solutions at MapR. His technical and managerial experience includes work with relational databases, as well as non-relational data in the areas of search, content management, and NoSQL. Dale holds an MBA from Santa Clara University, and a BA in Computer Science from the UC Berkeley.

IoT & Smart Cities Stories
The deluge of IoT sensor data collected from connected devices and the powerful AI required to make that data actionable are giving rise to a hybrid ecosystem in which cloud, on-prem and edge processes become interweaved. Attendees will learn how emerging composable infrastructure solutions deliver the adaptive architecture needed to manage this new data reality. Machine learning algorithms can better anticipate data storms and automate resources to support surges, including fully scalable GPU-c...
Machine learning has taken residence at our cities' cores and now we can finally have "smart cities." Cities are a collection of buildings made to provide the structure and safety necessary for people to function, create and survive. Buildings are a pool of ever-changing performance data from large automated systems such as heating and cooling to the people that live and work within them. Through machine learning, buildings can optimize performance, reduce costs, and improve occupant comfort by ...
The explosion of new web/cloud/IoT-based applications and the data they generate are transforming our world right before our eyes. In this rush to adopt these new technologies, organizations are often ignoring fundamental questions concerning who owns the data and failing to ask for permission to conduct invasive surveillance of their customers. Organizations that are not transparent about how their systems gather data telemetry without offering shared data ownership risk product rejection, regu...
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
Predicting the future has never been more challenging - not because of the lack of data but because of the flood of ungoverned and risk laden information. Microsoft states that 2.5 exabytes of data are created every day. Expectations and reliance on data are being pushed to the limits, as demands around hybrid options continue to grow.
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
As IoT continues to increase momentum, so does the associated risk. Secure Device Lifecycle Management (DLM) is ranked as one of the most important technology areas of IoT. Driving this trend is the realization that secure support for IoT devices provides companies the ability to deliver high-quality, reliable, secure offerings faster, create new revenue streams, and reduce support costs, all while building a competitive advantage in their markets. In this session, we will use customer use cases...