Linux Containers Authors: Pat Romanski, Elizabeth White, Liz McMillan, Craig Lowell, XebiaLabs Blog

Related Topics: @CloudExpo

@CloudExpo: Article

Black Friday? Cyber Monday? By @UmeshMahajan14 | @CloudExpo [#Cloud]

The network infrastructure is now intelligent enough to spin up new resources in a moment's notice to boost capacity

Black Friday? Cyber Monday? Bring It on with Analytics and SDx-Based Application Delivery

It's terminology specific to the retail industry though just about anyone who shops for consumer goods is familiar with the phrase "Black Friday" or, more recently, its online instantiation "Cyber Monday." Both terms refer to the anticipated rush of commercial traffic in advance of the holiday season. For the retailers themselves, it's an odd blend of the Apocalypse and Christmas magic, something to dread and anticipate simultaneously. For e-tailers specifically, this season requires that their web portals are capable of navigating huge spikes in online traffic without compromising the user experience. The threshold is extreme. Industry research has revealed that most consumers expect websites to load in under two seconds and that nearly half of them will abandon the site if loading exceeds a mere three seconds.

In the heyday of legacy TCP/IP networking, IT's response (or preparation) for this scenario would have been simple: overprovision the heck out of network capacity. For the web infrastructure, IT would have likely purchased and provisioned a large number of load balancers, a pair at a time to enable high availability. More than likely, the excess capacity would have been overkill, but hey, better safe than sorry, right? The reason for this overprovisioning was also simple - there was no accurate way for IT to dynamically provision network capacity on-demand. In essence, IT was flying blind, which benefited networking vendors who commanded insane market capitalization values due to the excess purchasing in the "good old days".

This very scenario, played out countless times, was one of the drivers for the advent of cloud computing, data center virtualization, and then software-defined networking as enterprises and service providers sought ways to maximize efficiencies in their network infrastructure. Another driver was the need to reduce network management complexity, made possible by the abstraction of key network services such as security, load balancing, application delivery, etc., through the SDN model. The migration toward these new constructs were based on three realities about networking in the modern era:

One, as upper-layer network services occupy the strategic high ground in the data center infrastructure between IT and the end-users themselves, these technologies play a major role in determining the all-important end-user experience. This may be the difference between a making a sale and losing a customer. However, as apps migrated to the cloud, the control and visibility that traditional application delivery controllers (ADC) could provide diminished, which threatened established service level agreements and, ultimately, user experience.

Two, the architecture of how applications are developed today has evolved from purpose-built, monolithic ("shrink wrapped") code and products to a tightly federated collection of microservices that are both modular are reusable. It's as if app developers moved to using a common set of Lego blocks to build any number of web-based apps only limited by their imagination. For networking teams, however, the move to microservice-app development meant that the existing assumptions around traffic patterns, load-balancing scale, and service requirements went out the window, requiring far greater levels of network-wide intelligence.

Three, the wide adoption of connected mobile devices has made anticipating where and when people were accessing applications a completely unpredictable exercise.

These megatrends pose disruptive impact for legacy ADC vendors because they tend to undermine the core value proposition of hardware, appliance-based products. That is, the hallmark of the vendors who led in this space was their ability to build high-performance gear and their intimate familiarity of monolithic apps - think SAP, Oracle, Microsoft, etc. But mobile computing and microservice-based apps requires load balancing capable of providing holistic network intelligence and the ability to co-locate these critical services directly with the microservices themselves (aka "application affinity") - whether they reside in the cloud or on-prem. For these requirements, we believe that the most logical form factor is software-based delivered as VMs or even containers.

Facebook, a company who helped drive these technology transformations, argued for these very principles the introduction of its homegrown Autoscale load balancer, which it positioned as a more efficient and intelligent way to deliver these network services. To achieve this engineering milestone, Facebook dedicated dozens of engineers, a luxury most enterprises cannot afford. But for Facebook, building a custom load balancer/ADC for its limited and specific set of applications was the only way it could guarantee end-user experience as well as optimize its compute resources at the levels its hyperscale environment required.

The opportunity now exists to build a next-generation ADC for mainstream enterprises who typically manage hundreds of different applications compared to one or two that a Web 2.0 company might. We believe this requires fundamentally rearchitecting what an ADC is and how it's delivered. Specifically, we believe the next-gen architecture requires:

  • A true separation of the control and data plane. We believe that SDN has been hindered in some way by "SDN-light" or "SDN-like" approaches by vendors that have simply taken the software running on their hardware appliances and squeezed them into VMs that never separated the data plane from the control plane. To support a true multi-cloud environment, the architecture requires an elastically scalable, load-balancer with a distributed data plane that casn span, serve and scale with apps across various on-premise and cloud locations. The distributed data plane enables customers to achieve application affinity at the application microservice levels thereby dramatically improving application performance. In addition, the clean separation of planes also enables the creation of a unified, centralized control plane, which significantly alleviates the operational complexity associated with integrating, operating and managing each ADC appliance across locations individually.
  • Holistic, in-line big data analytics that deliver real-time user, application and network performance not possible with the mishmash of offline/out-of-band monitoring tools currently available in the marketplace. I've already argued that the load balancer or ADC occupies the enviable, strategic location between the infrastructure and the end-user. Why not take advantage of this by delivering powerful performance insights and other KPI important to network operators, application admins, and DevOps teams? Further, real-time, in-line information can make the network smarter over time and enable it to automate, influence certain feature activation and resource scaling without human intervention, or what I refer to as "insight-to-action"

Now imagine that same Black Friday or Cyber Monday scenario but this time with a next-generation analytics and SDN-enabled ADC. Online traffic spikes from users all over the world using a myriad of connected devices. The network infrastructure is now intelligent enough to spin up new resources in a moment's notice to boost capacity and performance dynamically wherever required, as well as arbitrating the load efficiently throughout the data center. Further, with Big Data analytics, the network will eventually be able to make predictive decisions based on historical traffic, usage patterns unique to that environment such as online retailers and the holiday shopping season. This is not only possible today, we believe it's the mandate for where networking and, specifically, what ADCs must deliver.

More Stories By Umesh Mahajan

Umesh Mahajan is CEO and co-founder of Avi Networks. A seasoned executive and entrepreneur with 25+ years of experience in tech industry, he has helped develop the vision, strategy, and execution plan for several innovative technology products.

Before co-founding Avi Networks, Umesh was the Vice President / General Manager for a $2B Data Center switching business at Cisco where he led engineering, product management, marketing and operations for Nexus 7000, MDS switching products, and the NX-OS operating system.

Prior to his work at Cisco, Umesh led the software team at Andiamo in architecting and delivering SAN-OS. Umesh has a Master of Science degree in computer science from Duke, a Bachelor of Science degree from IIT Delhi, and has 29 patents to date.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@ThingsExpo Stories
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effi...
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform and how we integrate our thinking to solve complicated problems. In his session at 19th Cloud Expo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm ...
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
Big Data engines are powering a lot of service businesses right now. Data is collected from users from wearable technologies, web behaviors, purchase behavior as well as several arbitrary data points we’d never think of. The demand for faster and bigger engines to crunch and serve up the data to services is growing exponentially. You see a LOT of correlation between “Cloud” and “Big Data” but on Big Data and “Hybrid,” where hybrid hosting is the sanest approach to the Big Data Infrastructure pro...
A critical component of any IoT project is what to do with all the data being generated. This data needs to be captured, processed, structured, and stored in a way to facilitate different kinds of queries. Traditional data warehouse and analytical systems are mature technologies that can be used to handle certain kinds of queries, but they are not always well suited to many problems, particularly when there is a need for real-time insights.
"My role is working with customers, helping them go through this digital transformation. I spend a lot of time talking to banks, big industries, manufacturers working through how they are integrating and transforming their IT platforms and moving them forward," explained William Morrish, General Manager Product Sales at Interoute, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
With 15% of enterprises adopting a hybrid IT strategy, you need to set a plan to integrate hybrid cloud throughout your infrastructure. In his session at 18th Cloud Expo, Steven Dreher, Director of Solutions Architecture at Green House Data, discussed how to plan for shifting resource requirements, overcome challenges, and implement hybrid IT alongside your existing data center assets. Highlights included anticipating workload, cost and resource calculations, integrating services on both sides...
"We are a well-established player in the application life cycle management market and we also have a very strong version control product," stated Flint Brenton, CEO of CollabNet,, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Unless your company can spend a lot of money on new technology, re-engineering your environment and hiring a comprehensive cybersecurity team, you will most likely move to the cloud or seek external service partnerships. In his session at 18th Cloud Expo, Darren Guccione, CEO of Keeper Security, revealed what you need to know when it comes to encryption in the cloud.
We're entering the post-smartphone era, where wearable gadgets from watches and fitness bands to glasses and health aids will power the next technological revolution. With mass adoption of wearable devices comes a new data ecosystem that must be protected. Wearables open new pathways that facilitate the tracking, sharing and storing of consumers’ personal health, location and daily activity data. Consumers have some idea of the data these devices capture, but most don’t realize how revealing and...
What are the successful IoT innovations from emerging markets? What are the unique challenges and opportunities from these markets? How did the constraints in connectivity among others lead to groundbreaking insights? In her session at @ThingsExpo, Carmen Feliciano, a Principal at AMDG, will answer all these questions and share how you can apply IoT best practices and frameworks from the emerging markets to your own business.
Ask someone to architect an Internet of Things (IoT) solution and you are guaranteed to see a reference to the cloud. This would lead you to believe that IoT requires the cloud to exist. However, there are many IoT use cases where the cloud is not feasible or desirable. In his session at @ThingsExpo, Dave McCarthy, Director of Products at Bsquare Corporation, will discuss the strategies that exist to extend intelligence directly to IoT devices and sensors, freeing them from the constraints of ...
You think you know what’s in your data. But do you? Most organizations are now aware of the business intelligence represented by their data. Data science stands to take this to a level you never thought of – literally. The techniques of data science, when used with the capabilities of Big Data technologies, can make connections you had not yet imagined, helping you discover new insights and ask new questions of your data. In his session at @ThingsExpo, Sarbjit Sarkaria, data science team lead ...
Extracting business value from Internet of Things (IoT) data doesn’t happen overnight. There are several requirements that must be satisfied, including IoT device enablement, data analysis, real-time detection of complex events and automated orchestration of actions. Unfortunately, too many companies fall short in achieving their business goals by implementing incomplete solutions or not focusing on tangible use cases. In his general session at @ThingsExpo, Dave McCarthy, Director of Products...
Traditional IT, great for stable systems of record, is struggling to cope with newer, agile systems of engagement requirements coming straight from the business. In his session at 18th Cloud Expo, William Morrish, General Manager of Product Sales at Interoute, outlined ways of exploiting new architectures to enable both systems and building them to support your existing platforms, with an eye for the future. Technologies such as Docker and the hyper-convergence of computing, networking and sto...
WebRTC is bringing significant change to the communications landscape that will bridge the worlds of web and telephony, making the Internet the new standard for communications. Cloud9 took the road less traveled and used WebRTC to create a downloadable enterprise-grade communications platform that is changing the communication dynamic in the financial sector. In his session at @ThingsExpo, Leo Papadopoulos, CTO of Cloud9, discussed the importance of WebRTC and how it enables companies to focus...
With an estimated 50 billion devices connected to the Internet by 2020, several industries will begin to expand their capabilities for retaining end point data at the edge to better utilize the range of data types and sheer volume of M2M data generated by the Internet of Things. In his session at @ThingsExpo, Don DeLoach, CEO and President of Infobright, discussed the infrastructures businesses will need to implement to handle this explosion of data by providing specific use cases for filterin...
IoT generates lots of temporal data. But how do you unlock its value? You need to discover patterns that are repeatable in vast quantities of data, understand their meaning, and implement scalable monitoring across multiple data streams in order to monetize the discoveries and insights. Motif discovery and deep learning platforms are emerging to visualize sensor data, to search for patterns and to build application that can monitor real time streams efficiently. In his session at @ThingsExpo, ...
Early adopters of IoT viewed it mainly as a different term for machine-to-machine connectivity or M2M. This is understandable since a prerequisite for any IoT solution is the ability to collect and aggregate device data, which is most often presented in a dashboard. The problem is that viewing data in a dashboard requires a human to interpret the results and take manual action, which doesn’t scale to the needs of IoT.
Internet of @ThingsExpo has announced today that Chris Matthieu has been named tech chair of Internet of @ThingsExpo 2016 Silicon Valley. The 6thInternet of @ThingsExpo will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.