Welcome!

Linux Containers Authors: Yeshim Deniz, Kalyan Ramanathan, Elizabeth White, Liz McMillan, Xenia von Wedel

Related Topics: @CloudExpo

@CloudExpo: Article

Black Friday? Cyber Monday? By @UmeshMahajan14 | @CloudExpo [#Cloud]

The network infrastructure is now intelligent enough to spin up new resources in a moment's notice to boost capacity

Black Friday? Cyber Monday? Bring It on with Analytics and SDx-Based Application Delivery

It's terminology specific to the retail industry though just about anyone who shops for consumer goods is familiar with the phrase "Black Friday" or, more recently, its online instantiation "Cyber Monday." Both terms refer to the anticipated rush of commercial traffic in advance of the holiday season. For the retailers themselves, it's an odd blend of the Apocalypse and Christmas magic, something to dread and anticipate simultaneously. For e-tailers specifically, this season requires that their web portals are capable of navigating huge spikes in online traffic without compromising the user experience. The threshold is extreme. Industry research has revealed that most consumers expect websites to load in under two seconds and that nearly half of them will abandon the site if loading exceeds a mere three seconds.

In the heyday of legacy TCP/IP networking, IT's response (or preparation) for this scenario would have been simple: overprovision the heck out of network capacity. For the web infrastructure, IT would have likely purchased and provisioned a large number of load balancers, a pair at a time to enable high availability. More than likely, the excess capacity would have been overkill, but hey, better safe than sorry, right? The reason for this overprovisioning was also simple - there was no accurate way for IT to dynamically provision network capacity on-demand. In essence, IT was flying blind, which benefited networking vendors who commanded insane market capitalization values due to the excess purchasing in the "good old days".

This very scenario, played out countless times, was one of the drivers for the advent of cloud computing, data center virtualization, and then software-defined networking as enterprises and service providers sought ways to maximize efficiencies in their network infrastructure. Another driver was the need to reduce network management complexity, made possible by the abstraction of key network services such as security, load balancing, application delivery, etc., through the SDN model. The migration toward these new constructs were based on three realities about networking in the modern era:

One, as upper-layer network services occupy the strategic high ground in the data center infrastructure between IT and the end-users themselves, these technologies play a major role in determining the all-important end-user experience. This may be the difference between a making a sale and losing a customer. However, as apps migrated to the cloud, the control and visibility that traditional application delivery controllers (ADC) could provide diminished, which threatened established service level agreements and, ultimately, user experience.

Two, the architecture of how applications are developed today has evolved from purpose-built, monolithic ("shrink wrapped") code and products to a tightly federated collection of microservices that are both modular are reusable. It's as if app developers moved to using a common set of Lego blocks to build any number of web-based apps only limited by their imagination. For networking teams, however, the move to microservice-app development meant that the existing assumptions around traffic patterns, load-balancing scale, and service requirements went out the window, requiring far greater levels of network-wide intelligence.

Three, the wide adoption of connected mobile devices has made anticipating where and when people were accessing applications a completely unpredictable exercise.

These megatrends pose disruptive impact for legacy ADC vendors because they tend to undermine the core value proposition of hardware, appliance-based products. That is, the hallmark of the vendors who led in this space was their ability to build high-performance gear and their intimate familiarity of monolithic apps - think SAP, Oracle, Microsoft, etc. But mobile computing and microservice-based apps requires load balancing capable of providing holistic network intelligence and the ability to co-locate these critical services directly with the microservices themselves (aka "application affinity") - whether they reside in the cloud or on-prem. For these requirements, we believe that the most logical form factor is software-based delivered as VMs or even containers.

Facebook, a company who helped drive these technology transformations, argued for these very principles the introduction of its homegrown Autoscale load balancer, which it positioned as a more efficient and intelligent way to deliver these network services. To achieve this engineering milestone, Facebook dedicated dozens of engineers, a luxury most enterprises cannot afford. But for Facebook, building a custom load balancer/ADC for its limited and specific set of applications was the only way it could guarantee end-user experience as well as optimize its compute resources at the levels its hyperscale environment required.

The opportunity now exists to build a next-generation ADC for mainstream enterprises who typically manage hundreds of different applications compared to one or two that a Web 2.0 company might. We believe this requires fundamentally rearchitecting what an ADC is and how it's delivered. Specifically, we believe the next-gen architecture requires:

  • A true separation of the control and data plane. We believe that SDN has been hindered in some way by "SDN-light" or "SDN-like" approaches by vendors that have simply taken the software running on their hardware appliances and squeezed them into VMs that never separated the data plane from the control plane. To support a true multi-cloud environment, the architecture requires an elastically scalable, load-balancer with a distributed data plane that casn span, serve and scale with apps across various on-premise and cloud locations. The distributed data plane enables customers to achieve application affinity at the application microservice levels thereby dramatically improving application performance. In addition, the clean separation of planes also enables the creation of a unified, centralized control plane, which significantly alleviates the operational complexity associated with integrating, operating and managing each ADC appliance across locations individually.
  • Holistic, in-line big data analytics that deliver real-time user, application and network performance not possible with the mishmash of offline/out-of-band monitoring tools currently available in the marketplace. I've already argued that the load balancer or ADC occupies the enviable, strategic location between the infrastructure and the end-user. Why not take advantage of this by delivering powerful performance insights and other KPI important to network operators, application admins, and DevOps teams? Further, real-time, in-line information can make the network smarter over time and enable it to automate, influence certain feature activation and resource scaling without human intervention, or what I refer to as "insight-to-action"

Now imagine that same Black Friday or Cyber Monday scenario but this time with a next-generation analytics and SDN-enabled ADC. Online traffic spikes from users all over the world using a myriad of connected devices. The network infrastructure is now intelligent enough to spin up new resources in a moment's notice to boost capacity and performance dynamically wherever required, as well as arbitrating the load efficiently throughout the data center. Further, with Big Data analytics, the network will eventually be able to make predictive decisions based on historical traffic, usage patterns unique to that environment such as online retailers and the holiday shopping season. This is not only possible today, we believe it's the mandate for where networking and, specifically, what ADCs must deliver.

More Stories By Umesh Mahajan

Umesh Mahajan is CEO and co-founder of Avi Networks. A seasoned executive and entrepreneur with 25+ years of experience in tech industry, he has helped develop the vision, strategy, and execution plan for several innovative technology products.

Before co-founding Avi Networks, Umesh was the Vice President / General Manager for a $2B Data Center switching business at Cisco where he led engineering, product management, marketing and operations for Nexus 7000, MDS switching products, and the NX-OS operating system.

Prior to his work at Cisco, Umesh led the software team at Andiamo in architecting and delivering SAN-OS. Umesh has a Master of Science degree in computer science from Duke, a Bachelor of Science degree from IIT Delhi, and has 29 patents to date.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
"Once customers get a year into their IoT deployments, they start to realize that they may have been shortsighted in the ways they built out their deployment and the key thing I see a lot of people looking at is - how can I take equipment data, pull it back in an IoT solution and show it in a dashboard," stated Dave McCarthy, Director of Products at Bsquare Corporation, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
20th Cloud Expo, taking place June 6-8, 2017, at the Javits Center in New York City, NY, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy.
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effici...
Fact is, enterprises have significant legacy voice infrastructure that’s costly to replace with pure IP solutions. How can we bring this analog infrastructure into our shiny new cloud applications? There are proven methods to bind both legacy voice applications and traditional PSTN audio into cloud-based applications and services at a carrier scale. Some of the most successful implementations leverage WebRTC, WebSockets, SIP and other open source technologies. In his session at @ThingsExpo, Da...
"IoT is going to be a huge industry with a lot of value for end users, for industries, for consumers, for manufacturers. How can we use cloud to effectively manage IoT applications," stated Ian Khan, Innovation & Marketing Manager at Solgeniakhela, in this SYS-CON.tv interview at @ThingsExpo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
As data explodes in quantity, importance and from new sources, the need for managing and protecting data residing across physical, virtual, and cloud environments grow with it. Managing data includes protecting it, indexing and classifying it for true, long-term management, compliance and E-Discovery. Commvault can ensure this with a single pane of glass solution – whether in a private cloud, a Service Provider delivered public cloud or a hybrid cloud environment – across the heterogeneous enter...
The cloud promises new levels of agility and cost-savings for Big Data, data warehousing and analytics. But it’s challenging to understand all the options – from IaaS and PaaS to newer services like HaaS (Hadoop as a Service) and BDaaS (Big Data as a Service). In her session at @BigDataExpo at @ThingsExpo, Hannah Smalltree, a director at Cazena, provided an educational overview of emerging “as-a-service” options for Big Data in the cloud. This is critical background for IT and data professionals...
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
@GonzalezCarmen has been ranked the Number One Influencer and @ThingsExpo has been named the Number One Brand in the “M2M 2016: Top 100 Influencers and Brands” by Onalytica. Onalytica analyzed tweets over the last 6 months mentioning the keywords M2M OR “Machine to Machine.” They then identified the top 100 most influential brands and individuals leading the discussion on Twitter.
What happens when the different parts of a vehicle become smarter than the vehicle itself? As we move toward the era of smart everything, hundreds of entities in a vehicle that communicate with each other, the vehicle and external systems create a need for identity orchestration so that all entities work as a conglomerate. Much like an orchestra without a conductor, without the ability to secure, control, and connect the link between a vehicle’s head unit, devices, and systems and to manage the ...
More and more brands have jumped on the IoT bandwagon. We have an excess of wearables – activity trackers, smartwatches, smart glasses and sneakers, and more that track seemingly endless datapoints. However, most consumers have no idea what “IoT” means. Creating more wearables that track data shouldn't be the aim of brands; delivering meaningful, tangible relevance to their users should be. We're in a period in which the IoT pendulum is still swinging. Initially, it swung toward "smart for smar...
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and G...
Information technology is an industry that has always experienced change, and the dramatic change sweeping across the industry today could not be truthfully described as the first time we've seen such widespread change impacting customer investments. However, the rate of the change, and the potential outcomes from today's digital transformation has the distinct potential to separate the industry into two camps: Organizations that see the change coming, embrace it, and successful leverage it; and...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...
20th Cloud Expo, taking place June 6-8, 2017, at the Javits Center in New York City, NY, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy.
Internet of @ThingsExpo, taking place June 6-8, 2017 at the Javits Center in New York City, New York, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. @ThingsExpo New York Call for Papers is now open.
"ReadyTalk is an audio and web video conferencing provider. We've really come to embrace WebRTC as the platform for our future of technology," explained Dan Cunningham, CTO of ReadyTalk, in this SYS-CON.tv interview at WebRTC Summit at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Everyone knows that truly innovative companies learn as they go along, pushing boundaries in response to market changes and demands. What's more of a mystery is how to balance innovation on a fresh platform built from scratch with the legacy tech stack, product suite and customers that continue to serve as the business' foundation. In his General Session at 19th Cloud Expo, Michael Chambliss, Head of Engineering at ReadyTalk, discussed why and how ReadyTalk diverted from healthy revenue and mor...
Extracting business value from Internet of Things (IoT) data doesn’t happen overnight. There are several requirements that must be satisfied, including IoT device enablement, data analysis, real-time detection of complex events and automated orchestration of actions. Unfortunately, too many companies fall short in achieving their business goals by implementing incomplete solutions or not focusing on tangible use cases. In his general session at @ThingsExpo, Dave McCarthy, Director of Products...
You have great SaaS business app ideas. You want to turn your idea quickly into a functional and engaging proof of concept. You need to be able to modify it to meet customers' needs, and you need to deliver a complete and secure SaaS application. How could you achieve all the above and yet avoid unforeseen IT requirements that add unnecessary cost and complexity? You also want your app to be responsive in any device at any time. In his session at 19th Cloud Expo, Mark Allen, General Manager of...