Welcome!

Linux Containers Authors: Liz McMillan, Vaibhaw Pandey, Elizabeth White, Pat Romanski, Yeshim Deniz

Related Topics: @DevOpsSummit, Linux Containers, Containers Expo Blog

@DevOpsSummit: Article

Can Wire Data Be #APM? | @DevOpsSummit #DevOps #AI #ML #Monitoring

In general terms APM is simply 'the monitoring and management of the performance and availability of software applications'

Can Wire Data Be APM?

I recently read something – a blog, a tweet, a LinkedIn article perhaps – describing the use of wire data to analyze application performance. I remember that the author’s use of the term “APM” in this context caused one reader to comment, complaining that “you can’t call wire data APM.” This was around the same time I referred casually to Dynatrace’s wire data offering (Data Center Real User Monitoring, or DC RUM) as both “APM for IT Operations” and “probe-based APM.” So that complaint has stuck with me, prompting me to ask – and offer an answer to – the question.

It depends, of course, on answers to related questions. How do you define APM? What role does APM play in your organization? What APM insights can wire data provide? Let’s take a brief look at each of these.

What is APM to you?
In very general terms (Wikipedia is great for this), APM is simply “the monitoring and management of the performance and availability of software applications.” This is accomplished by measuring user response times, transaction volume (load), and resource consumption, with correlation to help identify system bottlenecks. But of course that description is too vague to be of much practical use. For more depth and breadth, we can turn to Gartner’s recent update to its 2010 definition of APM. Collapsed from the original five, Gartner now identifies three functional dimensions. In brief, these are:

  1. Digital experience monitoring – understanding the availability and performance of real and synthetic users.
  2. Application discovery, tracing and diagnostics – discovering application services, tracing transactions through the infrastructure, and deep insight into code execution. (This new dimension used to be three separate but interlinked dimensions.)
  3. Application analytics – automating the isolation and analysis of performance bottlenecks and fault domains.

Beyond the helpful simplification of the dimensions, there’s another interesting change to Gartner’s definition; it now explicitly calls out requirements for specific technology platforms. Included are web and mobile, HTTP, Java and .NET; by omission, all others are excluded.

“Traditional” APM architectures
To some degree, this narrowing (or perhaps clarification) of APM’s scope to focus to web stacks reflects a general market reality, if not a vendor-driven market definition; every APM vendor supports these stacks, and most don’t venture far beyond. The standardization and openness of these platforms encouraged development of compelling solutions to meet the monitoring needs of modern customer-facing web applications. Whether an offering’s pedigree can be traced to development tools or production monitoring, there’s no doubt that the performance visibility and diagnostic insights have helped many IT organizations modernize their operations, enable DevOps initiatives, and accelerate the shift from providing infrastructure and capacity to delivering business-oriented application services.

At least for mission-critical web apps.

Mission critical? Or vendor critical?
There’s a disconnect, however, that one of my colleagues helpfully calls “the myth of mission critical.” I see that myth as having two facets.

First, at a high level, it implies that some apps are not critical, and therefore don’t warrant monitoring. Maybe it’s a matter of degree – critical vs. important. But if an application isn’t at least important, why do you still have it? And if it is important, shouldn’t you be monitoring it?

The second facet is vendor-driven; APM vendors have steered the mission-critical discussion to web apps, the “apps of engagement” that are revenue-producing for many businesses. Distilling the messaging, one might conclude that “web apps are mission-critical; non-web apps are not.” This sounds like a spin on Maslow’s law of the hammer, illustrated nicely by Grace Witherell: “When all you have is a hammer, only nails are problems.”

I’d venture to say that your Oracle EBS and Forms-based apps, your SAP ERP applications, your Epic EHR and other custom thick-client applications that might be delivered via Citrix, all running core parts of your business – these and many others like them are probably critical as well.

But these “other” (i.e., non-web) apps run on a diverse set of often proprietary or closed platforms, without the instrumentation interfaces that have facilitated agent-based APM solutions for Java and .NET.

APM for IT operations
APM solutions often – always, maybe – support many user roles. Gartner’s recent Magic Quadrant for APM suggests that in a few years, only 30% of APM buyers will be in IT operations, down from 60% today; most of the other buyers will be application support and development. This doesn’t reflect a loss of interest on the part of IT operations, but rather an expanding audience of stakeholders – some of whom will have diverging interests.

One dominant example of these different interests is reflected in the need for code-level insight, a component of the second of the three APM dimensions. Application development and support teams likely need this, at least for applications built or customized and maintained in-house. But for IT operations teams, code-level insight may be less of a priority; common operational goals such as meeting service quality SLAs, reducing MTTR, and controlling costs can be easily accomplished by other APM capabilities. And the lack of code-level monitoring doesn’t preclude effective DevOps collaboration; inter-tier transaction monitoring and parameter capture help fill the gap.

Wire data
Wire data simply refers to an approach to gathering information – about performance, availability, usage, security, users, applications, networks, and much more. The type of information and the resulting value depends on the analytics applied to the data. Unlike agent technology, however, wire data is platform agnostic, unconcerned with the source application architecture. Instead, wire data relies on protocol decodes to be relevant. First tier examples include HTTP, SAPGUI, Oracle Forms, Epic, and Citrix ICA, while back end examples include SOAP, various forms of SQL, WebSphere MQ, CORBA, and more.

Analytics transforms this interpreted wire data into useful insights, and at Dynatrace, we’ve built a wire data analytics platform (DC RUM) that focuses on delivering application and user performance insights – in fact, mirroring many of the core capabilities defined by Gartner’s APM dimensions. These include:

  • EUE monitoring to help prioritize IT actions based on business impact
  • Automatic discovery to maintain visibility in increasingly dynamic environments
  • Automatic identification of users, transaction names and parameters
  • Robust analytics to automatically isolate fault domains and break out response time components
  • Detailed analysis of network performance and its impact on user experience

For an expansion of these wire data capabilities, you can read my blog “Where APM Agents Fear to Tread.”

In fact, the primary limitation of a wire data approach to APM might simply be the lack of code-level insights; in its place, however, wire data can offer enhanced network infrastructure visibility as well as enterprise-wide application coverage; for IT operations teams, that’s often a reasonable – if not desirable – tradeoff.

A positive-sum game
In the end, however, this isn’t a zero-sum game. Real benefits can be achieved through multiple perspectives of performance. An agent’s inside-out perspective – with deep code-level insights – gains new insights with the outside-in perspective of wire data, with its greater network awareness. The point is not to argue the merits of a specific collection technology, but to offer a multi-faceted solution that meets the needs of multiple stakeholders by covering your entire application portfolio.

At Dynatrace, we’re redefining monitoring to mean every user, every app, everywhere. This doesn’t mean separate products for different environments; it means a unified and modular AI-driven solution that offers comprehensive coverage for enterprise, web and newstack environments.

So, can wire data be APM? Some APM vendors want to argue that it can’t, but it might be that they’ve got only hammers to sell.

The post Can wire data be APM? appeared first on Dynatrace blog – monitoring redefined.

More Stories By Gary Kaiser

Gary Kaiser is a Subject Matter Expert in Network Performance Analytics at Dynatrace, responsible for DC RUM’s technical marketing programs. He is a co-inventor of multiple performance analysis features, and continues to champion the value of network performance analytics. He is the author of Network Application Performance Analysis (WalrusInk, 2014).

@ThingsExpo Stories
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...