Welcome!

Linux Containers Authors: Liz McMillan, Pat Romanski, Lori MacVittie, Roger Strukhoff, Elizabeth White

Related Topics: Linux Containers

Linux Containers: Article

TCO Comparisons: The Real Story

How to really read an analyst's report

There has been some controversy recently over a Microsoft-commissioned TCO (total cost of ownership) study claiming that the long-term cost of Windows is lower than that of Linux. It's time to clear up the confusion.

TCO Primer

Let's start with the basics of TCO. When we talk about measuring the total cost of ownership, it is important to understand what that measurement will actually tell us. TCO is defined as the total cost of a particular item over its useful life. It includes the cost of acquisition, maintenance, support, and disposal. In short, it includes everything you will ever spend on the item, and is useful for understanding future costs that may not be apparent at the time of deployment.

In theory, calculating TCO is easy. Simply add up all the expected costs over the life of the item you are measuring. In practice, however, this can be a little tricky, which is why most organizations don't actually track TCO. A number of factors are typically included in TCO calculations, including hardware costs, software licensing, initial costs to deploy, purchased support contracts, staffing costs, and additional overhead. The following is an overview of the TCO?process:

  • Plan to calculate for each class of system (file server, Internet-related server, desktop, etc.)
  • Determine hardware costs
  • Determine software licensing costs
  • Determine deployment costs (outsourced deployment, for example)
  • Determine support costs, extend to expected life of system
  • Determine staffing costs to maintain system
    -Determine number of staff supporting system
    -Determine hourly costs based on salaries
    -Determine percentage of time spent supporting system
    -Determine total number of staffing hours over expected life of system
    -Calculate dollar value of total staffing hours
  • Determine any additional costs for overhead
  • Add it all up
Some items on the list are fairly straightforward, such as hardware, software, and support contract costs. Staffing costs can be trickier, especially if your company doesn't have experience with the new technologies. If it were easy, of course, everyone would routinely calculate TCO figures. But it's important to at least have an idea of what's involved.

The Analysts' TCO Comparisons

There have been just a few studies of the TCO for Linux, all looking at costs for servers. An independent study, "Total Cost of Ownership for Linux in the Enterprise," conducted in 2002 by the Robert Francis Group, compared the total costs of enterprise Web servers on Linux, Windows, and Solaris. Data was drawn from actual experiences of interview participants. They found that the three-year total cost of Linux was two and half times cheaper than Windows, and seven and a half times cheaper than Solaris. One reason Linux was cheaper was its reliability. Respondents reported that security patches and accompanying server reboots took longer to administer on Windows, requiring more staff. Another reason was a reduced effort in responding to viruses and Internet worms. According to the survey, the ratio of administrator to server was 44 systems per Linux administrator, and 10 systems per Windows administrator. Average salaries for Linux administrators were about 4% higher than for Windows administrators, and about 20% lower than for Solaris administrators. Taking these factors into account, the staffing costs of Linux were less than one fourth the staffing costs for Windows. Again, this data came from asking interview participants about their already-deployed systems, and so involved real-world experiences rather than speculation.

IDC released a similar study in 2003 comparing Linux and Unix. Sponsored by Red Hat, "Linux and Intel-Based Servers: A Powerful Combination to Reduce the Cost of Enterprise Computing" was based on an earlier report that surveyed 142 companies about costs associated with Linux and RISC/Unix servers. No comparison was made with Windows in this study. IDC found that the TCO of Linux was a little more than half that of Unix for Internet/intranet workloads, and about one fifth that of Unix for collaborative workloads. IDC defined "collaborative workloads" as e-mail, group calendaring/scheduling, shared folders/databases, threaded discussions, and custom application development. The calculations did not include support contracts for hardware or software, but these costs are likely to be higher for Unix.

Microsoft commissioned a report, also from IDC, on the TCO of Windows versus Linux. This report, "Windows 2000 Versus Linux in Enterprise Computing," is currently being promoted in their "Get the Facts" marketing campaign against Linux. This study examined costs in five workloads: network infrastructure, file serving, print serving, Web serving, and security applications. They found the TCO of Windows to be comparable, or superior (meaning cheaper), to every workload except Web serving. The costs of software were calculated as being higher for Linux than for Windows. Staffing costs were also calculated as being higher for Linux.

The Yankee Group claimed in a recent press release that they have completed a study showing that Linux is "not a low-cost alternative to Unix and Windows for large enterprises." Their analysis is that small firms may benefit from a limited migration to Linux, but that Linux did not bring a measurably improved TCO to large organizations. The Yankee Group did not respond to requests to view the report by the deadline for this article, so the analysis here is based on information provided in the press release.

How Can These Reports Be So Different?

How did these studies arrive at vastly different conclusions? The short answer is that if you are abstract enough with your goals and methodology, are selective with the costs that you include, and ask the right questions, then you can arrive at any conclusion you want. I'll focus on the Linux versus Windows studies, since those are the most controversial.

Abstract Assumptions Don't Translate Well to the Real World

The Yankee Group report claimed that some interviewees reported that "a significant Linux deployment or total switch from Windows to Linux would be three to four times more expensive" than the usual Windows upgrade. Well, duh! There should be little question at this point that the total cost of owning a Linux system can be lower than that of a Windows system, assuming that you do nothing with the machine besides run an operating system. But in the real world, software is required to do work, and there is a great variety of software in use. If your organization requires a collection of disparate Windows-specific applications, for example, then you will have to make a number of changes in order to use Linux instead. You may need to rewrite custom applications, switch vendors of critical systems, retrain users on new systems that are quite different from the old ones, and suffer lower productivity because of awkward choices of replacement open source software. If you were to force these changes, then it is certainly possible that the total cost of those systems over their life cycles would be higher than the status quo given the overall costs to make it work. It is certainly possible to imagine scenarios in which this type of forced conversion would lead to a higher TCO for Linux systems.

The pragmatic approach most organizations take in adopting Linux and open source software is to find those areas where they can use it to gain the most benefit with the least cost and disruption. If you were to blindly convert your entire operation to Linux and open source software, you would save money in some places, but potentially at a great cost and disruption in other places. But let's be realistic - no one indiscriminately replaces one technology with another one wholesale. It was an unrealistic question that produced a meaningless and misleading result.

Real-World Data Is More Valuable than Opinion

It also makes a big difference whether the data was collected from real-world experiences of interviewees or from opinion. In the Robert Frances Group study, interviewees supplied all the data from actual field experiences. In the Microsoft-sponsored IDC study, the methodology is less clear. After several readings of the document, it appears to this author that 100 different North American companies were interviewed to help establish the assumptions that would drive the TCO calculations. In other words, the actual data appears to be at least partially generated, not gathered from field experience.

It should also be noted that this study claimed (in the front page "IDC Opinion" abstract) that "the cost advantages are driven primarily by Windows' significantly lower costs for IT staffing." It is unclear from the methodology description how the staffing costs were calculated. In any case, the results are in dramatic opposition to the data gathered by the Robert Frances Group from practitioners with active deployments.

Omissions Can Make the Data Unrealistic in Practice

In the IDC study that Microsoft is promoting in its "Get the Facts" campaign, suspicious omissions make the data unrealistic for most organizations. When the five-year costs are calculated for each workload, a load of 100 end users is used. The software costs are not broken down, but it is clear that Client Access Licenses (CALs) cannot possibly be included. Perhaps IDC considered them to be a part of the client operating system costs, even though they are required for Windows but not for Linux. This is a very important point because at about $800 per 25 users, the CALs really add up. This means that if you have 400 users instead of the calculated 100, you are adding about $9,600 to the software costs, clearly a significant figure. The apparent omission of the required Client Access Licenses is misleading.

What to Look for in a Study

How do you know who to believe? If you're going to follow the advice in an analyst report, then read the document and ask yourself these questions:
  • Were the interviews based on experience or guessing?
  • Was there actual data from real-world settings?
  • Are cost estimates realistic and inclusive?
  • Do the authors sufficiently describe their methodology so that I can understand how they arrived at the data?
If you're going to follow advice from analysts then read the reports and look for signs of solid methodology and independence in the research. Think about the advice you are being offered, and decide for yourself if it's helpful or not. As you can see, there is a wide discrepancy in the available analyses.

References

  • The Robert Frances Group, "Total Cost of Ownership for Linux in the Enterprise," 2002.
  • IDC, "Linux and Intel-Based Servers: A Powerful Combination to Reduce the Cost of Enterprise Computing," 2003.
  • IDC, "Windows 2000 Versus Linux in Enterprise Computing," 2002.
  • The Yankee Group, "Linux Not A Low-Cost Alternative to Unix and Windows for Large Enterprises, says the Yankee Group," 4/5/04 press release.

    Adapted from Manager's Guide to Open Source Manning Publications, summer 2004.

  • More Stories By Maria Winslow

    Maria Winslow is the author of The Practical Manager's Guide to Open Source, available at http://www.lulu.com/practicalGuide and can be contacted at [email protected]

    Comments (0)

    Share your thoughts on this story.

    Add your comment
    You must be signed in to add a comment. Sign-in | Register

    In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


    @ThingsExpo Stories
    In his session at @ThingsExpo, Kausik Sridharabalan, founder and CTO of Pulzze Systems, Inc., will focus on key challenges in building an Internet of Things solution infrastructure. He will shed light on efficient ways of defining interactions within IoT solutions, leading to cost and time reduction. He will also introduce ways to handle data and how one can develop IoT solutions that are lean, flexible and configurable, thus making IoT infrastructure agile and scalable.
    SYS-CON Events announced today that Numerex Corp, a leading provider of managed enterprise solutions enabling the Internet of Things (IoT), will exhibit at the 19th International Cloud Expo | @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Numerex Corp. (NASDAQ:NMRX) is a leading provider of managed enterprise solutions enabling the Internet of Things (IoT). The Company's solutions produce new revenue streams or create operating...
    In his general session at 18th Cloud Expo, Lee Atchison, Principal Cloud Architect and Advocate at New Relic, discussed cloud as a ‘better data center’ and how it adds new capacity (faster) and improves application availability (redundancy). The cloud is a ‘Dynamic Tool for Dynamic Apps’ and resource allocation is an integral part of your application architecture, so use only the resources you need and allocate /de-allocate resources on the fly.
    Fifty billion connected devices and still no winning protocols standards. HTTP, WebSockets, MQTT, and CoAP seem to be leading in the IoT protocol race at the moment but many more protocols are getting introduced on a regular basis. Each protocol has its pros and cons depending on the nature of the communications. Does there really need to be only one protocol to rule them all? Of course not. In his session at @ThingsExpo, Chris Matthieu, co-founder and CTO of Octoblu, walk you through how Oct...
    IoT is fundamentally transforming the auto industry, turning the vehicle into a hub for connected services, including safety, infotainment and usage-based insurance. Auto manufacturers – and businesses across all verticals – have built an entire ecosystem around the Connected Car, creating new customer touch points and revenue streams. In his session at @ThingsExpo, Macario Namie, Head of IoT Strategy at Cisco Jasper, will share real-world examples of how IoT transforms the car from a static p...
    Web Real-Time Communication APIs have quickly revolutionized what browsers are capable of. In addition to video and audio streams, we can now bi-directionally send arbitrary data over WebRTC's PeerConnection Data Channels. With the advent of Progressive Web Apps and new hardware APIs such as WebBluetooh and WebUSB, we can finally enable users to stitch together the Internet of Things directly from their browsers while communicating privately and securely in a decentralized way.
    "My role is working with customers, helping them go through this digital transformation. I spend a lot of time talking to banks, big industries, manufacturers working through how they are integrating and transforming their IT platforms and moving them forward," explained William Morrish, General Manager Product Sales at Interoute, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
    The Internet of Things can drive efficiency for airlines and airports. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Sudip Majumder, senior director of development at Oracle, will discuss the technical details of the connected airline baggage and related social media solutions. These IoT applications will enhance travelers' journey experience and drive efficiency for the airlines and the airports. The session will include a working demo and a technical d...
    Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy, and unified standards are a few key issues. In addition, each IoT product is comprised of (at least) three separate application components: the software embedded in the device, the back-end service, and the mobile application for the end user’s controls. Each component is developed by a different team, using different technologies and practices, and deployed to a different stack/target –...
    Why do your mobile transformations need to happen today? Mobile is the strategy that enterprise transformation centers on to drive customer engagement. In his general session at @ThingsExpo, Roger Woods, Director, Mobile Product & Strategy – Adobe Marketing Cloud, covered key IoT and mobile trends that are forcing mobile transformation, key components of a solid mobile strategy and explored how brands are effectively driving mobile change throughout the enterprise.
    Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
    SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management solutions, helping companies worldwide activate their data to drive more value and business insight and to transform moder...
    SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2016 Silicon Valley. The 19th Cloud Expo and 6th @ThingsExpo will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Interne...
    Personalization has long been the holy grail of marketing. Simply stated, communicate the most relevant offer to the right person and you will increase sales. To achieve this, you must understand the individual. Consequently, digital marketers developed many ways to gather and leverage customer information to deliver targeted experiences. In his session at @ThingsExpo, Lou Casal, Founder and Principal Consultant at Practicala, discussed how the Internet of Things (IoT) has accelerated our abil...
    Digital innovation is the next big wave of business transformation based on digital technologies of which IoT and Big Data are key components, For example: Business boundary innovation is a challenge to excavate third-party business value using IoT and BigData, like Nest Business structure innovation may propose re-building business structure from scratch, as Uber does in the taxicab industry The social model innovation is also a big challenge to the new social architecture with the design fr...
    So, you bought into the current machine learning craze and went on to collect millions/billions of records from this promising new data source. Now, what do you do with them? Too often, the abundance of data quickly turns into an abundance of problems. How do you extract that "magic essence" from your data without falling into the common pitfalls? In her session at @ThingsExpo, Natalia Ponomareva, Software Engineer at Google, provided tips on how to be successful in large scale machine learning...
    If you had a chance to enter on the ground level of the largest e-commerce market in the world – would you? China is the world’s most populated country with the second largest economy and the world’s fastest growing market. It is estimated that by 2018 the Chinese market will be reaching over $30 billion in gaming revenue alone. Admittedly for a foreign company, doing business in China can be challenging. Often changing laws, administrative regulations and the often inscrutable Chinese Interne...
    Data is an unusual currency; it is not restricted by the same transactional limitations as money or people. In fact, the more that you leverage your data across multiple business use cases, the more valuable it becomes to the organization. And the same can be said about the organization’s analytics. In his session at 19th Cloud Expo, Bill Schmarzo, CTO for the Big Data Practice at EMC, will introduce a methodology for capturing, enriching and sharing data (and analytics) across the organizati...
    Internet of @ThingsExpo has announced today that Chris Matthieu has been named tech chair of Internet of @ThingsExpo 2016 Silicon Valley. The 6thInternet of @ThingsExpo will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
    SYS-CON Events announced today that Bsquare has been named “Silver Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. For more than two decades, Bsquare has helped its customers extract business value from a broad array of physical assets by making them intelligent, connecting them, and using the data they generate to optimize business processes.