Welcome!

Linux Containers Authors: Pat Romanski, Elizabeth White, Miska Kaipiainen, Automic Blog, Darren Anstee

Related Topics: Linux Containers

Linux Containers: Article

Managing an Open Source Application Stack with Aduva OnStage

A user case study

One of the most serious problems facing larger organizations considering using Linux and Open Source application stacks is managing the software environment.

The basic Linux system has adequate tools to manage a single machine, or even a small group of machines, but once the population of these machines reaches into the tens and hundreds and spreads across multiple application areas and multiple locations the management task becomes harder.

When the complete system configuration includes items not directly supported by the Linux distribution, the tools provided with the system are often not enough.

Management tasks that become non-trivial for larger installations typically are:

  • Configuration management: In larger deployments it's usual to have multiple defined configurations, each specific to a given task. Each configuration will typically have loaded only those components required for the task for which the configuration is defined, and configuration parameters in various files defined to tune the system to its specific class of task.
  • Application deployment: New application deployment, or an upgrade of an existing application, in itself not typically a difficult task, can have implications for other parts of the system if any changes to the configuration are required due to dependency requirements of the new/upgraded application. Usually not particularly difficult to manage when the application is one directly supported by the Linux distribution vendor, which will ensure that dependencies are met without disrupting the rest of the system, but potentially much more complex when it's not directly supported.
  • Loading the software on to multiple (potentially hundreds) of machines, often having to take into account factors such as performing the task when no user is present, stopping and starting system services, and possibly needing to reboot the system if any OS components are modified.
In this article, we take a look at how one large user of Linux systems handles these problems with Aduva OnStage.

Jefferson County in Colorado makes heavy use of Linux where F/OSS makes good sense. With around 60 servers to manage, the systems administrator Jeff Falgout and the team of systems engineers that he leads need all the help they can get in automating and managing configurations used for multiple purposes.

The servers run mainly Red Hat Linux 8, with a small number of SuSE servers thrown into the mix, but are slowly transitioning to Red Hat ES and AS. The application stack includes Novell e-Directory and some test installations of Fedora Directory Server (the ex-Netscape/AOL directory server closely related to Sun's JES directory server). Other services include e-mail with sendmail and SpamAssassin in conjunction with mail-scanner providing spam and virus filtering. These provide front-end filtering and routing for Novell GroupWise. Apache Web servers are used in conjunction with Tomcat application servers. Proxying/caching of user Web access is covered by Squid with appropriate anti-virus components installed. Add in a few in-house developed applications and the result is a very capable software stack, but one that if not managed correctly could give any systems administrator, as well as the IT manager, sleepless nights.

Using Aduva OnStage to manage these configurations takes a lot of the hard work out of the process and lets Jeff sleep comfortably at night.

Jeff has few worries about those components supported in the base distribution of any of the systems. With the focus that Aduva puts on the base Linux distributions, the Aduva KnowlegeBase, which OnStage depends on to ensure that all dependency requirements are met correctly, faithfully tracks the changes that distributions make as new revisions of various components are released and, especially importantly, as security issues arise. The Aduva KnowlegeBase contains all the required information to keep distributions up-to-date, avoiding known security issues or warning where avoidance might not be possible with currently available packages, while maintaining correct dependencies throughout the system.

The tracking between the Aduva KnowlegeBase and the Linux distributors' own dependency/update systems is so good that Jeff feels comfortable using them interchangeably, but in practice uses OnStage as a replacement for Linux distributors tools, such as Red Hat's to maintain a complete and accurate record of the current state of every machine. On systems that have the Red Hat applet that warns that there are system updates available from Red Hat, the applet will occasionally show red, indicating pending updates, but after the next run of OnStage, those same applets will once again show green, illustrating the close tracking between OnStage and the Linux distribution's own systems.

For stack components not directly handled in distribution base systems, Jefferson County maintains its own private extension to the KnowlegeBase, containing information on dependency requirements of those components and a repository of the RPMs containing them. All the in-house applications are managed this way, as is Tomcat, which is not part of the Red Hat base system and so not automatically included in the Aduva KnowlegeBase for Red Hat.

OnStage handles the configuration management and automatic updates of components in that configuration as they become available. Not only are system and application binaries managed, so are the various associated configuration files. OnStage can be used to build a system "from bare metal" based on any one of these configurations, or for the transformation of a system in one configuration to another. Changes are recorded and, if required, can be backed out very simply. Configurable rules can be used to schedule updates to specific machine groups and can take account of requirements such as waiting until there's no user and doing a system reboot at the end.

The ability to clone a configuration on a machine is something that Jeff uses when major updates have to be tested. The new configuration can be tested and tuned, then that identical configuration is applied to specific groups of machines once testing is complete. OnStage uses the KnowlegeBase, both the central Aduva copy and Jefferson County's own, to determine exactly which packages to remove and which to install to ensure that existing systems end up being identical to the staging/test system(s).

When asked if he trusted OnStage enough to consider skipping the verification staging build of significant changes before deployment, Jeff responded like any systems administrator faced with applying untested patches to many production system would, saying, "No, I have faith in the system, but not that much!" Then after reflection, he added, "Actually, we do allow the system updates to go straight through without testing and have never has any issues, so I guess I do trust it after all."

More Stories By Philip Peake

Philip Peake is a professional services consultant, and has worked for a variety of companies including Netscape, AOL, Sun Microsystems and OSDL.
With over 25 years experience of UNIX based systems in Internet and
Intranet enterprise environments, using Linux has been a natural evolution.
Philip has a Batchelor of Science degree in computer science from
the University of Keele in the United Kingdom.

Comments (3) View Comments

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Most Recent Comments
Fraser Campbell 01/13/06 01:09:18 PM EST

Hi Philip,

I am in a position where we have 100s of SuSE servers and that number is expected to grow by leaps and bounds as virtualization begins to take hold.

I agree that higher level management tools are critical to managing this infrastructure.

I am curious as to what tools you may have used yourself, have you for example considered cfengine. My bias is weighted heavily towards open source tools despite the fact that we are using SLES servers.

news desk 12/27/05 11:43:26 PM EST

One of the most serious problems facing larger organizations considering using Linux and Open Source application stacks is managing the software environment. The basic Linux system has adequate tools to manage a single machine, or even a small group of machines, but once the population of these machines reaches into the tens and hundreds and spreads across multiple application areas and multiple locations the management task becomes harder.

news desk 12/27/05 11:32:19 PM EST

One of the most serious problems facing larger organizations considering using Linux and Open Source application stacks is managing the software environment. The basic Linux system has adequate tools to manage a single machine, or even a small group of machines, but once the population of these machines reaches into the tens and hundreds and spreads across multiple application areas and multiple locations the management task becomes harder.

@ThingsExpo Stories
SYS-CON Events announced today that Pulzze Systems will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Pulzze Systems, Inc. provides infrastructure products for the Internet of Things to enable any connected device and system to carry out matched operations without programming. For more information, visit http://www.pulzzesystems.com.
If you’re responsible for an application that depends on the data or functionality of various IoT endpoints – either sensors or devices – your brand reputation depends on the security, reliability, and compliance of its many integrated parts. If your application fails to deliver the expected business results, your customers and partners won't care if that failure stems from the code you developed or from a component that you integrated. What can you do to ensure that the endpoints work as expect...
The Internet of Things can drive efficiency for airlines and airports. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Sudip Majumder, senior director of development at Oracle, will discuss the technical details of the connected airline baggage and related social media solutions. These IoT applications will enhance travelers' journey experience and drive efficiency for the airlines and the airports. The session will include a working demo and a technical d...
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management solutions, helping companies worldwide activate their data to drive more value and business insight and to transform moder...
The Transparent Cloud-computing Consortium (abbreviation: T-Cloud Consortium) will conduct research activities into changes in the computing model as a result of collaboration between "device" and "cloud" and the creation of new value and markets through organic data processing High speed and high quality networks, and dramatic improvements in computer processing capabilities, have greatly changed the nature of applications and made the storing and processing of data on the network commonplace.
SYS-CON Events announced today that Bsquare has been named “Silver Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. For more than two decades, Bsquare has helped its customers extract business value from a broad array of physical assets by making them intelligent, connecting them, and using the data they generate to optimize business processes.
I'm a lonely sensor. I spend all day telling the world how I'm feeling, but none of the other sensors seem to care. I want to be connected. I want to build relationships with other sensors to be more useful for my human. I want my human to understand that when my friends next door are too hot for a while, I'll soon be flaming. And when all my friends go outside without me, I may be left behind. Don't just log my data; use the relationship graph. In his session at @ThingsExpo, Ryan Boyd, Engi...
Fact is, enterprises have significant legacy voice infrastructure that’s costly to replace with pure IP solutions. How can we bring this analog infrastructure into our shiny new cloud applications? There are proven methods to bind both legacy voice applications and traditional PSTN audio into cloud-based applications and services at a carrier scale. Some of the most successful implementations leverage WebRTC, WebSockets, SIP and other open source technologies. In his session at @ThingsExpo, Da...
Almost two-thirds of companies either have or soon will have IoT as the backbone of their business in 2016. However, IoT is far more complex than most firms expected. How can you not get trapped in the pitfalls? In his session at @ThingsExpo, Tony Shan, a renowned visionary and thought leader, will introduce a holistic method of IoTification, which is the process of IoTifying the existing technology and business models to adopt and leverage IoT. He will drill down to the components in this fra...
The vision of a connected smart home is becoming reality with the application of integrated wireless technologies in devices and appliances. The use of standardized and TCP/IP networked wireless technologies in line-powered and battery operated sensors and controls has led to the adoption of radios in the 2.4GHz band, including Wi-Fi, BT/BLE and 802.15.4 applied ZigBee and Thread. This is driving the need for robust wireless coexistence for multiple radios to ensure throughput performance and th...
Enterprise IT has been in the era of Hybrid Cloud for some time now. But it seems most conversations about Hybrid are focused on integrating AWS, Microsoft Azure, or Google ECM into existing on-premises systems. Where is all the Private Cloud? What do technology providers need to do to make their offerings more compelling? How should enterprise IT executives and buyers define their focus, needs, and roadmap, and communicate that clearly to the providers?
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
There is little doubt that Big Data solutions will have an increasing role in the Enterprise IT mainstream over time. Big Data at Cloud Expo - to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA - has announced its Call for Papers is open. Cloud computing is being adopted in one form or another by 94% of enterprises today. Tens of billions of new devices are being connected to The Internet of Things. And Big Data is driving this bus. An exponential increase is...
Digital innovation is the next big wave of business transformation based on digital technologies of which IoT and Big Data are key components, For example: Business boundary innovation is a challenge to excavate third-party business value using IoT and BigData, like Nest Business structure innovation may propose re-building business structure from scratch, as Uber does in the taxicab industry The social model innovation is also a big challenge to the new social architecture with the design fr...
DevOps at Cloud Expo, taking place Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long dev...
Data is an unusual currency; it is not restricted by the same transactional limitations as money or people. In fact, the more that you leverage your data across multiple business use cases, the more valuable it becomes to the organization. And the same can be said about the organization’s analytics. In his session at 19th Cloud Expo, Bill Schmarzo, CTO for the Big Data Practice at EMC, will introduce a methodology for capturing, enriching and sharing data (and analytics) across the organizati...
IoT is fundamentally transforming the auto industry, turning the vehicle into a hub for connected services, including safety, infotainment and usage-based insurance. Auto manufacturers – and businesses across all verticals – have built an entire ecosystem around the Connected Car, creating new customer touch points and revenue streams. In his session at @ThingsExpo, Macario Namie, Head of IoT Strategy at Cisco Jasper, will share real-world examples of how IoT transforms the car from a static p...
The many IoT deployments around the world are busy integrating smart devices and sensors into their enterprise IT infrastructures. Yet all of this technology – and there are an amazing number of choices – is of no use without the software to gather, communicate, and analyze the new data flows. Without software, there is no IT. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists will look at the protocols that communicate data and the emerging data analy...
SYS-CON Events announced today that China Unicom will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. China United Network Communications Group Co. Ltd ("China Unicom") was officially established in 2009 on the basis of the merger of former China Netcom and former China Unicom. China Unicom mainly operates a full range of telecommunications services including mobile broadband (GSM, WCDMA, LTE F...
Video experiences should be unique and exciting! But that doesn’t mean you need to patch all the pieces yourself. Users demand rich and engaging experiences and new ways to connect with you. But creating robust video applications at scale can be complicated, time-consuming and expensive. In his session at @ThingsExpo, Zohar Babin, Vice President of Platform, Ecosystem and Community at Kaltura, will discuss how VPaaS enables you to move fast, creating scalable video experiences that reach your...