Welcome!

Linux Containers Authors: Jnan Dash, Eric Robertson, Liz McMillan, Carmen Gonzalez, Elizabeth White

Related Topics: Linux Containers

Linux Containers: Article

Managing an Open Source Application Stack with Aduva OnStage

A user case study

One of the most serious problems facing larger organizations considering using Linux and Open Source application stacks is managing the software environment.

The basic Linux system has adequate tools to manage a single machine, or even a small group of machines, but once the population of these machines reaches into the tens and hundreds and spreads across multiple application areas and multiple locations the management task becomes harder.

When the complete system configuration includes items not directly supported by the Linux distribution, the tools provided with the system are often not enough.

Management tasks that become non-trivial for larger installations typically are:

  • Configuration management: In larger deployments it's usual to have multiple defined configurations, each specific to a given task. Each configuration will typically have loaded only those components required for the task for which the configuration is defined, and configuration parameters in various files defined to tune the system to its specific class of task.
  • Application deployment: New application deployment, or an upgrade of an existing application, in itself not typically a difficult task, can have implications for other parts of the system if any changes to the configuration are required due to dependency requirements of the new/upgraded application. Usually not particularly difficult to manage when the application is one directly supported by the Linux distribution vendor, which will ensure that dependencies are met without disrupting the rest of the system, but potentially much more complex when it's not directly supported.
  • Loading the software on to multiple (potentially hundreds) of machines, often having to take into account factors such as performing the task when no user is present, stopping and starting system services, and possibly needing to reboot the system if any OS components are modified.
In this article, we take a look at how one large user of Linux systems handles these problems with Aduva OnStage.

Jefferson County in Colorado makes heavy use of Linux where F/OSS makes good sense. With around 60 servers to manage, the systems administrator Jeff Falgout and the team of systems engineers that he leads need all the help they can get in automating and managing configurations used for multiple purposes.

The servers run mainly Red Hat Linux 8, with a small number of SuSE servers thrown into the mix, but are slowly transitioning to Red Hat ES and AS. The application stack includes Novell e-Directory and some test installations of Fedora Directory Server (the ex-Netscape/AOL directory server closely related to Sun's JES directory server). Other services include e-mail with sendmail and SpamAssassin in conjunction with mail-scanner providing spam and virus filtering. These provide front-end filtering and routing for Novell GroupWise. Apache Web servers are used in conjunction with Tomcat application servers. Proxying/caching of user Web access is covered by Squid with appropriate anti-virus components installed. Add in a few in-house developed applications and the result is a very capable software stack, but one that if not managed correctly could give any systems administrator, as well as the IT manager, sleepless nights.

Using Aduva OnStage to manage these configurations takes a lot of the hard work out of the process and lets Jeff sleep comfortably at night.

Jeff has few worries about those components supported in the base distribution of any of the systems. With the focus that Aduva puts on the base Linux distributions, the Aduva KnowlegeBase, which OnStage depends on to ensure that all dependency requirements are met correctly, faithfully tracks the changes that distributions make as new revisions of various components are released and, especially importantly, as security issues arise. The Aduva KnowlegeBase contains all the required information to keep distributions up-to-date, avoiding known security issues or warning where avoidance might not be possible with currently available packages, while maintaining correct dependencies throughout the system.

The tracking between the Aduva KnowlegeBase and the Linux distributors' own dependency/update systems is so good that Jeff feels comfortable using them interchangeably, but in practice uses OnStage as a replacement for Linux distributors tools, such as Red Hat's to maintain a complete and accurate record of the current state of every machine. On systems that have the Red Hat applet that warns that there are system updates available from Red Hat, the applet will occasionally show red, indicating pending updates, but after the next run of OnStage, those same applets will once again show green, illustrating the close tracking between OnStage and the Linux distribution's own systems.

For stack components not directly handled in distribution base systems, Jefferson County maintains its own private extension to the KnowlegeBase, containing information on dependency requirements of those components and a repository of the RPMs containing them. All the in-house applications are managed this way, as is Tomcat, which is not part of the Red Hat base system and so not automatically included in the Aduva KnowlegeBase for Red Hat.

OnStage handles the configuration management and automatic updates of components in that configuration as they become available. Not only are system and application binaries managed, so are the various associated configuration files. OnStage can be used to build a system "from bare metal" based on any one of these configurations, or for the transformation of a system in one configuration to another. Changes are recorded and, if required, can be backed out very simply. Configurable rules can be used to schedule updates to specific machine groups and can take account of requirements such as waiting until there's no user and doing a system reboot at the end.

The ability to clone a configuration on a machine is something that Jeff uses when major updates have to be tested. The new configuration can be tested and tuned, then that identical configuration is applied to specific groups of machines once testing is complete. OnStage uses the KnowlegeBase, both the central Aduva copy and Jefferson County's own, to determine exactly which packages to remove and which to install to ensure that existing systems end up being identical to the staging/test system(s).

When asked if he trusted OnStage enough to consider skipping the verification staging build of significant changes before deployment, Jeff responded like any systems administrator faced with applying untested patches to many production system would, saying, "No, I have faith in the system, but not that much!" Then after reflection, he added, "Actually, we do allow the system updates to go straight through without testing and have never has any issues, so I guess I do trust it after all."

More Stories By Philip Peake

Philip Peake is a professional services consultant, and has worked for a variety of companies including Netscape, AOL, Sun Microsystems and OSDL.
With over 25 years experience of UNIX based systems in Internet and
Intranet enterprise environments, using Linux has been a natural evolution.
Philip has a Batchelor of Science degree in computer science from
the University of Keele in the United Kingdom.

Comments (3) View Comments

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Most Recent Comments
Fraser Campbell 01/13/06 01:09:18 PM EST

Hi Philip,

I am in a position where we have 100s of SuSE servers and that number is expected to grow by leaps and bounds as virtualization begins to take hold.

I agree that higher level management tools are critical to managing this infrastructure.

I am curious as to what tools you may have used yourself, have you for example considered cfengine. My bias is weighted heavily towards open source tools despite the fact that we are using SLES servers.

news desk 12/27/05 11:43:26 PM EST

One of the most serious problems facing larger organizations considering using Linux and Open Source application stacks is managing the software environment. The basic Linux system has adequate tools to manage a single machine, or even a small group of machines, but once the population of these machines reaches into the tens and hundreds and spreads across multiple application areas and multiple locations the management task becomes harder.

news desk 12/27/05 11:32:19 PM EST

One of the most serious problems facing larger organizations considering using Linux and Open Source application stacks is managing the software environment. The basic Linux system has adequate tools to manage a single machine, or even a small group of machines, but once the population of these machines reaches into the tens and hundreds and spreads across multiple application areas and multiple locations the management task becomes harder.

@ThingsExpo Stories
SYS-CON Events announced today that Fusion, a leading provider of cloud services, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Fusion, a leading provider of integrated cloud solutions to small, medium and large businesses, is the industry’s single source for the cloud. Fusion’s advanced, proprietary cloud service platform enables the integration of leading edge solutions in the cloud, including cloud...
Video experiences should be unique and exciting! But that doesn’t mean you need to patch all the pieces yourself. Users demand rich and engaging experiences and new ways to connect with you. But creating robust video applications at scale can be complicated, time-consuming and expensive. In his session at @ThingsExpo, Zohar Babin, Vice President of Platform, Ecosystem and Community at Kaltura, discussed how VPaaS enables you to move fast, creating scalable video experiences that reach your aud...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life sett...
DevOps is being widely accepted (if not fully adopted) as essential in enterprise IT. But as Enterprise DevOps gains maturity, expands scope, and increases velocity, the need for data-driven decisions across teams becomes more acute. DevOps teams in any modern business must wrangle the ‘digital exhaust’ from the delivery toolchain, "pervasive" and "cognitive" computing, APIs and services, mobile devices and applications, the Internet of Things, and now even blockchain. In this power panel at @...
The 20th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held June 6-8, 2017, at the Javits Center in New York City, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal ...
20th Cloud Expo, taking place June 6-8, 2017, at the Javits Center in New York City, NY, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy.
20th Cloud Expo, taking place June 6-8, 2017, at the Javits Center in New York City, NY, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy.
Extracting business value from Internet of Things (IoT) data doesn’t happen overnight. There are several requirements that must be satisfied, including IoT device enablement, data analysis, real-time detection of complex events and automated orchestration of actions. Unfortunately, too many companies fall short in achieving their business goals by implementing incomplete solutions or not focusing on tangible use cases. In his general session at @ThingsExpo, Dave McCarthy, Director of Products...
The many IoT deployments around the world are busy integrating smart devices and sensors into their enterprise IT infrastructures. Yet all of this technology – and there are an amazing number of choices – is of no use without the software to gather, communicate, and analyze the new data flows. Without software, there is no IT. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, Dave McCarthy, Director of Products at Bsquare Corporation; Alan Williamson, Principal...
Internet of @ThingsExpo has announced today that Chris Matthieu has been named tech chair of Internet of @ThingsExpo 2017 New York The 7th Internet of @ThingsExpo will take place on June 6-8, 2017, at the Javits Center in New York City, New York. Chris Matthieu is the co-founder and CTO of Octoblu, a revolutionary real-time IoT platform recently acquired by Citrix. Octoblu connects things, systems, people and clouds to a global mesh network allowing users to automate and control design flo...
Unsecured IoT devices were used to launch crippling DDOS attacks in October 2016, targeting services such as Twitter, Spotify, and GitHub. Subsequent testimony to Congress about potential attacks on office buildings, schools, and hospitals raised the possibility for the IoT to harm and even kill people. What should be done? Does the government need to intervene? This panel at @ThingExpo New York brings together leading IoT and security experts to discuss this very serious topic.
Businesses and business units of all sizes can benefit from cloud computing, but many don't want the cost, performance and security concerns of public cloud nor the complexity of building their own private clouds. Today, some cloud vendors are using artificial intelligence (AI) to simplify cloud deployment and management. In his session at 20th Cloud Expo, Ajay Gulati, Co-founder and CEO of ZeroStack, will discuss how AI can simplify cloud operations. He will cover the following topics: why clou...
In this strange new world where more and more power is drawn from business technology, companies are effectively straddling two paths on the road to innovation and transformation into digital enterprises. The first path is the heritage trail – with “legacy” technology forming the background. Here, extant technologies are transformed by core IT teams to provide more API-driven approaches. Legacy systems can restrict companies that are transitioning into digital enterprises. To truly become a lead...
Internet-of-Things discussions can end up either going down the consumer gadget rabbit hole or focused on the sort of data logging that industrial manufacturers have been doing forever. However, in fact, companies today are already using IoT data both to optimize their operational technology and to improve the experience of customer interactions in novel ways. In his session at @ThingsExpo, Gordon Haff, Red Hat Technology Evangelist, will share examples from a wide range of industries – includin...
The WebRTC Summit New York, to be held June 6-8, 2017, at the Javits Center in New York City, NY, announces that its Call for Papers is now open. Topics include all aspects of improving IT delivery by eliminating waste through automated business models leveraging cloud technologies. WebRTC Summit is co-located with 20th International Cloud Expo and @ThingsExpo. WebRTC is the future of browser-to-browser communications, and continues to make inroads into the traditional, difficult, plug-in web co...
"We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
According to Forrester Research, every business will become either a digital predator or digital prey by 2020. To avoid demise, organizations must rapidly create new sources of value in their end-to-end customer experiences. True digital predators also must break down information and process silos and extend digital transformation initiatives to empower employees with the digital resources needed to win, serve, and retain customers.
Amazon has gradually rolled out parts of its IoT offerings in the last year, but these are just the tip of the iceberg. In addition to optimizing their back-end AWS offerings, Amazon is laying the ground work to be a major force in IoT – especially in the connected home and office. Amazon is extending its reach by building on its dominant Cloud IoT platform, its Dash Button strategy, recently announced Replenishment Services, the Echo/Alexa voice recognition control platform, the 6-7 strategic...
We're entering the post-smartphone era, where wearable gadgets from watches and fitness bands to glasses and health aids will power the next technological revolution. With mass adoption of wearable devices comes a new data ecosystem that must be protected. Wearables open new pathways that facilitate the tracking, sharing and storing of consumers’ personal health, location and daily activity data. Consumers have some idea of the data these devices capture, but most don’t realize how revealing and...