Welcome!

Linux Containers Authors: XebiaLabs Blog, Elizabeth White, Kevin Jackson, Pat Romanski, Liz McMillan

Related Topics: Linux Containers

Linux Containers: Article

The OSS Development Life Cycle

Part 4 of 4

This is an excerpt from Chapter 6 of Understanding Open Source Software Development by Joseph Feller and Brian Fitzgerald, published by Addison-Wesley. ISBN 0201734966. No part of this excerpt may be reproduced, in any form or by any means without the prior written permission of the publisher. (c) 2002 Addison-Wesley

The traditional software development life cycle (SDLC) is premised on a set of stages, which, in their most generic form, include:

  • Planning
  • Analysis
  • Design
  • Implementation
However, the OSS development life cycle is quite different. First, the planning, analysis, and design phases are largely conducted by the initial project founder, and are not part of the general OSS development life cycle. Getting design issues right is perhaps even more critical in OSS than in conventional development. Certain criteria in relation to modularity of the code are critical. For example, modules must be loosely coupled, thereby allowing distributed development in the first place. Less important, but still highly desirable for achieving an efficient development model, is that modules be highly cohesive and address a single well-defined purpose. However, design decisions are generally made in advance, before the larger pool of developers start to contribute, and are generally based on well-established design patterns. This allows developers to collaborate without having to undergo the detailed requirements analysis or design phases of the traditional life cycle. In the absence of conventional project management, the importance of "having a tail-light to follow" (Bezroukov, 1999b) is a very useful coordinating principle, as it allows a multitude of developers to contribute. This also helps to explain why many OSS products are horizontal infrastructure-type products, as these are ones in which the requirements are pretty well understood. In vertical domains, developer knowledge of the application domain has been found to be critical, but it is unlikely that the pool of potential developers would be as high in such domains.

Thus, the OSS development life cycle is located primarily within the implementation phase of the traditional SDLC. Several researchers have investigated the life cycle underpinning OSS. Bollinger et al. (1999) suggest that it follows a very intensive spiral model (Boehm, 1988), albeit without any real risk assessment. Mockus et al. (2000) have derived a life cycle for OSS from their study of the Apache Project, and Jorgensen (2001) has investigated the life cycle in the FreeBSD Project. Both have come up with models that are largely compatible, but Jorgensen's is more detailed. He identifies the following main phases in the OSS development life cycle:

Code

  • Review
  • Pre-commit test
  • Development release
  • Parallel debugging
  • Production release

    Code
    This is the sine qua non activity. However, many potential OSS contributors may fear taking the initial step of submitting their code for review by the supremely talented OSS "code-gods" (Asklund and Bendix, 2001; Bergquist and Ljungberg, 2001), a fear that is quite warranted when you consider the views of a FreeBSD developer reported by Jorgensen (2001):

    The way you get commit privileges is by first making enough code contributions&This implies the code you've been submitting is of sufficiently impressive quality that no one objects and says, "Yuck, no, don't give him commit privileges. He writes ugly code."

    Thus, the knowledge that talented and respected peers will be reviewing the code is a real incentive to improve the quality of the code being submitted in the first place.

    Review
    As already mentioned, truly independent peer review is one of the central strengths of the OSS process. However, Jorgensen found that eliciting feedback was not always easy. "Heavyweights" with a proven reputation will get a lot of feedback, but it can be quite difficult to get attention as a newbie - another classic "Catch-22" situation. Also, somewhat paradoxically, the simpler the code, the more feedback you gets. However, complex code would invariably benefit more from feedback. Also, it's more difficult to get feedback on design issues.

    Precommit Test
    Given the vulnerability of the OSS development model, it's critical that committers test each contribution carefully to avoid breaking the build, another common norm in the OSS community. Since there is no convenient help-line or telephone support for those installing the eventual product, it can be an adventure completing an actual OSS product installation. Sanders (1998) quotes the "tech-savvy" Ellen Ullman's description of her installation of Linux as "an exhilarating succession of problem-solving challenges." Given this problematic installation context, it is imperative that installation proceeds as smoothly as possible without unnecessary noise, and thus rogue modules that could jeopardize this must be prevented.

    Interestingly, testing is very much a personal process. There is no requirement that test scenarios be rigorously planned and written down in advance. However, the negative implications of allowing a faulty contribution through are such that the testing process is taken very seriously indeed. As mentioned earlier, the delegation of testing to the user community - or partial delegation, as is the case with Mozilla and GNOME - is one of the strengths of OSS (Schmidt and Porter, 2001).

    Development Release
    If the committer deems the module ready, it can be incorporated in the development release. This is the key payoff for many developers as they get the reward of seeing their code implemented quickly in the product. Jorgensen (2001) cites a developer who captures it quite graphically:

    There is a tremendous satisfaction to the "see bug, fix bug, see bug fix get incorporated so that the fix helps others" cycle.

    Parallel Debugging
    The advantages of global parallel debugging were discussed above. Again, as in testing, there is typically no formal plan for debugging. Rather the numbers of potential debuggers is where the power of the debugging arises - Linus's Law. If bugs are found, they can be fixed and resubmitted as per the life cycle described above, or problem reports may be created and submitted. This can also be a way of initiating your contributions to OSS. For example, the database of outstanding problem reports could be examined, and if there are some outstanding that catch your interest or are within your capability, then these can be worked on. Thus, can you begin a career in OSS.

    Production Release
    Contributions eventually become part of the production release. They are merged into the stable production branch. This is accomplished in different ways in different projects. FreeBSD maintains stable production and current development branches, and contributions that are eventually found suitable are merged into the latest stable production branch, and, in the case of a bug fix, to any previous production branches to which it might be relevant. Linux maintains its stable production and development versions in different directories, and uses release numbers to identify production (even numbers) and development (odd numbers) versions.

    Conclusion
    We have argued that the generic OSS development process is characterized by the practice of parallel, rather than linear, collaboration among developers, which leads to increases in both speed and quality; by the participation of large, globally distributed communities of developers who participate in a truly independent peer review process; by prompt feedback (e.g., bug reports) and prompt recognition (e.g., integration of bug fixes); by the participation of talented and motivated developers and extremely active users; and by rapid, incremental release schedules. We also examined the well-stocked toolkit of OSS, including configuration management tools like CVS, as well as editors, build tools, documentation extractors, and the like. Finally, we argued that the OSS process is governed by an elaborate system of taboos and social mores that take the place of formal project management, and that the OSS process follows a distinctly different development life cycle to traditional proprietary software.

  • More Stories By Joseph Feller

    Joseph Feller is a lecturer with the Business Information Systems Group,
    University College Cork, Ireland. His research on Open Source Software is
    published in several prominent conference proceedings and he is the author
    of Customer Friendly: Design Guidelines for eCommerce. He also edits the
    monthly professional journal, Inside XML Solutions.

    More Stories By Brian Fitzgerald

    Brian Fitzgerald is the Frederick A Krehbiel II Professor of Innovation in Global Business and Technology at the University of Limerick, Ireland. He is Associate Editor for two leading international journals in the IS field, The Information Systems Journal, and Data Base. His publications include five books and more than 50 papers, published in leading international conferences and journals. Having worked in the industry prior to taking up an academic position, he has more than 20 years of experience in the IS field.

    Comments (0)

    Share your thoughts on this story.

    Add your comment
    You must be signed in to add a comment. Sign-in | Register

    In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


    @ThingsExpo Stories
    With an estimated 50 billion devices connected to the Internet by 2020, several industries will begin to expand their capabilities for retaining end point data at the edge to better utilize the range of data types and sheer volume of M2M data generated by the Internet of Things. In his session at @ThingsExpo, Don DeLoach, CEO and President of Infobright, discussed the infrastructures businesses will need to implement to handle this explosion of data by providing specific use cases for filterin...
    Is your aging software platform suffering from technical debt while the market changes and demands new solutions at a faster clip? It’s a bold move, but you might consider walking away from your core platform and starting fresh. ReadyTalk did exactly that. In his General Session at 19th Cloud Expo, Michael Chambliss, Head of Engineering at ReadyTalk, will discuss why and how ReadyTalk diverted from healthy revenue and over a decade of audio conferencing product development to start an innovati...
    So, you bought into the current machine learning craze and went on to collect millions/billions of records from this promising new data source. Now, what do you do with them? Too often, the abundance of data quickly turns into an abundance of problems. How do you extract that "magic essence" from your data without falling into the common pitfalls? In her session at @ThingsExpo, Natalia Ponomareva, Software Engineer at Google, provided tips on how to be successful in large scale machine learning...
    Early adopters of IoT viewed it mainly as a different term for machine-to-machine connectivity or M2M. This is understandable since a prerequisite for any IoT solution is the ability to collect and aggregate device data, which is most often presented in a dashboard. The problem is that viewing data in a dashboard requires a human to interpret the results and take manual action, which doesn’t scale to the needs of IoT.
    What does it look like when you have access to cloud infrastructure and platform under the same roof? Let’s talk about the different layers of Technology as a Service: who cares, what runs where, and how does it all fit together. In his session at 18th Cloud Expo, Phil Jackson, Lead Technology Evangelist at SoftLayer, an IBM company, spoke about the picture being painted by IBM Cloud and how the tools being crafted can help fill the gaps in your IT infrastructure.
    "delaPlex is a software development company. We do team-based outsourcing development," explained Mark Rivers, COO and Co-founder of delaPlex Software, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
    "C2M is our digital transformation and IoT platform. We've had C2M on the market for almost three years now and it has a comprehensive set of functionalities that it brings to the market," explained Mahesh Ramu, Vice President, IoT Strategy and Operations at Plasma, in this SYS-CON.tv interview at @ThingsExpo, held June 7-9, 2016, at the Javits Center in New York City, NY.
    Traditional IT, great for stable systems of record, is struggling to cope with newer, agile systems of engagement requirements coming straight from the business. In his session at 18th Cloud Expo, William Morrish, General Manager of Product Sales at Interoute, outlined ways of exploiting new architectures to enable both systems and building them to support your existing platforms, with an eye for the future. Technologies such as Docker and the hyper-convergence of computing, networking and sto...
    Whether your IoT service is connecting cars, homes, appliances, wearable, cameras or other devices, one question hangs in the balance – how do you actually make money from this service? The ability to turn your IoT service into profit requires the ability to create a monetization strategy that is flexible, scalable and working for you in real-time. It must be a transparent, smoothly implemented strategy that all stakeholders – from customers to the board – will be able to understand and comprehe...
    SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
    The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren’t yet translating into a true “cloud” experience within the enterprise. What is stopping the growth of the “private cloud” market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between wh...
    It’s 2016: buildings are smart, connected and the IoT is fundamentally altering how control and operating systems work and speak to each other. Platforms across the enterprise are networked via inexpensive sensors to collect massive amounts of data for analytics, information management, and insights that can be used to continuously improve operations. In his session at @ThingsExpo, Brian Chemel, Co-Founder and CTO of Digital Lumens, will explore: The benefits sensor-networked systems bring to ...
    SYS-CON Events announced today the Enterprise IoT Bootcamp, being held November 1-2, 2016, in conjunction with 19th Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA. Combined with real-world scenarios and use cases, the Enterprise IoT Bootcamp is not just based on presentations but with hands-on demos and detailed walkthroughs. We will introduce you to a variety of real world use cases prototyped using Arduino, Raspberry Pi, BeagleBone, Spark, and Intel Edison. Y...
    Large scale deployments present unique planning challenges, system commissioning hurdles between IT and OT and demand careful system hand-off orchestration. In his session at @ThingsExpo, Jeff Smith, Senior Director and a founding member of Incenergy, will discuss some of the key tactics to ensure delivery success based on his experience of the last two years deploying Industrial IoT systems across four continents.
    Much of IT terminology is often misused and misapplied. Modernization and transformation are two such terms. They are often used interchangeably even though they mean different things and have very different connotations. Indeed, it is somewhat safe to assume that in IT any transformative effort is likely to also have a modernizing effect, and thus, we can see these as levels of improvement efforts. However, many businesses are being led to believe if they don’t transform now they risk becoming ...
    Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
    SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
    Whether your IoT service is connecting cars, homes, appliances, wearable, cameras or other devices, one question hangs in the balance – how do you actually make money from this service? The ability to turn your IoT service into profit requires the ability to create a monetization strategy that is flexible, scalable and working for you in real-time. It must be a transparent, smoothly implemented strategy that all stakeholders – from customers to the board – will be able to understand and comprehe...
    "Tintri was started in 2008 with the express purpose of building a storage appliance that is ideal for virtualized environments. We support a lot of different hypervisor platforms from VMware to OpenStack to Hyper-V," explained Dan Florea, Director of Product Management at Tintri, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
    "There's a growing demand from users for things to be faster. When you think about all the transactions or interactions users will have with your product and everything that is between those transactions and interactions - what drives us at Catchpoint Systems is the idea to measure that and to analyze it," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York Ci...