Welcome!

Linux Containers Authors: Liz McMillan, Vaibhaw Pandey, Elizabeth White, Pat Romanski, Yeshim Deniz

Related Topics: @DevOpsSummit, Linux Containers, Containers Expo Blog

@DevOpsSummit: Blog Post

The Next Evolution of DevOps in the Enterprise: 'Hardening' DevOps | @DevOpsSummit #DevOps

In today's digital age much of the business innovation is driven by software

In today's digital age much of the business innovation is driven by software. To win, serve and retain their customers, enterprises are being tasked with releasing application updates at an increasingly faster pace. A great idea, killer functionality and a robust technology are all as important as ever - but do not mean much if you can't get your code to your end users in a fast, predictable manner, and with high quality.

Your "Pathway to Production" is the path that your code takes from developer check-in all the way to a successful Release. It spans the entire organization - comprising all the different stakeholders, teams, processes, tools and environments involved in your software delivery. This is, essentially, how your organization delivers value to the market.

Increasingly, we see that organizations that become better at streamlining and accelerating their Pathway to Production are better equipped to compete and win in today's economy. The maturity, speed and quality of your software release processes have become a key differentiator and a competitive advantage for businesses today.

DevOps and ARA: Paving a Better Pathway to Production
DevOps and Application Release Automation (ARA) have emerged to help organizations become better at delivering software - allowing for greater speed and agility while mitigating the risk of software releases.

DevOps has huge business benefits: statistics show that organizations that practice DevOps outperform the SMP500 over a 3 year period, high-performing IT organizations have 50% higher market cap growth, and so on.

In order to remain competitive and meet consumer demands, enterprises across the board are adopting DevOps to optimize their Pathway to Production. Just as you would invest in designing the right functionality for your product, or defining a winning go-to-market plan, organizations now invest in optimizing and (re)designing their Pathway to Production to enable innovation.

The implementation of DevOps in large organizations comes with a unique set of challenges. Enterprises often need to support large volumes of distributed teams and multiple applications/product releases. In addition, regulatory and governance requirements, supporting legacy systems, tool variety, infrastructure management, and complex internal processes further compound these challenges.

I'd like to discuss the evolution of DevOps adoption in the enterprise, and what I see as the next phase of the DevOps revolution.

DevOps in the Enterprise: Starting Small, Dev Is Leading.
Agile methodologies, adopted by many software organizations, have been largely focused on development, QA and product management functions, and less on the Pathway to Production once the software has been authored.

As a continuation to Agile, DevOps also started as a very Dev-driven movement (despite the ‘Ops' in the name). Dev teams were quicker to adopt these practices, as they were eager to find a way to get their code into Production faster. Ops were traditionally more hesitant to adopt DevOps, seeing the increased velocity and speed as possible risks.

The majority of DevOps implementations today still start as grass-roots initiatives in small teams. And that's OK and is a good way to show early success and then scale. Increasingly, alongside these bottom-up efforts, we're seeing a shift towards DevOps being a company-wide initiative, championed both at the executive-level, as well as at the team-level.

The Next Phase: Scaling DevOps, Ops Takes Center Stage.
One of the biggest challenges for large enterprises is the "silo-ing" of people, processes and toolsets. Oftentimes, one or more of these silos may be quite adept at understanding and automating their piece of the puzzle, but there is no end-to-end visibility or automation of the entire Pathway. This leads to fragmented processes, manual handoffs, delays, errors, lack of governance, etc.

Since the Pathway to Production spans the entire organization, enterprises are realizing that optimizing it is not a disparate set of problems, but requires a system-level approach. The evolution of DevOps is towards scaling adoption across the entire enterprise to cover the end-to-end Pathway to Production. This removes friction by automating all aspects of your delivery pipeline, in the pursuit of creating predictable, repeatable processes that can be run frequently with less and less human intervention. By achieving consistency of processes and deployments (into QA, Staging, Prod.) throughout the entire lifecycle, you're in fact always ‘practicing' for game-day, and hardening your DevOps practices as you optimize them.

As part of this process - as DevOps matures and becomes mainstream in enterprises (and as it becomes more critical to their operations), DevOps practices are ‘hardened' to take into account more ‘Ops' requirements for releases: mainly around manageability,governance, security and compliance.

Talking about "enterprise-control" is no longer a bad thing or something that may be viewed as hindering DevOps adoption. DevOps is about enabling speed while ensuring stability. Similar to children maturing, now that we've grown and learned to walk (faster), it's time to learn to be more responsible.

As with the software your organization is developing, it's time to "harden" your DevOps practices to scale adoption throughout your end-to-end process across the organization. ‘Hardening' doesn't mean sacrificing speed or experimentation; it means your DevOps is getting ready for Prime Time!

"Hardening" Your DevOps Implementation:
You want to design your underlying tools and processes along your Pathway to Production in a way can scale across the enterprise. This requires balancing team ownership and collaboration, with supporting the needs of the organization for checks and balancesstandardization, and system-level visibility and control.

While you would likely still start ‘local', and gradually roll out across different groups as you optimize - be sure to always think ‘global'. As you analyze and (re)design your Pathway to Production, you need to take a system-wide approach, and always consider:How do I scale this? - across all teams, applications, releases, environments, and so on.

First, take some time to map your end-to-end Pathway to Production. From my experience, organizations often are not even aware of the entire path their code takes from check-in, through build, testing, deployment across environments, etc. Be sure to interview all the different teams and stakeholder, until you reach a painstakingly detailed documentation of your cross-functional pipeline(s) - including all the tools, technologies, infrastructure and processes involved.

Then, take a look at the bottlenecks - where do your pipelines choke? For example: waiting on VMs, waiting on builds, configuration drifts between environments, failed or flaky tests, bugs making it to Production, failed releases, errors or lags due to manual handoffs between teams or tools, etc.

As you redesign your pipelines to eliminate friction points, here are some things to consider on your journey to ‘harden' your DevOps practices to support stability and scaling across the organization:

  1. How do I ensure security access controls and approval gates at critical points along the pipeline?
  2. How do I guarantee visibility and auditability- so we have real-time reporting of the state of each task along the pipeline, and a record of exactly who did what/where/when?
  3. What security and compliance test (or other tests) must all processes adhere to in order to move through the pipeline and into Production?
  4. How do I standardize as much as possible on toolchain, technology and processes to normalize my pipeline to allow reusability across teams/applications and save on cost?
  5. How do I still enable extensibility and flexibility to support different needs from various teams or variants of the application?
  6. Can my chosen DevOps solution orchestrate and automate the entire end-to-end pipeline?
  7. Can my implementation support Bi-modal IT - enabling traditional release practices and support for legacy apps, as well as more modern container/microservices architectures and CD pipelines?
  8. Can I support both simpler, linear, release pipelines, as well as complex releases that require coordination of many inter-dependent applications and components into many environments?
  9. Is my solution ‘future-ready' and flexible enough to be able to plug-in any new technology stack, tool or processes as the need arise?
  10. As I scale, can my implementation support the velocity and throughout I'm expecting across the organization - which can include thousands of developers, thousands of Releases, millions of builds and test cases per .?
  11. Setting up one pipeline for one team/release is easy enough, but how do I onboard thousands of applications?

While optimizing your tools and technology to scale DevOps adoption is important, it is only half the battle. Above all- DevOps is a mindset, and cultural shift takes time. Remember that change doesn't happen in a day, and that you're in it for the long haul.

As a community, we started with asking why we should even bother doing DevOps. After establishing momentum and proving the ROI of DevOps, the discussion is gradually evolving to how we get DevOps right in large enterprises: what are some of the patterns for success, and how can we effectively scale so that the entire organization can reap the benefits.

infoworld-logo This article was originally published on InfoWorld

More Stories By Anders Wallgren

Anders Wallgren is Chief Technology Officer of Electric Cloud. Anders brings with him over 25 years of in-depth experience designing and building commercial software. Prior to joining Electric Cloud, Anders held executive positions at Aceva, Archistra, and Impresse. Anders also held management positions at Macromedia (MACR), Common Ground Software and Verity (VRTY), where he played critical technical leadership roles in delivering award winning technologies such as Macromedia’s Director 7 and various Shockwave products.

@ThingsExpo Stories
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...