Welcome!

Linux Containers Authors: Liz McMillan, Robin Miller, Bob Gourley, XebiaLabs Blog, Yeshim Deniz

Related Topics: @DevOpsSummit, Linux Containers, Containers Expo Blog

@DevOpsSummit: Blog Feed Post

How to Boost Enterprise Software Testing Predictability | @DevOpsSummit #DevOps #ContinuousTesting

The foundation of enterprise software testing predictability is built on consistent practices, processes, and tools

How to Boost Enterprise Software Testing Predictability
By Simon King

Are you tired of slipping deadlines and missing commitments? Do you feel like the consistency of Software Testing is out of your control? Here is how to improve the predictability of software testing across multiple teams and projects.

Enable Consistent Practices, Processes, and Tools
The foundation of enterprise software testing predictability is built on consistent practices, processes, and tools. Improving the predictability of software testing for a single team is difficult; doing so across multiple enterprise teams working on multiple features is exponentially more difficult.

Software testing predictability relies on the consistency of requirements management, code quality, test management, defects management, test environment management, and much more. The teams that support these activities have the largest impact on their predictability.

If multiple enterprise teams have inconsistent practices, processes, or tools, then these activities will be inconsistent. In order to enable predictable software testing, you have to enable your teams to have consistent practices, processes, and tools.

Standardizing Across Multiple Development Methodologies
It is easy to say that you should ensure everyone is using consistent practices, processes, and tools, but in the enterprise, the reality is that teams will be different. Some development teams may be using Agile practices, while others may be following Waterfall practices. Some of the Agile teams may be practicing Kanban while others are SCRUM.

From a tooling standpoint, different development teams may be using Rally, JIRA, spreadsheets, or Post-it Notes. While standardizing these methodologies and tools is clearly optimal, it may be unrealistic to expect Software Testing to drive those changes.

It is essential that software testing practices, processes, and tools support multiple development methodologies and tools. Support the testing at the team level that makes the teams most productive, and enable the management above the team level to be consistent.

This may sound theoretical, but I assure you it is pragmatic. Empowering teams to do work the way that is best for them while standardizing the management above those teams is exactly what methodologies like the Scaled Agile Framework (SAFe) and enterprise ALM platforms have done for development.

Your organization doesn’t have to be committed to SAFe to use its guidance for improving software testing management consistency. You also don’t have to use guidance from SAFe or any other methodology. You can determine which consistent practices you want to support. Modern enterprise test management tools, just like ALM tools, also help you standardize the management of multiple teams, methodologies, and tools.

Measure Software Testing Predictability
You must measure software testing predictability if you hope to improve it. No one has a simple answer or quick method for improving predictability across all these facets. The only way to start improving predictability across a complex system is to measure it, identify the biggest barriers, and resolve those barriers. Then rinse and repeat until you are executing within a suitable threshold.

It is key in the enterprise to be able to roll up individual team progress across different dimensions such as project, release, feature, or portfolio. You gain better insight faster by viewing the predictability of multiple teams across a release or feature.

It is also critical that you can drill down across different dimensions such as individual, team, project, or feature. For example, if you are viewing a chart of the predictability of testing across features and you see that one feature has far more defects than the rest, you would want to drill down to see how many defects are being found across the different teams that support that feature.

When you drill down, you might see that a particular team has far more defects than the rest of the teams. You will want to drill into that team to determine what the issue is. Now that you have pinpointed where the biggest issues are, you should investigate what is causing the issues and how you can resolve the situation. Over time your predictability will stabilize.

Capture Consistent Historical Insight
A measurement is only as insightful as the context that is provided alongside it. What if I tell you the temperature is eighty-eight degrees? Am I talking about my temperature, my six-month-old daughter’s temperature, or the outside temperature? If I’m talking about the outside temperature, where am I and what time of year is it? What is the historical temperature for this place and time of year? Finally, how reliable is my measurement? Is it coming from the weather service or an old thermometer sitting in the shade of my house?

To measure software testing predictability you have to have reliable measurements across all teams, features, releases, and portfolios throughout a significant period of time. This includes collecting the number of requirements, defects, fixes, and more. You also need to be able to slice this information by teams, features, releases, and portfolios, so that you can know how many defects a team typically finds.

Measuring Predictability
There are three aspects to measuring enterprise software testing predictability:

1. Throughput
To determine your software testing predictability, you need to know your throughput of defects found by phase, fixes by phase, and bugs injected into production. You also need to be able to view these items in relation to the number of requirements. Once again, you need to be able to slice the information by teams, features, releases, and portfolios.

2. Throughput Variation
Next, you want to look at the historical trends of the throughput variation. The more consistent your throughput values are month-over-month, the higher your predictability is.

3. Single Source of Truth
This type of reporting is next to impossible if you are using spreadsheets for software testing reporting or older test management tools. You need a central repository for storing testing data. A modern enterprise test management tool will enable you to collect, store, and analyze these types of measures.

Conclusion
Missing deadlines and commitments is stressful. Boosting your software testing predictability is paramount for your team’s success and sanity. As crucial as predictability is, it is just one component of improving your overall enterprise software testing performance. Check out this webinar to learn how to improve enterprise software testing.

The post How to Boost Enterprise Software Testing Predictability appeared first on Plutora.

Read the original blog entry...

More Stories By Plutora Blog

Plutora provides Enterprise Release and Test Environment Management SaaS solutions aligning process, technology, and information to solve release orchestration challenges for the enterprise.

Plutora’s SaaS solution enables organizations to model release management and test environment management activities as a bridge between agile project teams and an enterprise’s ITSM initiatives. Using Plutora, you can orchestrate parallel releases from several independent DevOps groups all while giving your executives as well as change management specialists insight into overall risk.

Supporting the largest releases for the largest organizations throughout North America, EMEA, and Asia Pacific, Plutora provides proof that large companies can adopt DevOps while managing the risks that come with wider adoption of self-service and agile software development in the enterprise. Aligning process, technology, and information to solve increasingly complex release orchestration challenges, this Gartner “Cool Vendor in IT DevOps” upgrades the enterprise release management from spreadsheets, meetings, and email to an integrated dashboard giving release managers insight and control over large software releases.

@ThingsExpo Stories
The age of Digital Disruption is evolving into the next era – Digital Cohesion, an age in which applications securely self-assemble and deliver predictive services that continuously adapt to user behavior. Information from devices, sensors and applications around us will drive services seamlessly across mobile and fixed devices/infrastructure. This evolution is happening now in software defined services and secure networking. Four key drivers – Performance, Economics, Interoperability and Trust ...
Data is an unusual currency; it is not restricted by the same transactional limitations as money or people. In fact, the more that you leverage your data across multiple business use cases, the more valuable it becomes to the organization. And the same can be said about the organization’s analytics. In his session at 19th Cloud Expo, Bill Schmarzo, CTO for the Big Data Practice at Dell EMC, introduced a methodology for capturing, enriching and sharing data (and analytics) across the organization...
SYS-CON Events announced today that T-Mobile will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. As America's Un-carrier, T-Mobile US, Inc., is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The Company's advanced nationwide 4G LTE network delivers outstanding wireless experiences to 67.4 million customers who are unwilling to compromise on ...
The explosion of new web/cloud/IoT-based applications and the data they generate are transforming our world right before our eyes. In this rush to adopt these new technologies, organizations are often ignoring fundamental questions concerning who owns the data and failing to ask for permission to conduct invasive surveillance of their customers. Organizations that are not transparent about how their systems gather data telemetry without offering shared data ownership risk product rejection, regu...
Bert Loomis was a visionary. This general session will highlight how Bert Loomis and people like him inspire us to build great things with small inventions. In their general session at 19th Cloud Expo, Harold Hannon, Architect at IBM Bluemix, and Michael O'Neill, Strategic Business Development at Nvidia, discussed the accelerating pace of AI development and how IBM Cloud and NVIDIA are partnering to bring AI capabilities to "every day," on-demand. They also reviewed two "free infrastructure" pr...
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists will examine how DevOps helps to meet th...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...
With billions of sensors deployed worldwide, the amount of machine-generated data will soon exceed what our networks can handle. But consumers and businesses will expect seamless experiences and real-time responsiveness. What does this mean for IoT devices and the infrastructure that supports them? More of the data will need to be handled at - or closer to - the devices themselves.
Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market across the USA and Europe, we work with a variety of customers from emerging startups to Fortune 1000 companies.
Financial Technology has become a topic of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 20th Cloud Expo at the Javits Center in New York, June 6-8, 2017, will find fresh new content in a new track called FinTech.
SYS-CON Events announced today that Interoute, owner-operator of one of Europe's largest networks and a global cloud services platform, has been named “Bronze Sponsor” of SYS-CON's 20th Cloud Expo, which will take place on June 6-8, 2017 at the Javits Center in New York, New York. Interoute is the owner-operator of one of Europe's largest networks and a global cloud services platform which encompasses 12 data centers, 14 virtual data centers and 31 colocation centers, with connections to 195 add...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm.
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
SYS-CON Events announced today that Juniper Networks (NYSE: JNPR), an industry leader in automated, scalable and secure networks, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Juniper Networks challenges the status quo with products, solutions and services that transform the economics of networking. The company co-innovates with customers and partners to deliver automated, scalable and secure network...
The age of Digital Disruption is evolving into the next era – Digital Cohesion, an age in which applications securely self-assemble and deliver predictive services that continuously adapt to user behavior. Information from devices, sensors and applications around us will drive services seamlessly across mobile and fixed devices/infrastructure. This evolution is happening now in software defined services and secure networking. Four key drivers – Performance, Economics, Interoperability and Trust ...
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
SYS-CON Events announced today that Hitachi Data Systems, a wholly owned subsidiary of Hitachi LTD., will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City. Hitachi Data Systems (HDS) will be featuring the Hitachi Content Platform (HCP) portfolio. This is the industry’s only offering that allows organizations to bring together object storage, file sync and share, cloud storage gateways, and sophisticated search an...
@GonzalezCarmen has been ranked the Number One Influencer and @ThingsExpo has been named the Number One Brand in the “M2M 2016: Top 100 Influencers and Brands” by Analytic. Onalytica analyzed tweets over the last 6 months mentioning the keywords M2M OR “Machine to Machine.” They then identified the top 100 most influential brands and individuals leading the discussion on Twitter.
The Internet of Things is clearly many things: data collection and analytics, wearables, Smart Grids and Smart Cities, the Industrial Internet, and more. Cool platforms like Arduino, Raspberry Pi, Intel's Galileo and Edison, and a diverse world of sensors are making the IoT a great toy box for developers in all these areas. In this Power Panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists discussed what things are the most important, which will have the most profound e...
@ThingsExpo has been named the Most Influential ‘Smart Cities - IIoT' Account and @BigDataExpo has been named fourteenth by Right Relevance (RR), which provides curated information and intelligence on approximately 50,000 topics. In addition, Right Relevance provides an Insights offering that combines the above Topics and Influencers information with real time conversations to provide actionable intelligence with visualizations to enable decision making. The Insights service is applicable to eve...