Welcome!

Linux Containers Authors: Zakia Bouachraoui, Elizabeth White, Yeshim Deniz, Liz McMillan, Pat Romanski

Related Topics: @DevOpsSummit, Linux Containers, Containers Expo Blog

@DevOpsSummit: Blog Feed Post

How to Select a Test Automation Tool | @DevOpsSummit #APM #DevOps

A Test Automation tool along with its associated components are primarily responsible for communicating with AUT

A Test Automation Tool can play a big role in deciding success as well as effectiveness of Test Automation. Based on the growth in the device and browser matrix, it is not recommended to build test automation framework around a single tool; however, many organizations still continue to do so. It becomes even more important to choose right tool for your automation when test automation solution is built around a specific tool.

A Test Automation tool along with its associated components are primarily responsible for communicating with Application Under Test (AUT) and for passing the instructions of test automation scripts to AUT interface (UI or API) and get responses from the AUT interfaces. The tool is also responsible for verification of the AUT responses against expected results, logging of results and report generation. Other than these basic responsibilities, the test automation tool has enhanced features such as keyword driven scripting, robustness against failures / unexpected interrupts, informative dashboard which shows progress of test automation while executing, integration with test management tools, integration with continuous integration tools, etc.

Best way to approach selection of test automation tool is to do an elaborate Proof of Concept (POC) with AUT using the tool. Most complex test scenarios (e.g. boundary conditions, large test data volume scenarios, scenarios involving boundary conditions, etc.) should be put to automation using the tool.

More than one tools must be tried for the POC and the parameters such as

  • Browsers / Devices / OSs Matrix Support
  • Extension Features – Ability to integrate with Industry standard automation frameworks / components
  • Technology Support – Ability to support different programming languages
  • Possible test coverage of AUT
  • Community Support – Extent of available help documentation, active forums / discussions regarding the tool
  • Richness of tool development interface
  • Ability to integrate with (desired) test management tools
  • Ability to integrate with (desired) continuous integration tools
  • Licensing mode (SaaS Vs Perpetual Licensing, Node locked Vs. Floating Licenses)

As ever, the IT industry continues to evolve with different technologies and gadgets. Against popular Windows desktop based UI applications of 1990s, distributed web applications are now ubiquitous and eventually will be replaced by applications on small form factor (SFF) devices. Commercial tools with initial focus on UI automation of Windows desktop applications eventually evolved to support Web applications / Web Services and are trying to catch up with UI automation on SFF devices. Many open source / freeware tools and libraries, have become equally popular and successful in addressing test automation needs (e.g. Selenium, Microsoft UI Automation Libraries, White, Sikuli, Appium, Calabash, etc.)

Typical enterprise application under test (AUT) is likely to be comprised of Data layer, Services Layers and User Interface layer. At the data layer one has choices of SQL / NOSQL technologies. For data transport there are choices like XML vs. JSON vs. custom data structures. Also one may choose to hide / expose service (API) layer along with UI layer external users. UI layer itself needs to support leading browsers (IE, Firefox, Safari, Chrome, Opera) and mobile technologies like Android, iOS, Windows Phone, etc.

Most of the applications are likely to support all leading devices as well as browsers. It is going to be difficult for any single tool to be able to keep up with the pace at which this matrix is growing. Hence single tool cannot provide foolproof test automation solution against diverse platforms.

Recommended approach is to separate framework development activity from test automation tool selection activity. Test automation framework should be robust enough to accommodate multiple test automation tools, libraries for different test automation needs (e.g. UI testing, API testing, Volume testing, Performance testing, Vulnerability testing). Each tool selection can then undergo elaborate POC as described above and consequent integration with existing test automation framework.

The post How to Select Test Automation Tool appeared first on Software Testing Services Company - AFourTech.

Read the original blog entry...

More Stories By Mahesh Kulkarni

Mahesh A. Kulkarni is Managing Director and Principal Test Architect at AFour Technologies. He has over fifteen years of experience of software engineering .Since 1998 he has worked with SMEs as well as large scale ISVs and has contributed to software quality initiatives across diverse software systems. As a part of this he has built performance testing, test automation, security testing and functional testing teams at Pune, Bangalore, and Hyderabad. Mahesh holds engineering degree from BITS, Pilani.

IoT & Smart Cities Stories
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things'). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing. IoT is not about the devices, its about the data consumed and generated. The devices are tools, mechanisms, conduits. This paper discusses the considerations when dealing with the...
Bill Schmarzo, Tech Chair of "Big Data | Analytics" of upcoming CloudEXPO | DXWorldEXPO New York (November 12-13, 2018, New York City) today announced the outline and schedule of the track. "The track has been designed in experience/degree order," said Schmarzo. "So, that folks who attend the entire track can leave the conference with some of the skills necessary to get their work done when they get back to their offices. It actually ties back to some work that I'm doing at the University of San...
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...
If a machine can invent, does this mean the end of the patent system as we know it? The patent system, both in the US and Europe, allows companies to protect their inventions and helps foster innovation. However, Artificial Intelligence (AI) could be set to disrupt the patent system as we know it. This talk will examine how AI may change the patent landscape in the years to come. Furthermore, ways in which companies can best protect their AI related inventions will be examined from both a US and...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
Chris Matthieu is the President & CEO of Computes, inc. He brings 30 years of experience in development and launches of disruptive technologies to create new market opportunities as well as enhance enterprise product portfolios with emerging technologies. His most recent venture was Octoblu, a cross-protocol Internet of Things (IoT) mesh network platform, acquired by Citrix. Prior to co-founding Octoblu, Chris was founder of Nodester, an open-source Node.JS PaaS which was acquired by AppFog and ...
The deluge of IoT sensor data collected from connected devices and the powerful AI required to make that data actionable are giving rise to a hybrid ecosystem in which cloud, on-prem and edge processes become interweaved. Attendees will learn how emerging composable infrastructure solutions deliver the adaptive architecture needed to manage this new data reality. Machine learning algorithms can better anticipate data storms and automate resources to support surges, including fully scalable GPU-c...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...