Enter the characters shown in the image.

You are here

Automation Tool - How to choose

Automation Tool: choosing is not an easy job

How do we choose our automated testing tools?

If we decided wrongly, how much it will cost us to move to new tool?

Where can I get good information that will help to decide on this issues?

On selecting testing tool we should take in consideration the following issues:

  1. Technology Under test
    It should be very easy to understand and analyze, because we know the application that is under test but do we aware on all its sub processes, applications, and those applications that already run in the background? In few cases we might find out more applications, or/and special functional cases that we should take them in consideration. Before buying the tool, we must make sure we are not creating any testing limitation.
  2. Scripting Language
    Let us say that all my team members are well familiar with Java language, for them to build the frameworks with java will be very fast, which will shorten the TTM time. However, do we need testing application with scripting capabilities at all? Today code-free tools are available and there is variety of them, the question on the scripting language is now much wider.
  3. Support
    every testing tool need support and bug fixing like every program, not fixing its defect will be equal to testing limitation, and with time we are wiser on the companies that provide this support. Using opensource tool will give you the option to support the tool by yourself or external team. The support we will need should be handy and fast. Not having the support in time, might mean not providing the automated test you promise on time.
  4. Intuitive and Easy to Use
    Learning curve for the tool is a second grade issue but still we must take it in consideration. Especially if we don’t have time to teach and understand the tool (like in many extreme process development)
  5. Command Line – API – UI
    In many cases we desire to activate the test from centralize application that will archive the results and even show us statistics on the overall cycle run. Do we have integration possibilities? One solution is activating the test via command line, in some cases the tool designed to work with OLE strategy, which will enable the possibilities to integrate it by code. So, how do I plan to activate the test? We need to summarize all the using methods needed before even testing it. I call it UI Availabilities.
  6. Non-Intrusive tool
    Intrusive or non-intrusive testing tool? How much our application influenced by the fact that the testing tool is there?
  7. Brand
    A well known brand has its advantages like: reliability, resources availabilities, but there is disadvantages as well, like: higher price, support problems, long waiting for desired features
  8. Special Company needs or process
    my company need special types of process, statistics, reporting, data, running information, logs analyzing. Does the tool support it?
  9. Cost
    Cost is an issue like every other and even more, we cannot decide on tool, which is too expansive, so we must understand our budget limitations and strategy. The cost of the tool is not always so obvious, start using specific tools means purchasing more than single, stand-alone license, working with testing tools will need licensing for production needs and development needs as well, we must consider maintenance cost, support, management and leads, all are cost derived from our purchasing decision and in some cases are varied according the tool we selected.


What do you think?

 If you know  more criterias that should be taken in consideration, I will be happy to read them in the comment area and even add them  into the article, later on.

Please feel free to comment.

Thanks for Reading




Testing tool manufacturers world-wide list
10Levels ABID CONSULTING AccelQ Accord Software ActiMind AdaCore
AdaLog AgileLoad AgileWay Agitar Algorismi ALL4TEC
Andreas Kleffel Android Apache Apica Apollo Systems
Applitools AppPerfect Appsee ApTest Assertible Assure
Atlassian AutoIt Consulti .. Automation Anyw .. Automation Cons .. Axosoft Aztaz Software
Backtrace I/O Badboy BlazeMeter Borvid BrowserStack BSQUARE
BStriker Intern .. CA Technologies Canonical Canoo Engineeri .. Catch Software CelestialTeapot
Chris Mallett Cleanscape ClicTest CloudQA Codeborne CodeCentrix
CodePlex projec .. Codoid Cogitek Compuware Configure IT Conflair
ConSol Core Services Coronys Ltd Countersoft CresTech Softwa .. CrossBrowserTes ..
Crosscheck Netw .. Crowdsourced Te .. Cucumber Ltd Cyara Cygnet Infotech DareBoost
Databene Datamatics Glob .. DevExpress DTM soft Dynatrace LLC EasyQA
Eclipse EkaTechserv Elvior Emmanuel Jorge Empirix EPAM Systems
Equafy Esterel Technol .. eXept Software .. Experitest Finaris Froglogic
FrontEndART Ltd GeneXus GitHub project gnoso Google Code Pro .. GrammaTech
Gurock Software HelpSystems HENIX Hewlett Packard .. Hexawise High-Tech Bridg ..
Hiptest Hitex IBM Rational imbus Shanghai Impetus Inflectra
informUp InTENSO - IT Ex .. Ipswitch Jamo Solutions Janova JAR Technologie ..
JBoss Developer jClarity JetBrains Jively jQuery foundati ..
JS Foundation Jspresso Kanoah KMS Technology Kualitee LDRA Limited
Litmus LoadFocus Loadster Perfor .. MarathonITE Marketcircle Marketcircle
Maveryx Meliora Ltd Micro Focus Sof .. Microsoft Mobile Labs Mobile1st
Mockaroo, LLC Monkop Mozila MSys Technologi .. Navicat NeoTys
Neowise Softwar .. NetCart NORIZZK.COM Novosync Mobili .. NRG Global NTT Resonant
OC Systems Odin Technology OpCord Oracle Orcanos Original Softwa ..
OW2 PANAYA Parasoft PassMark Patterson Consu .. Perfecto Mobile
Pivotal, Inc. Plutora Postman (API To .. PractiTest PrimaTest Process One
Programming Res .. Psoda PureLoad PushToTest Python Q-Assurance
QA Systems QACube QASymphony QAWorks QMetry Quali
Qualitia Softwa .. Quality First S .. Quotium RadView Softwar .. Ranorex RedLine13
Reflective Solu .. ReQtest RevDeBug Robotium Tech Rogue Wave Soft .. Rommana Softwar ..
RTTS Runscope Sandklef GNU La .. Sauce Labs Seapine Softwar ..
SeleniumHQ Sencha Sensiple Siemens PLM Sof .. SmartBear Softw .. SmarteSoft
SOASTA SoftLogica Softomotive Softsmith Solution-Soft SonarSource
Sourceforge Spirent Technol .. SQS Software Qu .. Square Stimulus Techno .. Swifting AB
Synopsys T-komp T-Plan TechExcel TechTalk Telerik By Prog ..
Tellurium Test Collab Test Goat Test Recon TestCaseLab Gm ..
TestCraft Techn .. Testenium TestingBot TestLodge Testmunk
Testomato TestOptimal TestPlant TestPro Testsigma Techn .. Testuff
The Core Bankin .. The MathWorks The Open Group Thoughtbot Thoughtworks Time Simulator Top-Q Trace Technolog .. TrendIC TRICENTIS
Tritusa Pty Ltd TWD Solutions P .. TypeMock Tyto Software Ubertesters UniTESK
Universal Test .. Usetrace Ltd Utrecht Univers .. Validata Group Vanamco AG Vector Software
Veracode Verifaya Corpor .. Verit VersionOne Vornex Inc. WcfStorm Soluti .. We Are Mammoth Web Performance .. Wintask Wireshark Found ..
Worksoft Xceptance XK72 Xpand IT XQual ZAPTEST
Zeenyx Software .. Zephyr Zeta Software zutubi pty

Theme by Danetsoft and Danang Probo Sayekti