testing tools report from it central station...

© 2014 ITCentralStation.com Reproduction Prohibited To read more real user reviews about Testing Tools, please visit: http://www.itcentralstation.com/category/testing-tools

TESTING TOOLS

A PEEK INTO WHAT REAL USERS REALLY THINK

2014

IT Central Station helps enterprise tech professionals by providing

A comprehensive list of all testing tools.

Several real user reviews from enterprise tech

professionals and vendor information.

Specific information to help enterprise tech professionals

select the product that is right for their specific needs.

DISCLAIMER

IT Central Station Ltd. does not endorse or recommend any products or services. The views and opinions of reviewers quoted in this document, IT Central Station websites, and IT Central Station materials (i.e. Content) do not reflect the opinions of IT Central Station. We make no guarantees

about the accuracy, currency, suitability, or quality of the content, and we assume no responsibility for unintended, objectionable, inaccurate, misleading, or unlawful content made available by Content

authors or other third parties


ABOUT IT CENTRAL STATION

User reviews, candid discussions, and more for enterprise technology professionals. The Internet has completely changed the way we make buying decisions. We now use ratings and review sites to see what other real users think before we buy electronics, book a hotel, visit a doctor or choose a restaurant. But in the world of enterprise technology, most of the information online and in your inbox comes from vendors but what you really want is objective information from other users. We created IT Central Station to provide technology professionals like you with a community platform to share information about enterprise software, applications, hardware and services. We commit to offering user-contributed information that is valuable, objective and relevant. We protect your privacy by providing an environment where you can post anonymously and freely express your views. As a result, the community becomes a valuable resource, ensuring you get access to the right information and connect to the right people, whenever you need it.

Use IT Central Station to: • Read and post reviews

of vendors and products • Request or share

information about functionality, quality, and pricing

• Contact real users with relevant product experience

• Get immediate answers to questions

• Validate vendor claims • Exchange tips for

getting the best deals with vendors

ITCentralStation.com

244 5th Avenue,

Suite R-230 New York, NY 10001

USA +1 (646) 328-1944

[email protected]

ABOUT THIS REPORT

This report is comprised of a comprehensive list of all enterprise level testing tools. We have also included several real user reviews posted on ITCentralStation.com. The reviewers of these products have been validated as real users based on their LinkedIn profiles to ensure that they provide reliable opinions and not those of product vendors.


IMPORTANT NOTICE

Did you find this whitepaper helpful? At IT Central Station, our philosophy is “Give to Get”. Our active community and unbiased reviews are made possible by your participation and as such, we ask that you share your expertise with us as well. Please expect to be contacted shortly by an IT Central Station Community Manager. We will ask you for 10 minutes of your time to review a product that you use either via a 10 minute phone interview or questionnaire. You can choose to review anonymously or not and your company name will not be included in the review.

If you found this report and/or the reviews on IT Central Station useful, we would greatly appreciate your participation in giving back to our community.


VENDOR & PRODUCT LIST

V E N D O R P R O D U C T

HP LoadRunner

Apache JMeter

Qualitia Software Qualitia

HP Quality Center

Oracle Oracle Application Testing Suite

HP Service Test

TRICENTIS TOSCA Testsuite

HP QuickTest Professional

Micro Focus Borland Silk

SmartBear Software TestComplete

HP Application Security Center

Appvance Appvance

HP Business Process Testing

Worksoft Certify

SOASTA CloudTest

Compuware Compuware DevPartner

Parasoft Concerto

Micro Focus Data Express

IBM Green Hat Tracker

BlazeMeter JMeter Cloud

Dotcom-Monitor LoadView Stress Testing

Micro Focus Micro Focus DevPartner


Perfecto Mobile MobileCloud

HP Performance Center

Passmark PerformanceTest

NMQA QABook

Compuware QACenter

Original Software Qualify

IBM Rational AppScan

IBM Rational Functional Tester

IBM Rational Performance Tester

IBM Rational Policy Tester

IBM Rational Quality Manager

IBM Rational Service Tester

IBM Rational Software Analyzer

SmarteSoft SmarteSoft Testing Suite

Crosscheck Networks SOAPSonar

Parasoft SOAtest

T-Plan T-Plan

Seapine TestTrack

Testuff Testuff

Microsoft Visual Studio Test Professional

SoftLogica WAPT

Radview WebLOAD


LoadRunner Vendor: HP www.hp.com/go/loadrunner

REVIEW BY A REAL USER

Rutger van der Linden Verified by IT Central Station IT Administrator at a tech services company with 5000+ employees

PROS

• Easy, powerful scripting tool.

• Easy integration of external measurements in test scenarios.

• Extensive vendor documentation and help system included.

• Easy ramping of many concurrent users to make the most representative testing possible.

CONS

• Complexity. LoadRunner is not simple to learn by installing it and "doing it".

• Performance testing with a tool like this requires planning and skilled resources.

• Price. The product costs a few bucks more than the (open source) alternatives

SUMMARY

I'm still impressed by the versatility and plain power of this testing tool. LR's scripting engine is very flexible and the fact that it's able to quickly and easily simulate hundreds of concurrent users makes it the performance testing tool of choice for years running. LR is constantly updated and improved to cope with a changing world. Further, HP offers extensive documentation and support services to help its customer base. True, the product costs a few bucks more than the (open source) alternatives like Neoload, QA Load and others, but in my opinion you get a solid performance test in return.

WHAT REAL USERS ARE SAYING…

“Cost effective performance validation tool.”

“Helps us prevent performance problems by detecting bottlenecks.”

“The product is More user friendly.”


Oracle Application Testing Suite Vendor: Oracle www.oracle.com


itconsul6204 Verified by IT Central Station QA Expert at a tech services company with 5000+ employees

PROS

• This is the best tool I have used till today as it allows us to handle automation in variety of ways. It has lots of features which are bundled together in a single package (e.g. OTM, OFT).

• We can use the same automated test script for functional testing. Lots of features are there in it.

• Best tool for automation on Siebel Object.

CONS

• Need to improve in Object Identification process.

• Performance is slow as compared to other tools like QTP.

• Internet Explorer is facing difficulties in identifying siebel object so browser functionality needs to be improved


“Be sure your team has the right amount of expertise in OpenScript (Java) before deciding to use this product.”

“We can use the same automated test script for functional testing.”


Quality Center Vendor: HP www.hp.com


QAexpert325 Verified by IT Central Station QA Expert at a tech company with 5000+ employees

PROS

• Intuitive GUI: Fairly easy to use and follow.

• Provides interface with other test management systems like JIRA.

• Excellent reporting process including customizable reports and charts. This is very useful for monitoring the progress of QA cycles and communicating the same to the higher management.

CONS

• High licensing cost.

• QC lacks a "watch" feature thus disallowing independent actors such as managers / leads to track progress of issues.

SUMMARY

QC is a versatile Quality management tool that offers test case and defect management capabilities along with a customizable reporting process. It also integrates with other defect and requirement tracking tools making it a good fit in multi-team environments as well as integrated application environment. QC does have an involved initial setup but once done, it is fairly easy to use by testing and defect management teams. However, as QC comes with a high license and maintenance cost, it is more suitable for large projects in terms of cost.


NickW Verified by IT Central Station IT Administrator at a tech vendor with 1-500 employees

PROS

• As long as procedures are clear, then anyone


“The full product is very complex plus the licensing left much to be improved.”

“Flexible, customizable and easy to integrate, but high licensing cost.”

“Very strong product but I would like to see integration with an Agile Tool.”

“HPTC can be a beast if you let it get out of control and get too large a test plan, but has nice tools for testing against a certain release version.”

“I always recommend it as the tool to implement for test management.”

“Extremely versatile QA management tool, but costly!”

“The best test resource management tool for a large company.”

“Robust API and maintains data integrity very well. Great for larger organizations.”


can execute the tests. It no longer has to be the person that initially discovered the issue.

CONS

• Full product is very complex plus the licensing left much to be improved.

SUMMARY

Check the licensing as we had to log off from the tool as the company could not afford a license for every person. The full product is very complex and encompassing. There may be smaller more lightweight tools available. You need to match your requirements to the appropriate tools. HP Quality Center was too complex and complicated tool for the QA organization’s requirements at that time.


TOSCA Testsuite Vendor: Tricentis www.tricentis.com


reviewer72699 Verified by IT Central Station QA Expert at a healthcare company with 500-5000 employees

PROS

• Ease in the maintenance of existing test automation scripts. Because the way TOSCA binds the tests with objects, test data sheet and so on when the time comes for maintenance it is really easy.

CONS • There is no such thing as "No Coding skills

required". Even TOSCA has some custom vb script files that come with the installation that allow you to do certain automation tasks. Also you can create your own vb script files and associate them to modules within TOSCA for further customisation.

SUMMARY

TOSCA is a great tool. A tool that promises no coding skills required. A tool that talks about moving away from conventional test automation methodology of object driven test automation towards model based test automation. But I think it is still a bit further away from reality and will take a few more years to mature & grow on its own.


VJ Verified by IT Central Station Senior Manager of QA at a tech services company with 1-500 employees

DETAILS • It's possible to organize test steps in the library

and reuse them in TC's. For other kinds of references you are free to create custom fields (to store path to other TC for example).

• TOSCA has a lot of engines (HTML, .NET, Java, Webservices, etc.) with control library's that can be used out of the box. For something that is not covered by these engines (like a custom


“ Very rich automation/test management framework but consider the coding needed to integrate with your application”

“I would recommend it to a team which does not have much reliance on technical testers but more with business testers”

“ Good Visual representation, easy to understand and comfortable to implement business ideas”

“ Great tool but I think it will take a few more years to mature & grow”


java widget) you will need to code for steering. • It's possible to organize test steps in the library

and reuse them in TC's. For other kinds of references you are free to create custom fields (to store path to other TC for example).

• You can trigger TOSCA execution using the TOSCA API from cmd line using windows scheduled jobs.

• You can use multi-user repository, which has checkin/checkout operations like SVN or CVS. You can also export your TC's or other TOSCA objects to file and import to other local/shared repository

SUMMARY Overall impression about TOSCA is quite positive - it's a very rich automation/test management framework. In the right hands it can be used for creation of a really powerful and complex solution. There are many more features that are useful for automation but there can really be a need for some coding effort to integrate with your application - this needs to be considered.


Join the IT Central Station Community

This report features just a few of the testing tools reviews on IT Central Station. If you would like to read more about what real users are saying about the many testing tools on the market, visit the Testing Tools page at IT Central Station:

http://www.itcentralstation.com/category/testing-tools

There are a number of ways you can participate in the IT Central Station community! Write a review, read a comment, or just follow a product. Either way, we’ll be sure to let you know when people are talking about the solutions you care about!

Give to Get

Did you find this whitepaper helpful? At IT Central Station, our philosophy is “Give to Get”. Our active community and unbiased reviews are made possible by your participation and as such, we ask that you share your expertise with us as well. Please expect to be contacted shortly by an IT Central Station Community Manager. We will ask you for 10 minutes of your time to review a product that you use either via a 10 minute phone interview or questionnaire. You can choose to review anonymously or not and your company name will not be included in the review.

If you found this report and/or the reviews on IT Central Station useful, we would greatly appreciate your participation in giving back to our community.

testing tools report from it central station...

Documents