software testing circus

64
www.TestingCircus.com Testing Circus Volume 2 - Issue 12 - December 2011 Your Monthly Magazine on Software Testing Is GOD a Tester or a Developer?

Upload: niravkpathak2482

Post on 16-Apr-2015

36 views

Category:

Documents


1 download

DESCRIPTION

Testing circus document

TRANSCRIPT

Page 1: software Testing Circus

wwwTestingCircuscom

Testing CircusVolume 2 - Issue 12 - December 2011

Your Monthly Magazineon

Software Testing

Is GOD

a Tester or

a Developer

Moolya is HIRINGPassionate Software Tester- Associate Senior and LeadOur company aims to re-shape the way software testing is done in Indiaand we are looking to hire testers who are passionate about softwaretesting and want to be a fabulous tester in the time to come

Some of our pre-requisites Testing experience of web applications server desktop client amp

mobile applications amp gadgets Someone who can understand business goals of our client amp

determine what tests help in testing those business goals Exploratory testing approach Excellent English communication skills (If you mess up on this we

may not hire) Excellent in finding bugs and reporting it in clear manner Good learner Being able to adapt to changes quickly Lead a team of testers (for Lead position) Asks important questions Risk assessment of product Good in determining test coverage True Leader Creative Has decent skills and commitment on automation Open source testing tools Wearing the business analyst hat when needed Has read testing books (No not the ISTQB) Skilled in testing software Willing to be a part of an exciting startup

Salary INR 125000 - 625000 PA + Medical Insurance

Education We dont bother if you have BE BTech as long asyou are passionate about testing can test well want to beknown for your skills

Contact DetailsContact Person Mampi DasContact Company Moolya Software Testing Private LimitedAddress 251 9th Cross JP Nagar 2nd Phase BANGALOREKarnataka India 560078Email Address careersmoolyacomTelephone 91-80-26590022Twitter Facebook

Moolya is a new generation softwaretesting company from India founded inDecember 2010 and achieving a breakeven within its first year of operation Itis a group of some of the top awardwinning testers of India and hascustomers who are multi billion dollarcompanies to startups and works onproducts that serve millions ofcustomers worldwide

Moolya pioneers lot of creative thinkingtype testing and is aiming to re-shapethe way testing is done and perceived inIndia Moolyavans (Moolya testers) areexcited about the journey they have hadso far We dont call our testers asresources because they arentresources We dont count heads wecount brains We are young and highlyenergetic team Would you match ourpace

httpwwwmoolyacom

wwwTestingCircuscom December 2011 - 02 -

Come join the

Apple of

Software Testing

From the Keyboard of Editor-in-ChiefAnother year is passing by and we are readyto welcome a brand New Year in few days Itis time we made some New Year resolutionSo what is New Year resolutionFewsuggestions from my side ndash1 Write down your career aspirations andcreate a SMART goal SMART beingspecific measurable attainable realistic andtime bound I have found most of the NewYear resolutions unrealistic and attainableWrite it down and try to achieve it Dreamit and you will be able to achieve it2 Are suffering from wallflower syndromeMost of you are Well the salary checkarrives at the end of every month That is okBut if you keep on being the wallflower youare blocking your own career growth Jumpout and take initiatives in youruncomfortable area3 Keep yourself in a ldquofire brigaderdquo modeAlways ready for next opportunity modeKeep your skills updated Do not wait for acrisis to happen to start learning new orimproving upon your old skills Be readyThe world has just become veryunpredictable Your job is not that safeanymore Ask yourself this question ndash whatdid I learn in the last 12 months You havejust wasted another year updating facebook

twitter status and liking other friendsrsquofunny photographs and videos These likesand shares will never give you a boost tocareer4 Invest in yourself Do not hesitate to buybooks join coaching classes and attendlecturesconferences on your domain Ohyes you can avoid those cigarettes colas andpizzas and save money to pay for thingswhich make your IQ fatter and healthier5 You testers ndash resolve to write an article forTesting Circus in 2012 Testing Circuswelcomes articles from newbie and expertsalike Our editorial team will help you refineyour article if required Take out thatpenpaper (mousekeyboard) and startscribing Make your heart proud of the testerinside youWe thank everyone who helped us run thismagazine in the last one and half years Wewish you a very happy exciting and aneventful year ahead Enjoy 2012 and happytesting

- Ajoy Kumar SinghaEditor-in-Chief

httptwittercomajoysinghaeditortestingcircuscom

Write to us at editortestingcircuscom

wwwTestingCircuscom December 2011 - 03 -

In this issueIn this issueVolume 2 - Issue 12 - December 2011

wwwTestingCircuscom December 2011 - 04 -

Testing Circus

Editorial Ajoy Kumar Singha 3

Letter to the Editor 5

Is GOD a tester or a developer Jayshree Rathod 6

Test Coverage ndash Industry Standards Gagneet Singh 14

Book Wormrsquos Corner WoBo 17

Crack The Code Blindu Eusebiu 18

Testers at Twitter 19

Beyond Junior Testing Skills Matthew Heusser 15

Bringing Exploratory Testing into Your Test Department Mark Garzone 25

Promoting Software Testing in Your Organization Rob van Steenbergen 27

Testing Events around the World - January 2012 32

The Stolen Idea Fake Software Tester 35

What is a Testerrsquos Role in Quality Bernice Niel Ruhland 37

QTP Code Corner Jaijeet Pandey 42

Software Testing News 43

Testing Corner Tools Journal 47

Interview with Lisa Crispin Mohinder Khosla 61

Letters straight from the readers

I saw the Magazine today It is really really good with lot of things to learn from itThank you to all for this good work

RegardsKoti Mohan (via our Facebook Page)

------------------------------------------

This one is a unique magazine with new concept This is the kind of magazine I waslooking for The other magazines with theoretical thesis which are boring and hasno practical value to testers working in service based companies Your magazinehas all the ingredients which are I would say a great mix of infotainment sectionsExcellent work team

Rosalyn Mackenzie

------------------------------------------I donrsquot believe this is a free magazine Is print version available for this magazineWhere do I get it in Mumbai

Nand Kishore

- Dear Nand Kishore the print version is not available for this magazine We willremain free forever Enjoy learning with our e-version - Editor

Write to us ateditortestingcircuscom

Letter to the Edi

tor

wwwTestingCircuscom December 2011 - 05 -

Jayshree RathodI had thought to write something relating to Testingsince I joined Testing But whenever I thought towrite something neutrons started bombarding mypoor mind which then used to divide into severalpieces in the form of questions Like - are you readyWhat would you write about Why are you writingthis Will you finish it Will you write again Andchoosing the subject was very difficult for me I wantto make sure that whatever I write about should bean outcome of my own thoughts and imaginationseven if it sounds ridiculous to someall

Then I banged on a topic ndash is the creator of thisuniverse a tester or a developer Do we have somesymptoms by which we can say God is a tester or adeveloper This is a little debatable topic comparedto classical topics that we cover in magazine likeTesting Circus

Why this topicAfter joining testing I couldnrsquot stop myself fromrelating Testing with what I see all around I alwaysthink about what role God plays and how and whereHe fits in our development life cycle

God - a Developer1) God Seeing some people andor their behavior

we often say God has made himher in haste or in avery bad moodDeveloper We see some buggy code and sayldquoDeveloper has really made it in haste or has notunderstood the logic rightrdquo

2) God For the issues of our daily lives we blamethe God After all he designed us and others (wehave problems with) So isnrsquot it his duty to solve ourproblems we face

Developer For the defects of the softwarerespective developer is blamed and then the defect isassigned to him amp it is his duty to resolve it

3) God Some creatures in this world are really aboveour imaginations I wonder how God so beautifullypaints them Only he can create such beings InHindus we have different GodsGoddess fordifferent purpose Eg for Wealth- Laxmiji ForKnowledge- Saraswatiji For Fame ndash Ganeshji to getrid of Fears ndash Hanumanji and here is the best if noneof them listen to your wishes go to Shiv ji

wwwTestingCircuscom December 2011 - 06 -

Is GOD a Tester or a developer

- Jayshree Rathod amp our Facebook Page Subscribers

Developer In software world also we need differentdevelopers to solve our problems like JavaDeveloper Web Developer Net Developer Joomladeveloper PHP developer and many morehellip tobuild desired applications

4) God When we get things sorted out in a rightmanner we say oh Thank you god finally youlistened to meDeveloper When software gets it major bugsresolved and clients feedback is good Developergets a pat on their back for the good work they did

5) God Criticize your God and wait for the resultsYou will get lessons back in some formsDeveloper Tell developer about a new defect youfound and you will get an instant message from himor he would appear in person if possible discussingwhy the defect is not defect

God - a Tester1) God We get up in the morning and if see anyproblems we say oh God so you know I was happyyesterday and you canrsquot bear everything works finehmmmmTester When a Tester says defects are not resolvedyet and I need to reopen them againDeveloper says You (Tester) never acknowledge mywork and are always ready to throw problemsNothing seems right to you Isnrsquot it

2) God Sometimes unexpected or unplannedcircumstances appear and we say oh God Why am Ifacing this now or why didnrsquot you make me awarewell before I could have avoided this easilyTester Client finds some new or severe bugsEverybody nods - Hey Our Tester(s) might have nottested the product well enough OR why heshe hasnot found these bugs early

3) God Often people could not believe if somethinggood can happens to them and say I canrsquot believe Ihave got this OR have I achieved this really Anddoubt GodTester Sometimes Developer gets surprised anddoubts testerrsquos credibility if their module gets passedat first Hey man have you tested it all Really is thatworked fine

4) God Most people think God himself does nothave to face such situations and so he createsproblems for othersTester Most people think Testers dont have or neednot have any qualifications and when they couldntbuild it themselves testers get happy finding defectsin otherlsquos work

5) God In every religions every God says somethingmostly they all says the something in differentbooks People often use the terms Jesus says to dothis or Krishna says to do this or Allah says to dothis So we all use our Gods to make someone dosomething which we want himher to doTester Whenever Testers reports a bug every Testeruses the term User However tester reports a bugand he wants the bug to be resolved he does notbecome the customer directly He presents the Useras the customer of the bug

6) God I used to read Geeta every day before I leavefor work But when I was getting late I used to skipreading to catch the bus on time I have closelyobserved that whenever I skip reading I never gotbus on time even if I reach bus stop on time To testthis I had even skipped readings intentionally even ifI had enough time But on those days I could never

wwwTestingCircuscom December 2011 - 07 -

catch the bus on time I really wondered and used toask in an angry voice ldquoDo you really want me toread it every day for you So even God sometimescreates obstacles when we donrsquot keep healthyrelationshipTester Well I donrsquot do it but have often heard thatsome testers get upset and angry when developersunderestimate them or doubt their credibility to testtheir code So when testers donrsquot share a goodrelationship with developers testers try to reopenmajor bugs on last minutes so that developers gethard times

We had asked our readers toexpress their opinion on the sametopic Many readers logged intoour Facebook page andcommented on the discussion ldquoIsGOD a Tester or a developerrdquo

Here is what they have to say -

Nicolaacutes Sebastiaacuten Domeniconi Clearly GOD is aDeveloper who created TestDrivenDevelopment Lifethat we call Evolution

Aacuteine McGovern I reckon a PO overseeingeverything and making demands

Saurava Singh GOD is above TESTING andDEVELOPEMENT

Gagan Talwar God is both developer and tester (Farbeyond all such things too) He creates us developus test us by giving hard time test us by giving uspains test us by giving extra happiness to seewhether we remember him or not N when bugsenter when we get old and it needs to be recycledthen he calls us back recycle us n send us in newshape n new place )

Amol Punse God is Beyond allHe can create testdestroy maintain

Yamini Kala GOD is a developer cum Tester )

Karthik Arumugam Lets put it this way God hasmany facetsGod of Creation DeveloperGod of DestructionBenefactor TesterAny takers for God of PreservationProjectManager may be

Manvinder Kaur God is a developer as well astester God created (fully tested) creatures thathuman cannot replicate Human is learning for Godsdevelopment For example God developed Lotuswith leaves where water cannot resist people try toreplicate how to create self-cleaning paint and self-cleaning roofs There are plenty of examples for aGod as very good developer and excellent tester

Sudipto Paul God is author of Human developmentlife cycle (HDLC)Herere are the stages of this life cycle- Childhood- Adolescence- Adulthood- RetirementEach of the stages has input data required to be fedbased on the requirements either of the guardian orof the subjectThere are best practices on both how these are to beadministered and how the administered goods areto be absorbedFinally both God and Humans can easily tell thequality of the end product

Mandeep Sharma God is Developerbut Tester ismaha kaalwho can destroyany thingcreatedeven by god

M Rutherford Ejimonu My God is first a Developerand then a tester and then above bothHe developUs and everything around usand then He Tests ourlove to him by giving my first Fathers Adamtheinstruction Not to eat of the fruit in the middle of the

wwwTestingCircuscom December 2011 - 08 -

genderWhen that test failedHe Presented Uswith yet another to abide by the TenCommandmentWhen that further failedHe gaveus the current last one to Just accept the gift ofsalvation via His Only SonThe Rest isHistory

Sharad Pawar GOD is Developer as well as tester

Rahul Srivastava God is neither a Developer nortester God is architect

Shubhangi Chhibber God is both developer as wellas tester

Ajay Patel God is first developer and then tester

Amit Bhandari GOD IS DEVELOPER AS WELL ASTESTER

Sapan Dey God is Developer amp Tester both Wecannot give away both of them If they will workwith together then we can give quality product tothe customer So both of them are important Wecannot categorize them

Ajay Godbole If we think from a HinduPerspective then Lord Bramha is a Developer LordVishnu is one who maintains it and Lord Shiva is aTester

Quality Analyst God is Tester for sure he tested usin real time Scenario without any specific Test PlanWith Negative Test cases and check ourcompatibility testing

Suresh Gattu God is neither a tester nor any otherIT faculty to begin with as all these positions are forHomo sapiens Closest our QA understanding canget to god is anything error free(perfect) Also the10 (binary number 2) requirements for being godincludea) Being omnipresent (1) in everything physical andeternalb) Having Neutrality (0) in Bias and Judgment to allAnd at core 1 amp 0 form everything that a Computercan relate to and as a Tester we ensure that thesources that turn into these 1s and 0s are correct atthe human side before being translated to systemside Which means we ensure that the requirementsare met to be God (error free)

Narayan Raman Well given that Shiv Bhagvaan iscalled Maha-Dev

Suresh Gattu God has this on his resumeArchitected Universe Developed Creatures toPerformance test Life Mentored humans onSPEACH SMILE platforms Lead all phases of SDLC(Species Development Life Cycle)

Nikunj Kathiria First god is a Developer (Developshumans) after that god is a tester (test humanity)

wwwTestingCircuscom December 2011 - 09 -

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 2: software Testing Circus

Moolya is HIRINGPassionate Software Tester- Associate Senior and LeadOur company aims to re-shape the way software testing is done in Indiaand we are looking to hire testers who are passionate about softwaretesting and want to be a fabulous tester in the time to come

Some of our pre-requisites Testing experience of web applications server desktop client amp

mobile applications amp gadgets Someone who can understand business goals of our client amp

determine what tests help in testing those business goals Exploratory testing approach Excellent English communication skills (If you mess up on this we

may not hire) Excellent in finding bugs and reporting it in clear manner Good learner Being able to adapt to changes quickly Lead a team of testers (for Lead position) Asks important questions Risk assessment of product Good in determining test coverage True Leader Creative Has decent skills and commitment on automation Open source testing tools Wearing the business analyst hat when needed Has read testing books (No not the ISTQB) Skilled in testing software Willing to be a part of an exciting startup

Salary INR 125000 - 625000 PA + Medical Insurance

Education We dont bother if you have BE BTech as long asyou are passionate about testing can test well want to beknown for your skills

Contact DetailsContact Person Mampi DasContact Company Moolya Software Testing Private LimitedAddress 251 9th Cross JP Nagar 2nd Phase BANGALOREKarnataka India 560078Email Address careersmoolyacomTelephone 91-80-26590022Twitter Facebook

Moolya is a new generation softwaretesting company from India founded inDecember 2010 and achieving a breakeven within its first year of operation Itis a group of some of the top awardwinning testers of India and hascustomers who are multi billion dollarcompanies to startups and works onproducts that serve millions ofcustomers worldwide

Moolya pioneers lot of creative thinkingtype testing and is aiming to re-shapethe way testing is done and perceived inIndia Moolyavans (Moolya testers) areexcited about the journey they have hadso far We dont call our testers asresources because they arentresources We dont count heads wecount brains We are young and highlyenergetic team Would you match ourpace

httpwwwmoolyacom

wwwTestingCircuscom December 2011 - 02 -

Come join the

Apple of

Software Testing

From the Keyboard of Editor-in-ChiefAnother year is passing by and we are readyto welcome a brand New Year in few days Itis time we made some New Year resolutionSo what is New Year resolutionFewsuggestions from my side ndash1 Write down your career aspirations andcreate a SMART goal SMART beingspecific measurable attainable realistic andtime bound I have found most of the NewYear resolutions unrealistic and attainableWrite it down and try to achieve it Dreamit and you will be able to achieve it2 Are suffering from wallflower syndromeMost of you are Well the salary checkarrives at the end of every month That is okBut if you keep on being the wallflower youare blocking your own career growth Jumpout and take initiatives in youruncomfortable area3 Keep yourself in a ldquofire brigaderdquo modeAlways ready for next opportunity modeKeep your skills updated Do not wait for acrisis to happen to start learning new orimproving upon your old skills Be readyThe world has just become veryunpredictable Your job is not that safeanymore Ask yourself this question ndash whatdid I learn in the last 12 months You havejust wasted another year updating facebook

twitter status and liking other friendsrsquofunny photographs and videos These likesand shares will never give you a boost tocareer4 Invest in yourself Do not hesitate to buybooks join coaching classes and attendlecturesconferences on your domain Ohyes you can avoid those cigarettes colas andpizzas and save money to pay for thingswhich make your IQ fatter and healthier5 You testers ndash resolve to write an article forTesting Circus in 2012 Testing Circuswelcomes articles from newbie and expertsalike Our editorial team will help you refineyour article if required Take out thatpenpaper (mousekeyboard) and startscribing Make your heart proud of the testerinside youWe thank everyone who helped us run thismagazine in the last one and half years Wewish you a very happy exciting and aneventful year ahead Enjoy 2012 and happytesting

- Ajoy Kumar SinghaEditor-in-Chief

httptwittercomajoysinghaeditortestingcircuscom

Write to us at editortestingcircuscom

wwwTestingCircuscom December 2011 - 03 -

In this issueIn this issueVolume 2 - Issue 12 - December 2011

wwwTestingCircuscom December 2011 - 04 -

Testing Circus

Editorial Ajoy Kumar Singha 3

Letter to the Editor 5

Is GOD a tester or a developer Jayshree Rathod 6

Test Coverage ndash Industry Standards Gagneet Singh 14

Book Wormrsquos Corner WoBo 17

Crack The Code Blindu Eusebiu 18

Testers at Twitter 19

Beyond Junior Testing Skills Matthew Heusser 15

Bringing Exploratory Testing into Your Test Department Mark Garzone 25

Promoting Software Testing in Your Organization Rob van Steenbergen 27

Testing Events around the World - January 2012 32

The Stolen Idea Fake Software Tester 35

What is a Testerrsquos Role in Quality Bernice Niel Ruhland 37

QTP Code Corner Jaijeet Pandey 42

Software Testing News 43

Testing Corner Tools Journal 47

Interview with Lisa Crispin Mohinder Khosla 61

Letters straight from the readers

I saw the Magazine today It is really really good with lot of things to learn from itThank you to all for this good work

RegardsKoti Mohan (via our Facebook Page)

------------------------------------------

This one is a unique magazine with new concept This is the kind of magazine I waslooking for The other magazines with theoretical thesis which are boring and hasno practical value to testers working in service based companies Your magazinehas all the ingredients which are I would say a great mix of infotainment sectionsExcellent work team

Rosalyn Mackenzie

------------------------------------------I donrsquot believe this is a free magazine Is print version available for this magazineWhere do I get it in Mumbai

Nand Kishore

- Dear Nand Kishore the print version is not available for this magazine We willremain free forever Enjoy learning with our e-version - Editor

Write to us ateditortestingcircuscom

Letter to the Edi

tor

wwwTestingCircuscom December 2011 - 05 -

Jayshree RathodI had thought to write something relating to Testingsince I joined Testing But whenever I thought towrite something neutrons started bombarding mypoor mind which then used to divide into severalpieces in the form of questions Like - are you readyWhat would you write about Why are you writingthis Will you finish it Will you write again Andchoosing the subject was very difficult for me I wantto make sure that whatever I write about should bean outcome of my own thoughts and imaginationseven if it sounds ridiculous to someall

Then I banged on a topic ndash is the creator of thisuniverse a tester or a developer Do we have somesymptoms by which we can say God is a tester or adeveloper This is a little debatable topic comparedto classical topics that we cover in magazine likeTesting Circus

Why this topicAfter joining testing I couldnrsquot stop myself fromrelating Testing with what I see all around I alwaysthink about what role God plays and how and whereHe fits in our development life cycle

God - a Developer1) God Seeing some people andor their behavior

we often say God has made himher in haste or in avery bad moodDeveloper We see some buggy code and sayldquoDeveloper has really made it in haste or has notunderstood the logic rightrdquo

2) God For the issues of our daily lives we blamethe God After all he designed us and others (wehave problems with) So isnrsquot it his duty to solve ourproblems we face

Developer For the defects of the softwarerespective developer is blamed and then the defect isassigned to him amp it is his duty to resolve it

3) God Some creatures in this world are really aboveour imaginations I wonder how God so beautifullypaints them Only he can create such beings InHindus we have different GodsGoddess fordifferent purpose Eg for Wealth- Laxmiji ForKnowledge- Saraswatiji For Fame ndash Ganeshji to getrid of Fears ndash Hanumanji and here is the best if noneof them listen to your wishes go to Shiv ji

wwwTestingCircuscom December 2011 - 06 -

Is GOD a Tester or a developer

- Jayshree Rathod amp our Facebook Page Subscribers

Developer In software world also we need differentdevelopers to solve our problems like JavaDeveloper Web Developer Net Developer Joomladeveloper PHP developer and many morehellip tobuild desired applications

4) God When we get things sorted out in a rightmanner we say oh Thank you god finally youlistened to meDeveloper When software gets it major bugsresolved and clients feedback is good Developergets a pat on their back for the good work they did

5) God Criticize your God and wait for the resultsYou will get lessons back in some formsDeveloper Tell developer about a new defect youfound and you will get an instant message from himor he would appear in person if possible discussingwhy the defect is not defect

God - a Tester1) God We get up in the morning and if see anyproblems we say oh God so you know I was happyyesterday and you canrsquot bear everything works finehmmmmTester When a Tester says defects are not resolvedyet and I need to reopen them againDeveloper says You (Tester) never acknowledge mywork and are always ready to throw problemsNothing seems right to you Isnrsquot it

2) God Sometimes unexpected or unplannedcircumstances appear and we say oh God Why am Ifacing this now or why didnrsquot you make me awarewell before I could have avoided this easilyTester Client finds some new or severe bugsEverybody nods - Hey Our Tester(s) might have nottested the product well enough OR why heshe hasnot found these bugs early

3) God Often people could not believe if somethinggood can happens to them and say I canrsquot believe Ihave got this OR have I achieved this really Anddoubt GodTester Sometimes Developer gets surprised anddoubts testerrsquos credibility if their module gets passedat first Hey man have you tested it all Really is thatworked fine

4) God Most people think God himself does nothave to face such situations and so he createsproblems for othersTester Most people think Testers dont have or neednot have any qualifications and when they couldntbuild it themselves testers get happy finding defectsin otherlsquos work

5) God In every religions every God says somethingmostly they all says the something in differentbooks People often use the terms Jesus says to dothis or Krishna says to do this or Allah says to dothis So we all use our Gods to make someone dosomething which we want himher to doTester Whenever Testers reports a bug every Testeruses the term User However tester reports a bugand he wants the bug to be resolved he does notbecome the customer directly He presents the Useras the customer of the bug

6) God I used to read Geeta every day before I leavefor work But when I was getting late I used to skipreading to catch the bus on time I have closelyobserved that whenever I skip reading I never gotbus on time even if I reach bus stop on time To testthis I had even skipped readings intentionally even ifI had enough time But on those days I could never

wwwTestingCircuscom December 2011 - 07 -

catch the bus on time I really wondered and used toask in an angry voice ldquoDo you really want me toread it every day for you So even God sometimescreates obstacles when we donrsquot keep healthyrelationshipTester Well I donrsquot do it but have often heard thatsome testers get upset and angry when developersunderestimate them or doubt their credibility to testtheir code So when testers donrsquot share a goodrelationship with developers testers try to reopenmajor bugs on last minutes so that developers gethard times

We had asked our readers toexpress their opinion on the sametopic Many readers logged intoour Facebook page andcommented on the discussion ldquoIsGOD a Tester or a developerrdquo

Here is what they have to say -

Nicolaacutes Sebastiaacuten Domeniconi Clearly GOD is aDeveloper who created TestDrivenDevelopment Lifethat we call Evolution

Aacuteine McGovern I reckon a PO overseeingeverything and making demands

Saurava Singh GOD is above TESTING andDEVELOPEMENT

Gagan Talwar God is both developer and tester (Farbeyond all such things too) He creates us developus test us by giving hard time test us by giving uspains test us by giving extra happiness to seewhether we remember him or not N when bugsenter when we get old and it needs to be recycledthen he calls us back recycle us n send us in newshape n new place )

Amol Punse God is Beyond allHe can create testdestroy maintain

Yamini Kala GOD is a developer cum Tester )

Karthik Arumugam Lets put it this way God hasmany facetsGod of Creation DeveloperGod of DestructionBenefactor TesterAny takers for God of PreservationProjectManager may be

Manvinder Kaur God is a developer as well astester God created (fully tested) creatures thathuman cannot replicate Human is learning for Godsdevelopment For example God developed Lotuswith leaves where water cannot resist people try toreplicate how to create self-cleaning paint and self-cleaning roofs There are plenty of examples for aGod as very good developer and excellent tester

Sudipto Paul God is author of Human developmentlife cycle (HDLC)Herere are the stages of this life cycle- Childhood- Adolescence- Adulthood- RetirementEach of the stages has input data required to be fedbased on the requirements either of the guardian orof the subjectThere are best practices on both how these are to beadministered and how the administered goods areto be absorbedFinally both God and Humans can easily tell thequality of the end product

Mandeep Sharma God is Developerbut Tester ismaha kaalwho can destroyany thingcreatedeven by god

M Rutherford Ejimonu My God is first a Developerand then a tester and then above bothHe developUs and everything around usand then He Tests ourlove to him by giving my first Fathers Adamtheinstruction Not to eat of the fruit in the middle of the

wwwTestingCircuscom December 2011 - 08 -

genderWhen that test failedHe Presented Uswith yet another to abide by the TenCommandmentWhen that further failedHe gaveus the current last one to Just accept the gift ofsalvation via His Only SonThe Rest isHistory

Sharad Pawar GOD is Developer as well as tester

Rahul Srivastava God is neither a Developer nortester God is architect

Shubhangi Chhibber God is both developer as wellas tester

Ajay Patel God is first developer and then tester

Amit Bhandari GOD IS DEVELOPER AS WELL ASTESTER

Sapan Dey God is Developer amp Tester both Wecannot give away both of them If they will workwith together then we can give quality product tothe customer So both of them are important Wecannot categorize them

Ajay Godbole If we think from a HinduPerspective then Lord Bramha is a Developer LordVishnu is one who maintains it and Lord Shiva is aTester

Quality Analyst God is Tester for sure he tested usin real time Scenario without any specific Test PlanWith Negative Test cases and check ourcompatibility testing

Suresh Gattu God is neither a tester nor any otherIT faculty to begin with as all these positions are forHomo sapiens Closest our QA understanding canget to god is anything error free(perfect) Also the10 (binary number 2) requirements for being godincludea) Being omnipresent (1) in everything physical andeternalb) Having Neutrality (0) in Bias and Judgment to allAnd at core 1 amp 0 form everything that a Computercan relate to and as a Tester we ensure that thesources that turn into these 1s and 0s are correct atthe human side before being translated to systemside Which means we ensure that the requirementsare met to be God (error free)

Narayan Raman Well given that Shiv Bhagvaan iscalled Maha-Dev

Suresh Gattu God has this on his resumeArchitected Universe Developed Creatures toPerformance test Life Mentored humans onSPEACH SMILE platforms Lead all phases of SDLC(Species Development Life Cycle)

Nikunj Kathiria First god is a Developer (Developshumans) after that god is a tester (test humanity)

wwwTestingCircuscom December 2011 - 09 -

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 3: software Testing Circus

From the Keyboard of Editor-in-ChiefAnother year is passing by and we are readyto welcome a brand New Year in few days Itis time we made some New Year resolutionSo what is New Year resolutionFewsuggestions from my side ndash1 Write down your career aspirations andcreate a SMART goal SMART beingspecific measurable attainable realistic andtime bound I have found most of the NewYear resolutions unrealistic and attainableWrite it down and try to achieve it Dreamit and you will be able to achieve it2 Are suffering from wallflower syndromeMost of you are Well the salary checkarrives at the end of every month That is okBut if you keep on being the wallflower youare blocking your own career growth Jumpout and take initiatives in youruncomfortable area3 Keep yourself in a ldquofire brigaderdquo modeAlways ready for next opportunity modeKeep your skills updated Do not wait for acrisis to happen to start learning new orimproving upon your old skills Be readyThe world has just become veryunpredictable Your job is not that safeanymore Ask yourself this question ndash whatdid I learn in the last 12 months You havejust wasted another year updating facebook

twitter status and liking other friendsrsquofunny photographs and videos These likesand shares will never give you a boost tocareer4 Invest in yourself Do not hesitate to buybooks join coaching classes and attendlecturesconferences on your domain Ohyes you can avoid those cigarettes colas andpizzas and save money to pay for thingswhich make your IQ fatter and healthier5 You testers ndash resolve to write an article forTesting Circus in 2012 Testing Circuswelcomes articles from newbie and expertsalike Our editorial team will help you refineyour article if required Take out thatpenpaper (mousekeyboard) and startscribing Make your heart proud of the testerinside youWe thank everyone who helped us run thismagazine in the last one and half years Wewish you a very happy exciting and aneventful year ahead Enjoy 2012 and happytesting

- Ajoy Kumar SinghaEditor-in-Chief

httptwittercomajoysinghaeditortestingcircuscom

Write to us at editortestingcircuscom

wwwTestingCircuscom December 2011 - 03 -

In this issueIn this issueVolume 2 - Issue 12 - December 2011

wwwTestingCircuscom December 2011 - 04 -

Testing Circus

Editorial Ajoy Kumar Singha 3

Letter to the Editor 5

Is GOD a tester or a developer Jayshree Rathod 6

Test Coverage ndash Industry Standards Gagneet Singh 14

Book Wormrsquos Corner WoBo 17

Crack The Code Blindu Eusebiu 18

Testers at Twitter 19

Beyond Junior Testing Skills Matthew Heusser 15

Bringing Exploratory Testing into Your Test Department Mark Garzone 25

Promoting Software Testing in Your Organization Rob van Steenbergen 27

Testing Events around the World - January 2012 32

The Stolen Idea Fake Software Tester 35

What is a Testerrsquos Role in Quality Bernice Niel Ruhland 37

QTP Code Corner Jaijeet Pandey 42

Software Testing News 43

Testing Corner Tools Journal 47

Interview with Lisa Crispin Mohinder Khosla 61

Letters straight from the readers

I saw the Magazine today It is really really good with lot of things to learn from itThank you to all for this good work

RegardsKoti Mohan (via our Facebook Page)

------------------------------------------

This one is a unique magazine with new concept This is the kind of magazine I waslooking for The other magazines with theoretical thesis which are boring and hasno practical value to testers working in service based companies Your magazinehas all the ingredients which are I would say a great mix of infotainment sectionsExcellent work team

Rosalyn Mackenzie

------------------------------------------I donrsquot believe this is a free magazine Is print version available for this magazineWhere do I get it in Mumbai

Nand Kishore

- Dear Nand Kishore the print version is not available for this magazine We willremain free forever Enjoy learning with our e-version - Editor

Write to us ateditortestingcircuscom

Letter to the Edi

tor

wwwTestingCircuscom December 2011 - 05 -

Jayshree RathodI had thought to write something relating to Testingsince I joined Testing But whenever I thought towrite something neutrons started bombarding mypoor mind which then used to divide into severalpieces in the form of questions Like - are you readyWhat would you write about Why are you writingthis Will you finish it Will you write again Andchoosing the subject was very difficult for me I wantto make sure that whatever I write about should bean outcome of my own thoughts and imaginationseven if it sounds ridiculous to someall

Then I banged on a topic ndash is the creator of thisuniverse a tester or a developer Do we have somesymptoms by which we can say God is a tester or adeveloper This is a little debatable topic comparedto classical topics that we cover in magazine likeTesting Circus

Why this topicAfter joining testing I couldnrsquot stop myself fromrelating Testing with what I see all around I alwaysthink about what role God plays and how and whereHe fits in our development life cycle

God - a Developer1) God Seeing some people andor their behavior

we often say God has made himher in haste or in avery bad moodDeveloper We see some buggy code and sayldquoDeveloper has really made it in haste or has notunderstood the logic rightrdquo

2) God For the issues of our daily lives we blamethe God After all he designed us and others (wehave problems with) So isnrsquot it his duty to solve ourproblems we face

Developer For the defects of the softwarerespective developer is blamed and then the defect isassigned to him amp it is his duty to resolve it

3) God Some creatures in this world are really aboveour imaginations I wonder how God so beautifullypaints them Only he can create such beings InHindus we have different GodsGoddess fordifferent purpose Eg for Wealth- Laxmiji ForKnowledge- Saraswatiji For Fame ndash Ganeshji to getrid of Fears ndash Hanumanji and here is the best if noneof them listen to your wishes go to Shiv ji

wwwTestingCircuscom December 2011 - 06 -

Is GOD a Tester or a developer

- Jayshree Rathod amp our Facebook Page Subscribers

Developer In software world also we need differentdevelopers to solve our problems like JavaDeveloper Web Developer Net Developer Joomladeveloper PHP developer and many morehellip tobuild desired applications

4) God When we get things sorted out in a rightmanner we say oh Thank you god finally youlistened to meDeveloper When software gets it major bugsresolved and clients feedback is good Developergets a pat on their back for the good work they did

5) God Criticize your God and wait for the resultsYou will get lessons back in some formsDeveloper Tell developer about a new defect youfound and you will get an instant message from himor he would appear in person if possible discussingwhy the defect is not defect

God - a Tester1) God We get up in the morning and if see anyproblems we say oh God so you know I was happyyesterday and you canrsquot bear everything works finehmmmmTester When a Tester says defects are not resolvedyet and I need to reopen them againDeveloper says You (Tester) never acknowledge mywork and are always ready to throw problemsNothing seems right to you Isnrsquot it

2) God Sometimes unexpected or unplannedcircumstances appear and we say oh God Why am Ifacing this now or why didnrsquot you make me awarewell before I could have avoided this easilyTester Client finds some new or severe bugsEverybody nods - Hey Our Tester(s) might have nottested the product well enough OR why heshe hasnot found these bugs early

3) God Often people could not believe if somethinggood can happens to them and say I canrsquot believe Ihave got this OR have I achieved this really Anddoubt GodTester Sometimes Developer gets surprised anddoubts testerrsquos credibility if their module gets passedat first Hey man have you tested it all Really is thatworked fine

4) God Most people think God himself does nothave to face such situations and so he createsproblems for othersTester Most people think Testers dont have or neednot have any qualifications and when they couldntbuild it themselves testers get happy finding defectsin otherlsquos work

5) God In every religions every God says somethingmostly they all says the something in differentbooks People often use the terms Jesus says to dothis or Krishna says to do this or Allah says to dothis So we all use our Gods to make someone dosomething which we want himher to doTester Whenever Testers reports a bug every Testeruses the term User However tester reports a bugand he wants the bug to be resolved he does notbecome the customer directly He presents the Useras the customer of the bug

6) God I used to read Geeta every day before I leavefor work But when I was getting late I used to skipreading to catch the bus on time I have closelyobserved that whenever I skip reading I never gotbus on time even if I reach bus stop on time To testthis I had even skipped readings intentionally even ifI had enough time But on those days I could never

wwwTestingCircuscom December 2011 - 07 -

catch the bus on time I really wondered and used toask in an angry voice ldquoDo you really want me toread it every day for you So even God sometimescreates obstacles when we donrsquot keep healthyrelationshipTester Well I donrsquot do it but have often heard thatsome testers get upset and angry when developersunderestimate them or doubt their credibility to testtheir code So when testers donrsquot share a goodrelationship with developers testers try to reopenmajor bugs on last minutes so that developers gethard times

We had asked our readers toexpress their opinion on the sametopic Many readers logged intoour Facebook page andcommented on the discussion ldquoIsGOD a Tester or a developerrdquo

Here is what they have to say -

Nicolaacutes Sebastiaacuten Domeniconi Clearly GOD is aDeveloper who created TestDrivenDevelopment Lifethat we call Evolution

Aacuteine McGovern I reckon a PO overseeingeverything and making demands

Saurava Singh GOD is above TESTING andDEVELOPEMENT

Gagan Talwar God is both developer and tester (Farbeyond all such things too) He creates us developus test us by giving hard time test us by giving uspains test us by giving extra happiness to seewhether we remember him or not N when bugsenter when we get old and it needs to be recycledthen he calls us back recycle us n send us in newshape n new place )

Amol Punse God is Beyond allHe can create testdestroy maintain

Yamini Kala GOD is a developer cum Tester )

Karthik Arumugam Lets put it this way God hasmany facetsGod of Creation DeveloperGod of DestructionBenefactor TesterAny takers for God of PreservationProjectManager may be

Manvinder Kaur God is a developer as well astester God created (fully tested) creatures thathuman cannot replicate Human is learning for Godsdevelopment For example God developed Lotuswith leaves where water cannot resist people try toreplicate how to create self-cleaning paint and self-cleaning roofs There are plenty of examples for aGod as very good developer and excellent tester

Sudipto Paul God is author of Human developmentlife cycle (HDLC)Herere are the stages of this life cycle- Childhood- Adolescence- Adulthood- RetirementEach of the stages has input data required to be fedbased on the requirements either of the guardian orof the subjectThere are best practices on both how these are to beadministered and how the administered goods areto be absorbedFinally both God and Humans can easily tell thequality of the end product

Mandeep Sharma God is Developerbut Tester ismaha kaalwho can destroyany thingcreatedeven by god

M Rutherford Ejimonu My God is first a Developerand then a tester and then above bothHe developUs and everything around usand then He Tests ourlove to him by giving my first Fathers Adamtheinstruction Not to eat of the fruit in the middle of the

wwwTestingCircuscom December 2011 - 08 -

genderWhen that test failedHe Presented Uswith yet another to abide by the TenCommandmentWhen that further failedHe gaveus the current last one to Just accept the gift ofsalvation via His Only SonThe Rest isHistory

Sharad Pawar GOD is Developer as well as tester

Rahul Srivastava God is neither a Developer nortester God is architect

Shubhangi Chhibber God is both developer as wellas tester

Ajay Patel God is first developer and then tester

Amit Bhandari GOD IS DEVELOPER AS WELL ASTESTER

Sapan Dey God is Developer amp Tester both Wecannot give away both of them If they will workwith together then we can give quality product tothe customer So both of them are important Wecannot categorize them

Ajay Godbole If we think from a HinduPerspective then Lord Bramha is a Developer LordVishnu is one who maintains it and Lord Shiva is aTester

Quality Analyst God is Tester for sure he tested usin real time Scenario without any specific Test PlanWith Negative Test cases and check ourcompatibility testing

Suresh Gattu God is neither a tester nor any otherIT faculty to begin with as all these positions are forHomo sapiens Closest our QA understanding canget to god is anything error free(perfect) Also the10 (binary number 2) requirements for being godincludea) Being omnipresent (1) in everything physical andeternalb) Having Neutrality (0) in Bias and Judgment to allAnd at core 1 amp 0 form everything that a Computercan relate to and as a Tester we ensure that thesources that turn into these 1s and 0s are correct atthe human side before being translated to systemside Which means we ensure that the requirementsare met to be God (error free)

Narayan Raman Well given that Shiv Bhagvaan iscalled Maha-Dev

Suresh Gattu God has this on his resumeArchitected Universe Developed Creatures toPerformance test Life Mentored humans onSPEACH SMILE platforms Lead all phases of SDLC(Species Development Life Cycle)

Nikunj Kathiria First god is a Developer (Developshumans) after that god is a tester (test humanity)

wwwTestingCircuscom December 2011 - 09 -

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 4: software Testing Circus

In this issueIn this issueVolume 2 - Issue 12 - December 2011

wwwTestingCircuscom December 2011 - 04 -

Testing Circus

Editorial Ajoy Kumar Singha 3

Letter to the Editor 5

Is GOD a tester or a developer Jayshree Rathod 6

Test Coverage ndash Industry Standards Gagneet Singh 14

Book Wormrsquos Corner WoBo 17

Crack The Code Blindu Eusebiu 18

Testers at Twitter 19

Beyond Junior Testing Skills Matthew Heusser 15

Bringing Exploratory Testing into Your Test Department Mark Garzone 25

Promoting Software Testing in Your Organization Rob van Steenbergen 27

Testing Events around the World - January 2012 32

The Stolen Idea Fake Software Tester 35

What is a Testerrsquos Role in Quality Bernice Niel Ruhland 37

QTP Code Corner Jaijeet Pandey 42

Software Testing News 43

Testing Corner Tools Journal 47

Interview with Lisa Crispin Mohinder Khosla 61

Letters straight from the readers

I saw the Magazine today It is really really good with lot of things to learn from itThank you to all for this good work

RegardsKoti Mohan (via our Facebook Page)

------------------------------------------

This one is a unique magazine with new concept This is the kind of magazine I waslooking for The other magazines with theoretical thesis which are boring and hasno practical value to testers working in service based companies Your magazinehas all the ingredients which are I would say a great mix of infotainment sectionsExcellent work team

Rosalyn Mackenzie

------------------------------------------I donrsquot believe this is a free magazine Is print version available for this magazineWhere do I get it in Mumbai

Nand Kishore

- Dear Nand Kishore the print version is not available for this magazine We willremain free forever Enjoy learning with our e-version - Editor

Write to us ateditortestingcircuscom

Letter to the Edi

tor

wwwTestingCircuscom December 2011 - 05 -

Jayshree RathodI had thought to write something relating to Testingsince I joined Testing But whenever I thought towrite something neutrons started bombarding mypoor mind which then used to divide into severalpieces in the form of questions Like - are you readyWhat would you write about Why are you writingthis Will you finish it Will you write again Andchoosing the subject was very difficult for me I wantto make sure that whatever I write about should bean outcome of my own thoughts and imaginationseven if it sounds ridiculous to someall

Then I banged on a topic ndash is the creator of thisuniverse a tester or a developer Do we have somesymptoms by which we can say God is a tester or adeveloper This is a little debatable topic comparedto classical topics that we cover in magazine likeTesting Circus

Why this topicAfter joining testing I couldnrsquot stop myself fromrelating Testing with what I see all around I alwaysthink about what role God plays and how and whereHe fits in our development life cycle

God - a Developer1) God Seeing some people andor their behavior

we often say God has made himher in haste or in avery bad moodDeveloper We see some buggy code and sayldquoDeveloper has really made it in haste or has notunderstood the logic rightrdquo

2) God For the issues of our daily lives we blamethe God After all he designed us and others (wehave problems with) So isnrsquot it his duty to solve ourproblems we face

Developer For the defects of the softwarerespective developer is blamed and then the defect isassigned to him amp it is his duty to resolve it

3) God Some creatures in this world are really aboveour imaginations I wonder how God so beautifullypaints them Only he can create such beings InHindus we have different GodsGoddess fordifferent purpose Eg for Wealth- Laxmiji ForKnowledge- Saraswatiji For Fame ndash Ganeshji to getrid of Fears ndash Hanumanji and here is the best if noneof them listen to your wishes go to Shiv ji

wwwTestingCircuscom December 2011 - 06 -

Is GOD a Tester or a developer

- Jayshree Rathod amp our Facebook Page Subscribers

Developer In software world also we need differentdevelopers to solve our problems like JavaDeveloper Web Developer Net Developer Joomladeveloper PHP developer and many morehellip tobuild desired applications

4) God When we get things sorted out in a rightmanner we say oh Thank you god finally youlistened to meDeveloper When software gets it major bugsresolved and clients feedback is good Developergets a pat on their back for the good work they did

5) God Criticize your God and wait for the resultsYou will get lessons back in some formsDeveloper Tell developer about a new defect youfound and you will get an instant message from himor he would appear in person if possible discussingwhy the defect is not defect

God - a Tester1) God We get up in the morning and if see anyproblems we say oh God so you know I was happyyesterday and you canrsquot bear everything works finehmmmmTester When a Tester says defects are not resolvedyet and I need to reopen them againDeveloper says You (Tester) never acknowledge mywork and are always ready to throw problemsNothing seems right to you Isnrsquot it

2) God Sometimes unexpected or unplannedcircumstances appear and we say oh God Why am Ifacing this now or why didnrsquot you make me awarewell before I could have avoided this easilyTester Client finds some new or severe bugsEverybody nods - Hey Our Tester(s) might have nottested the product well enough OR why heshe hasnot found these bugs early

3) God Often people could not believe if somethinggood can happens to them and say I canrsquot believe Ihave got this OR have I achieved this really Anddoubt GodTester Sometimes Developer gets surprised anddoubts testerrsquos credibility if their module gets passedat first Hey man have you tested it all Really is thatworked fine

4) God Most people think God himself does nothave to face such situations and so he createsproblems for othersTester Most people think Testers dont have or neednot have any qualifications and when they couldntbuild it themselves testers get happy finding defectsin otherlsquos work

5) God In every religions every God says somethingmostly they all says the something in differentbooks People often use the terms Jesus says to dothis or Krishna says to do this or Allah says to dothis So we all use our Gods to make someone dosomething which we want himher to doTester Whenever Testers reports a bug every Testeruses the term User However tester reports a bugand he wants the bug to be resolved he does notbecome the customer directly He presents the Useras the customer of the bug

6) God I used to read Geeta every day before I leavefor work But when I was getting late I used to skipreading to catch the bus on time I have closelyobserved that whenever I skip reading I never gotbus on time even if I reach bus stop on time To testthis I had even skipped readings intentionally even ifI had enough time But on those days I could never

wwwTestingCircuscom December 2011 - 07 -

catch the bus on time I really wondered and used toask in an angry voice ldquoDo you really want me toread it every day for you So even God sometimescreates obstacles when we donrsquot keep healthyrelationshipTester Well I donrsquot do it but have often heard thatsome testers get upset and angry when developersunderestimate them or doubt their credibility to testtheir code So when testers donrsquot share a goodrelationship with developers testers try to reopenmajor bugs on last minutes so that developers gethard times

We had asked our readers toexpress their opinion on the sametopic Many readers logged intoour Facebook page andcommented on the discussion ldquoIsGOD a Tester or a developerrdquo

Here is what they have to say -

Nicolaacutes Sebastiaacuten Domeniconi Clearly GOD is aDeveloper who created TestDrivenDevelopment Lifethat we call Evolution

Aacuteine McGovern I reckon a PO overseeingeverything and making demands

Saurava Singh GOD is above TESTING andDEVELOPEMENT

Gagan Talwar God is both developer and tester (Farbeyond all such things too) He creates us developus test us by giving hard time test us by giving uspains test us by giving extra happiness to seewhether we remember him or not N when bugsenter when we get old and it needs to be recycledthen he calls us back recycle us n send us in newshape n new place )

Amol Punse God is Beyond allHe can create testdestroy maintain

Yamini Kala GOD is a developer cum Tester )

Karthik Arumugam Lets put it this way God hasmany facetsGod of Creation DeveloperGod of DestructionBenefactor TesterAny takers for God of PreservationProjectManager may be

Manvinder Kaur God is a developer as well astester God created (fully tested) creatures thathuman cannot replicate Human is learning for Godsdevelopment For example God developed Lotuswith leaves where water cannot resist people try toreplicate how to create self-cleaning paint and self-cleaning roofs There are plenty of examples for aGod as very good developer and excellent tester

Sudipto Paul God is author of Human developmentlife cycle (HDLC)Herere are the stages of this life cycle- Childhood- Adolescence- Adulthood- RetirementEach of the stages has input data required to be fedbased on the requirements either of the guardian orof the subjectThere are best practices on both how these are to beadministered and how the administered goods areto be absorbedFinally both God and Humans can easily tell thequality of the end product

Mandeep Sharma God is Developerbut Tester ismaha kaalwho can destroyany thingcreatedeven by god

M Rutherford Ejimonu My God is first a Developerand then a tester and then above bothHe developUs and everything around usand then He Tests ourlove to him by giving my first Fathers Adamtheinstruction Not to eat of the fruit in the middle of the

wwwTestingCircuscom December 2011 - 08 -

genderWhen that test failedHe Presented Uswith yet another to abide by the TenCommandmentWhen that further failedHe gaveus the current last one to Just accept the gift ofsalvation via His Only SonThe Rest isHistory

Sharad Pawar GOD is Developer as well as tester

Rahul Srivastava God is neither a Developer nortester God is architect

Shubhangi Chhibber God is both developer as wellas tester

Ajay Patel God is first developer and then tester

Amit Bhandari GOD IS DEVELOPER AS WELL ASTESTER

Sapan Dey God is Developer amp Tester both Wecannot give away both of them If they will workwith together then we can give quality product tothe customer So both of them are important Wecannot categorize them

Ajay Godbole If we think from a HinduPerspective then Lord Bramha is a Developer LordVishnu is one who maintains it and Lord Shiva is aTester

Quality Analyst God is Tester for sure he tested usin real time Scenario without any specific Test PlanWith Negative Test cases and check ourcompatibility testing

Suresh Gattu God is neither a tester nor any otherIT faculty to begin with as all these positions are forHomo sapiens Closest our QA understanding canget to god is anything error free(perfect) Also the10 (binary number 2) requirements for being godincludea) Being omnipresent (1) in everything physical andeternalb) Having Neutrality (0) in Bias and Judgment to allAnd at core 1 amp 0 form everything that a Computercan relate to and as a Tester we ensure that thesources that turn into these 1s and 0s are correct atthe human side before being translated to systemside Which means we ensure that the requirementsare met to be God (error free)

Narayan Raman Well given that Shiv Bhagvaan iscalled Maha-Dev

Suresh Gattu God has this on his resumeArchitected Universe Developed Creatures toPerformance test Life Mentored humans onSPEACH SMILE platforms Lead all phases of SDLC(Species Development Life Cycle)

Nikunj Kathiria First god is a Developer (Developshumans) after that god is a tester (test humanity)

wwwTestingCircuscom December 2011 - 09 -

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 5: software Testing Circus

Letters straight from the readers

I saw the Magazine today It is really really good with lot of things to learn from itThank you to all for this good work

RegardsKoti Mohan (via our Facebook Page)

------------------------------------------

This one is a unique magazine with new concept This is the kind of magazine I waslooking for The other magazines with theoretical thesis which are boring and hasno practical value to testers working in service based companies Your magazinehas all the ingredients which are I would say a great mix of infotainment sectionsExcellent work team

Rosalyn Mackenzie

------------------------------------------I donrsquot believe this is a free magazine Is print version available for this magazineWhere do I get it in Mumbai

Nand Kishore

- Dear Nand Kishore the print version is not available for this magazine We willremain free forever Enjoy learning with our e-version - Editor

Write to us ateditortestingcircuscom

Letter to the Edi

tor

wwwTestingCircuscom December 2011 - 05 -

Jayshree RathodI had thought to write something relating to Testingsince I joined Testing But whenever I thought towrite something neutrons started bombarding mypoor mind which then used to divide into severalpieces in the form of questions Like - are you readyWhat would you write about Why are you writingthis Will you finish it Will you write again Andchoosing the subject was very difficult for me I wantto make sure that whatever I write about should bean outcome of my own thoughts and imaginationseven if it sounds ridiculous to someall

Then I banged on a topic ndash is the creator of thisuniverse a tester or a developer Do we have somesymptoms by which we can say God is a tester or adeveloper This is a little debatable topic comparedto classical topics that we cover in magazine likeTesting Circus

Why this topicAfter joining testing I couldnrsquot stop myself fromrelating Testing with what I see all around I alwaysthink about what role God plays and how and whereHe fits in our development life cycle

God - a Developer1) God Seeing some people andor their behavior

we often say God has made himher in haste or in avery bad moodDeveloper We see some buggy code and sayldquoDeveloper has really made it in haste or has notunderstood the logic rightrdquo

2) God For the issues of our daily lives we blamethe God After all he designed us and others (wehave problems with) So isnrsquot it his duty to solve ourproblems we face

Developer For the defects of the softwarerespective developer is blamed and then the defect isassigned to him amp it is his duty to resolve it

3) God Some creatures in this world are really aboveour imaginations I wonder how God so beautifullypaints them Only he can create such beings InHindus we have different GodsGoddess fordifferent purpose Eg for Wealth- Laxmiji ForKnowledge- Saraswatiji For Fame ndash Ganeshji to getrid of Fears ndash Hanumanji and here is the best if noneof them listen to your wishes go to Shiv ji

wwwTestingCircuscom December 2011 - 06 -

Is GOD a Tester or a developer

- Jayshree Rathod amp our Facebook Page Subscribers

Developer In software world also we need differentdevelopers to solve our problems like JavaDeveloper Web Developer Net Developer Joomladeveloper PHP developer and many morehellip tobuild desired applications

4) God When we get things sorted out in a rightmanner we say oh Thank you god finally youlistened to meDeveloper When software gets it major bugsresolved and clients feedback is good Developergets a pat on their back for the good work they did

5) God Criticize your God and wait for the resultsYou will get lessons back in some formsDeveloper Tell developer about a new defect youfound and you will get an instant message from himor he would appear in person if possible discussingwhy the defect is not defect

God - a Tester1) God We get up in the morning and if see anyproblems we say oh God so you know I was happyyesterday and you canrsquot bear everything works finehmmmmTester When a Tester says defects are not resolvedyet and I need to reopen them againDeveloper says You (Tester) never acknowledge mywork and are always ready to throw problemsNothing seems right to you Isnrsquot it

2) God Sometimes unexpected or unplannedcircumstances appear and we say oh God Why am Ifacing this now or why didnrsquot you make me awarewell before I could have avoided this easilyTester Client finds some new or severe bugsEverybody nods - Hey Our Tester(s) might have nottested the product well enough OR why heshe hasnot found these bugs early

3) God Often people could not believe if somethinggood can happens to them and say I canrsquot believe Ihave got this OR have I achieved this really Anddoubt GodTester Sometimes Developer gets surprised anddoubts testerrsquos credibility if their module gets passedat first Hey man have you tested it all Really is thatworked fine

4) God Most people think God himself does nothave to face such situations and so he createsproblems for othersTester Most people think Testers dont have or neednot have any qualifications and when they couldntbuild it themselves testers get happy finding defectsin otherlsquos work

5) God In every religions every God says somethingmostly they all says the something in differentbooks People often use the terms Jesus says to dothis or Krishna says to do this or Allah says to dothis So we all use our Gods to make someone dosomething which we want himher to doTester Whenever Testers reports a bug every Testeruses the term User However tester reports a bugand he wants the bug to be resolved he does notbecome the customer directly He presents the Useras the customer of the bug

6) God I used to read Geeta every day before I leavefor work But when I was getting late I used to skipreading to catch the bus on time I have closelyobserved that whenever I skip reading I never gotbus on time even if I reach bus stop on time To testthis I had even skipped readings intentionally even ifI had enough time But on those days I could never

wwwTestingCircuscom December 2011 - 07 -

catch the bus on time I really wondered and used toask in an angry voice ldquoDo you really want me toread it every day for you So even God sometimescreates obstacles when we donrsquot keep healthyrelationshipTester Well I donrsquot do it but have often heard thatsome testers get upset and angry when developersunderestimate them or doubt their credibility to testtheir code So when testers donrsquot share a goodrelationship with developers testers try to reopenmajor bugs on last minutes so that developers gethard times

We had asked our readers toexpress their opinion on the sametopic Many readers logged intoour Facebook page andcommented on the discussion ldquoIsGOD a Tester or a developerrdquo

Here is what they have to say -

Nicolaacutes Sebastiaacuten Domeniconi Clearly GOD is aDeveloper who created TestDrivenDevelopment Lifethat we call Evolution

Aacuteine McGovern I reckon a PO overseeingeverything and making demands

Saurava Singh GOD is above TESTING andDEVELOPEMENT

Gagan Talwar God is both developer and tester (Farbeyond all such things too) He creates us developus test us by giving hard time test us by giving uspains test us by giving extra happiness to seewhether we remember him or not N when bugsenter when we get old and it needs to be recycledthen he calls us back recycle us n send us in newshape n new place )

Amol Punse God is Beyond allHe can create testdestroy maintain

Yamini Kala GOD is a developer cum Tester )

Karthik Arumugam Lets put it this way God hasmany facetsGod of Creation DeveloperGod of DestructionBenefactor TesterAny takers for God of PreservationProjectManager may be

Manvinder Kaur God is a developer as well astester God created (fully tested) creatures thathuman cannot replicate Human is learning for Godsdevelopment For example God developed Lotuswith leaves where water cannot resist people try toreplicate how to create self-cleaning paint and self-cleaning roofs There are plenty of examples for aGod as very good developer and excellent tester

Sudipto Paul God is author of Human developmentlife cycle (HDLC)Herere are the stages of this life cycle- Childhood- Adolescence- Adulthood- RetirementEach of the stages has input data required to be fedbased on the requirements either of the guardian orof the subjectThere are best practices on both how these are to beadministered and how the administered goods areto be absorbedFinally both God and Humans can easily tell thequality of the end product

Mandeep Sharma God is Developerbut Tester ismaha kaalwho can destroyany thingcreatedeven by god

M Rutherford Ejimonu My God is first a Developerand then a tester and then above bothHe developUs and everything around usand then He Tests ourlove to him by giving my first Fathers Adamtheinstruction Not to eat of the fruit in the middle of the

wwwTestingCircuscom December 2011 - 08 -

genderWhen that test failedHe Presented Uswith yet another to abide by the TenCommandmentWhen that further failedHe gaveus the current last one to Just accept the gift ofsalvation via His Only SonThe Rest isHistory

Sharad Pawar GOD is Developer as well as tester

Rahul Srivastava God is neither a Developer nortester God is architect

Shubhangi Chhibber God is both developer as wellas tester

Ajay Patel God is first developer and then tester

Amit Bhandari GOD IS DEVELOPER AS WELL ASTESTER

Sapan Dey God is Developer amp Tester both Wecannot give away both of them If they will workwith together then we can give quality product tothe customer So both of them are important Wecannot categorize them

Ajay Godbole If we think from a HinduPerspective then Lord Bramha is a Developer LordVishnu is one who maintains it and Lord Shiva is aTester

Quality Analyst God is Tester for sure he tested usin real time Scenario without any specific Test PlanWith Negative Test cases and check ourcompatibility testing

Suresh Gattu God is neither a tester nor any otherIT faculty to begin with as all these positions are forHomo sapiens Closest our QA understanding canget to god is anything error free(perfect) Also the10 (binary number 2) requirements for being godincludea) Being omnipresent (1) in everything physical andeternalb) Having Neutrality (0) in Bias and Judgment to allAnd at core 1 amp 0 form everything that a Computercan relate to and as a Tester we ensure that thesources that turn into these 1s and 0s are correct atthe human side before being translated to systemside Which means we ensure that the requirementsare met to be God (error free)

Narayan Raman Well given that Shiv Bhagvaan iscalled Maha-Dev

Suresh Gattu God has this on his resumeArchitected Universe Developed Creatures toPerformance test Life Mentored humans onSPEACH SMILE platforms Lead all phases of SDLC(Species Development Life Cycle)

Nikunj Kathiria First god is a Developer (Developshumans) after that god is a tester (test humanity)

wwwTestingCircuscom December 2011 - 09 -

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 6: software Testing Circus

Jayshree RathodI had thought to write something relating to Testingsince I joined Testing But whenever I thought towrite something neutrons started bombarding mypoor mind which then used to divide into severalpieces in the form of questions Like - are you readyWhat would you write about Why are you writingthis Will you finish it Will you write again Andchoosing the subject was very difficult for me I wantto make sure that whatever I write about should bean outcome of my own thoughts and imaginationseven if it sounds ridiculous to someall

Then I banged on a topic ndash is the creator of thisuniverse a tester or a developer Do we have somesymptoms by which we can say God is a tester or adeveloper This is a little debatable topic comparedto classical topics that we cover in magazine likeTesting Circus

Why this topicAfter joining testing I couldnrsquot stop myself fromrelating Testing with what I see all around I alwaysthink about what role God plays and how and whereHe fits in our development life cycle

God - a Developer1) God Seeing some people andor their behavior

we often say God has made himher in haste or in avery bad moodDeveloper We see some buggy code and sayldquoDeveloper has really made it in haste or has notunderstood the logic rightrdquo

2) God For the issues of our daily lives we blamethe God After all he designed us and others (wehave problems with) So isnrsquot it his duty to solve ourproblems we face

Developer For the defects of the softwarerespective developer is blamed and then the defect isassigned to him amp it is his duty to resolve it

3) God Some creatures in this world are really aboveour imaginations I wonder how God so beautifullypaints them Only he can create such beings InHindus we have different GodsGoddess fordifferent purpose Eg for Wealth- Laxmiji ForKnowledge- Saraswatiji For Fame ndash Ganeshji to getrid of Fears ndash Hanumanji and here is the best if noneof them listen to your wishes go to Shiv ji

wwwTestingCircuscom December 2011 - 06 -

Is GOD a Tester or a developer

- Jayshree Rathod amp our Facebook Page Subscribers

Developer In software world also we need differentdevelopers to solve our problems like JavaDeveloper Web Developer Net Developer Joomladeveloper PHP developer and many morehellip tobuild desired applications

4) God When we get things sorted out in a rightmanner we say oh Thank you god finally youlistened to meDeveloper When software gets it major bugsresolved and clients feedback is good Developergets a pat on their back for the good work they did

5) God Criticize your God and wait for the resultsYou will get lessons back in some formsDeveloper Tell developer about a new defect youfound and you will get an instant message from himor he would appear in person if possible discussingwhy the defect is not defect

God - a Tester1) God We get up in the morning and if see anyproblems we say oh God so you know I was happyyesterday and you canrsquot bear everything works finehmmmmTester When a Tester says defects are not resolvedyet and I need to reopen them againDeveloper says You (Tester) never acknowledge mywork and are always ready to throw problemsNothing seems right to you Isnrsquot it

2) God Sometimes unexpected or unplannedcircumstances appear and we say oh God Why am Ifacing this now or why didnrsquot you make me awarewell before I could have avoided this easilyTester Client finds some new or severe bugsEverybody nods - Hey Our Tester(s) might have nottested the product well enough OR why heshe hasnot found these bugs early

3) God Often people could not believe if somethinggood can happens to them and say I canrsquot believe Ihave got this OR have I achieved this really Anddoubt GodTester Sometimes Developer gets surprised anddoubts testerrsquos credibility if their module gets passedat first Hey man have you tested it all Really is thatworked fine

4) God Most people think God himself does nothave to face such situations and so he createsproblems for othersTester Most people think Testers dont have or neednot have any qualifications and when they couldntbuild it themselves testers get happy finding defectsin otherlsquos work

5) God In every religions every God says somethingmostly they all says the something in differentbooks People often use the terms Jesus says to dothis or Krishna says to do this or Allah says to dothis So we all use our Gods to make someone dosomething which we want himher to doTester Whenever Testers reports a bug every Testeruses the term User However tester reports a bugand he wants the bug to be resolved he does notbecome the customer directly He presents the Useras the customer of the bug

6) God I used to read Geeta every day before I leavefor work But when I was getting late I used to skipreading to catch the bus on time I have closelyobserved that whenever I skip reading I never gotbus on time even if I reach bus stop on time To testthis I had even skipped readings intentionally even ifI had enough time But on those days I could never

wwwTestingCircuscom December 2011 - 07 -

catch the bus on time I really wondered and used toask in an angry voice ldquoDo you really want me toread it every day for you So even God sometimescreates obstacles when we donrsquot keep healthyrelationshipTester Well I donrsquot do it but have often heard thatsome testers get upset and angry when developersunderestimate them or doubt their credibility to testtheir code So when testers donrsquot share a goodrelationship with developers testers try to reopenmajor bugs on last minutes so that developers gethard times

We had asked our readers toexpress their opinion on the sametopic Many readers logged intoour Facebook page andcommented on the discussion ldquoIsGOD a Tester or a developerrdquo

Here is what they have to say -

Nicolaacutes Sebastiaacuten Domeniconi Clearly GOD is aDeveloper who created TestDrivenDevelopment Lifethat we call Evolution

Aacuteine McGovern I reckon a PO overseeingeverything and making demands

Saurava Singh GOD is above TESTING andDEVELOPEMENT

Gagan Talwar God is both developer and tester (Farbeyond all such things too) He creates us developus test us by giving hard time test us by giving uspains test us by giving extra happiness to seewhether we remember him or not N when bugsenter when we get old and it needs to be recycledthen he calls us back recycle us n send us in newshape n new place )

Amol Punse God is Beyond allHe can create testdestroy maintain

Yamini Kala GOD is a developer cum Tester )

Karthik Arumugam Lets put it this way God hasmany facetsGod of Creation DeveloperGod of DestructionBenefactor TesterAny takers for God of PreservationProjectManager may be

Manvinder Kaur God is a developer as well astester God created (fully tested) creatures thathuman cannot replicate Human is learning for Godsdevelopment For example God developed Lotuswith leaves where water cannot resist people try toreplicate how to create self-cleaning paint and self-cleaning roofs There are plenty of examples for aGod as very good developer and excellent tester

Sudipto Paul God is author of Human developmentlife cycle (HDLC)Herere are the stages of this life cycle- Childhood- Adolescence- Adulthood- RetirementEach of the stages has input data required to be fedbased on the requirements either of the guardian orof the subjectThere are best practices on both how these are to beadministered and how the administered goods areto be absorbedFinally both God and Humans can easily tell thequality of the end product

Mandeep Sharma God is Developerbut Tester ismaha kaalwho can destroyany thingcreatedeven by god

M Rutherford Ejimonu My God is first a Developerand then a tester and then above bothHe developUs and everything around usand then He Tests ourlove to him by giving my first Fathers Adamtheinstruction Not to eat of the fruit in the middle of the

wwwTestingCircuscom December 2011 - 08 -

genderWhen that test failedHe Presented Uswith yet another to abide by the TenCommandmentWhen that further failedHe gaveus the current last one to Just accept the gift ofsalvation via His Only SonThe Rest isHistory

Sharad Pawar GOD is Developer as well as tester

Rahul Srivastava God is neither a Developer nortester God is architect

Shubhangi Chhibber God is both developer as wellas tester

Ajay Patel God is first developer and then tester

Amit Bhandari GOD IS DEVELOPER AS WELL ASTESTER

Sapan Dey God is Developer amp Tester both Wecannot give away both of them If they will workwith together then we can give quality product tothe customer So both of them are important Wecannot categorize them

Ajay Godbole If we think from a HinduPerspective then Lord Bramha is a Developer LordVishnu is one who maintains it and Lord Shiva is aTester

Quality Analyst God is Tester for sure he tested usin real time Scenario without any specific Test PlanWith Negative Test cases and check ourcompatibility testing

Suresh Gattu God is neither a tester nor any otherIT faculty to begin with as all these positions are forHomo sapiens Closest our QA understanding canget to god is anything error free(perfect) Also the10 (binary number 2) requirements for being godincludea) Being omnipresent (1) in everything physical andeternalb) Having Neutrality (0) in Bias and Judgment to allAnd at core 1 amp 0 form everything that a Computercan relate to and as a Tester we ensure that thesources that turn into these 1s and 0s are correct atthe human side before being translated to systemside Which means we ensure that the requirementsare met to be God (error free)

Narayan Raman Well given that Shiv Bhagvaan iscalled Maha-Dev

Suresh Gattu God has this on his resumeArchitected Universe Developed Creatures toPerformance test Life Mentored humans onSPEACH SMILE platforms Lead all phases of SDLC(Species Development Life Cycle)

Nikunj Kathiria First god is a Developer (Developshumans) after that god is a tester (test humanity)

wwwTestingCircuscom December 2011 - 09 -

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 7: software Testing Circus

Developer In software world also we need differentdevelopers to solve our problems like JavaDeveloper Web Developer Net Developer Joomladeveloper PHP developer and many morehellip tobuild desired applications

4) God When we get things sorted out in a rightmanner we say oh Thank you god finally youlistened to meDeveloper When software gets it major bugsresolved and clients feedback is good Developergets a pat on their back for the good work they did

5) God Criticize your God and wait for the resultsYou will get lessons back in some formsDeveloper Tell developer about a new defect youfound and you will get an instant message from himor he would appear in person if possible discussingwhy the defect is not defect

God - a Tester1) God We get up in the morning and if see anyproblems we say oh God so you know I was happyyesterday and you canrsquot bear everything works finehmmmmTester When a Tester says defects are not resolvedyet and I need to reopen them againDeveloper says You (Tester) never acknowledge mywork and are always ready to throw problemsNothing seems right to you Isnrsquot it

2) God Sometimes unexpected or unplannedcircumstances appear and we say oh God Why am Ifacing this now or why didnrsquot you make me awarewell before I could have avoided this easilyTester Client finds some new or severe bugsEverybody nods - Hey Our Tester(s) might have nottested the product well enough OR why heshe hasnot found these bugs early

3) God Often people could not believe if somethinggood can happens to them and say I canrsquot believe Ihave got this OR have I achieved this really Anddoubt GodTester Sometimes Developer gets surprised anddoubts testerrsquos credibility if their module gets passedat first Hey man have you tested it all Really is thatworked fine

4) God Most people think God himself does nothave to face such situations and so he createsproblems for othersTester Most people think Testers dont have or neednot have any qualifications and when they couldntbuild it themselves testers get happy finding defectsin otherlsquos work

5) God In every religions every God says somethingmostly they all says the something in differentbooks People often use the terms Jesus says to dothis or Krishna says to do this or Allah says to dothis So we all use our Gods to make someone dosomething which we want himher to doTester Whenever Testers reports a bug every Testeruses the term User However tester reports a bugand he wants the bug to be resolved he does notbecome the customer directly He presents the Useras the customer of the bug

6) God I used to read Geeta every day before I leavefor work But when I was getting late I used to skipreading to catch the bus on time I have closelyobserved that whenever I skip reading I never gotbus on time even if I reach bus stop on time To testthis I had even skipped readings intentionally even ifI had enough time But on those days I could never

wwwTestingCircuscom December 2011 - 07 -

catch the bus on time I really wondered and used toask in an angry voice ldquoDo you really want me toread it every day for you So even God sometimescreates obstacles when we donrsquot keep healthyrelationshipTester Well I donrsquot do it but have often heard thatsome testers get upset and angry when developersunderestimate them or doubt their credibility to testtheir code So when testers donrsquot share a goodrelationship with developers testers try to reopenmajor bugs on last minutes so that developers gethard times

We had asked our readers toexpress their opinion on the sametopic Many readers logged intoour Facebook page andcommented on the discussion ldquoIsGOD a Tester or a developerrdquo

Here is what they have to say -

Nicolaacutes Sebastiaacuten Domeniconi Clearly GOD is aDeveloper who created TestDrivenDevelopment Lifethat we call Evolution

Aacuteine McGovern I reckon a PO overseeingeverything and making demands

Saurava Singh GOD is above TESTING andDEVELOPEMENT

Gagan Talwar God is both developer and tester (Farbeyond all such things too) He creates us developus test us by giving hard time test us by giving uspains test us by giving extra happiness to seewhether we remember him or not N when bugsenter when we get old and it needs to be recycledthen he calls us back recycle us n send us in newshape n new place )

Amol Punse God is Beyond allHe can create testdestroy maintain

Yamini Kala GOD is a developer cum Tester )

Karthik Arumugam Lets put it this way God hasmany facetsGod of Creation DeveloperGod of DestructionBenefactor TesterAny takers for God of PreservationProjectManager may be

Manvinder Kaur God is a developer as well astester God created (fully tested) creatures thathuman cannot replicate Human is learning for Godsdevelopment For example God developed Lotuswith leaves where water cannot resist people try toreplicate how to create self-cleaning paint and self-cleaning roofs There are plenty of examples for aGod as very good developer and excellent tester

Sudipto Paul God is author of Human developmentlife cycle (HDLC)Herere are the stages of this life cycle- Childhood- Adolescence- Adulthood- RetirementEach of the stages has input data required to be fedbased on the requirements either of the guardian orof the subjectThere are best practices on both how these are to beadministered and how the administered goods areto be absorbedFinally both God and Humans can easily tell thequality of the end product

Mandeep Sharma God is Developerbut Tester ismaha kaalwho can destroyany thingcreatedeven by god

M Rutherford Ejimonu My God is first a Developerand then a tester and then above bothHe developUs and everything around usand then He Tests ourlove to him by giving my first Fathers Adamtheinstruction Not to eat of the fruit in the middle of the

wwwTestingCircuscom December 2011 - 08 -

genderWhen that test failedHe Presented Uswith yet another to abide by the TenCommandmentWhen that further failedHe gaveus the current last one to Just accept the gift ofsalvation via His Only SonThe Rest isHistory

Sharad Pawar GOD is Developer as well as tester

Rahul Srivastava God is neither a Developer nortester God is architect

Shubhangi Chhibber God is both developer as wellas tester

Ajay Patel God is first developer and then tester

Amit Bhandari GOD IS DEVELOPER AS WELL ASTESTER

Sapan Dey God is Developer amp Tester both Wecannot give away both of them If they will workwith together then we can give quality product tothe customer So both of them are important Wecannot categorize them

Ajay Godbole If we think from a HinduPerspective then Lord Bramha is a Developer LordVishnu is one who maintains it and Lord Shiva is aTester

Quality Analyst God is Tester for sure he tested usin real time Scenario without any specific Test PlanWith Negative Test cases and check ourcompatibility testing

Suresh Gattu God is neither a tester nor any otherIT faculty to begin with as all these positions are forHomo sapiens Closest our QA understanding canget to god is anything error free(perfect) Also the10 (binary number 2) requirements for being godincludea) Being omnipresent (1) in everything physical andeternalb) Having Neutrality (0) in Bias and Judgment to allAnd at core 1 amp 0 form everything that a Computercan relate to and as a Tester we ensure that thesources that turn into these 1s and 0s are correct atthe human side before being translated to systemside Which means we ensure that the requirementsare met to be God (error free)

Narayan Raman Well given that Shiv Bhagvaan iscalled Maha-Dev

Suresh Gattu God has this on his resumeArchitected Universe Developed Creatures toPerformance test Life Mentored humans onSPEACH SMILE platforms Lead all phases of SDLC(Species Development Life Cycle)

Nikunj Kathiria First god is a Developer (Developshumans) after that god is a tester (test humanity)

wwwTestingCircuscom December 2011 - 09 -

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 8: software Testing Circus

catch the bus on time I really wondered and used toask in an angry voice ldquoDo you really want me toread it every day for you So even God sometimescreates obstacles when we donrsquot keep healthyrelationshipTester Well I donrsquot do it but have often heard thatsome testers get upset and angry when developersunderestimate them or doubt their credibility to testtheir code So when testers donrsquot share a goodrelationship with developers testers try to reopenmajor bugs on last minutes so that developers gethard times

We had asked our readers toexpress their opinion on the sametopic Many readers logged intoour Facebook page andcommented on the discussion ldquoIsGOD a Tester or a developerrdquo

Here is what they have to say -

Nicolaacutes Sebastiaacuten Domeniconi Clearly GOD is aDeveloper who created TestDrivenDevelopment Lifethat we call Evolution

Aacuteine McGovern I reckon a PO overseeingeverything and making demands

Saurava Singh GOD is above TESTING andDEVELOPEMENT

Gagan Talwar God is both developer and tester (Farbeyond all such things too) He creates us developus test us by giving hard time test us by giving uspains test us by giving extra happiness to seewhether we remember him or not N when bugsenter when we get old and it needs to be recycledthen he calls us back recycle us n send us in newshape n new place )

Amol Punse God is Beyond allHe can create testdestroy maintain

Yamini Kala GOD is a developer cum Tester )

Karthik Arumugam Lets put it this way God hasmany facetsGod of Creation DeveloperGod of DestructionBenefactor TesterAny takers for God of PreservationProjectManager may be

Manvinder Kaur God is a developer as well astester God created (fully tested) creatures thathuman cannot replicate Human is learning for Godsdevelopment For example God developed Lotuswith leaves where water cannot resist people try toreplicate how to create self-cleaning paint and self-cleaning roofs There are plenty of examples for aGod as very good developer and excellent tester

Sudipto Paul God is author of Human developmentlife cycle (HDLC)Herere are the stages of this life cycle- Childhood- Adolescence- Adulthood- RetirementEach of the stages has input data required to be fedbased on the requirements either of the guardian orof the subjectThere are best practices on both how these are to beadministered and how the administered goods areto be absorbedFinally both God and Humans can easily tell thequality of the end product

Mandeep Sharma God is Developerbut Tester ismaha kaalwho can destroyany thingcreatedeven by god

M Rutherford Ejimonu My God is first a Developerand then a tester and then above bothHe developUs and everything around usand then He Tests ourlove to him by giving my first Fathers Adamtheinstruction Not to eat of the fruit in the middle of the

wwwTestingCircuscom December 2011 - 08 -

genderWhen that test failedHe Presented Uswith yet another to abide by the TenCommandmentWhen that further failedHe gaveus the current last one to Just accept the gift ofsalvation via His Only SonThe Rest isHistory

Sharad Pawar GOD is Developer as well as tester

Rahul Srivastava God is neither a Developer nortester God is architect

Shubhangi Chhibber God is both developer as wellas tester

Ajay Patel God is first developer and then tester

Amit Bhandari GOD IS DEVELOPER AS WELL ASTESTER

Sapan Dey God is Developer amp Tester both Wecannot give away both of them If they will workwith together then we can give quality product tothe customer So both of them are important Wecannot categorize them

Ajay Godbole If we think from a HinduPerspective then Lord Bramha is a Developer LordVishnu is one who maintains it and Lord Shiva is aTester

Quality Analyst God is Tester for sure he tested usin real time Scenario without any specific Test PlanWith Negative Test cases and check ourcompatibility testing

Suresh Gattu God is neither a tester nor any otherIT faculty to begin with as all these positions are forHomo sapiens Closest our QA understanding canget to god is anything error free(perfect) Also the10 (binary number 2) requirements for being godincludea) Being omnipresent (1) in everything physical andeternalb) Having Neutrality (0) in Bias and Judgment to allAnd at core 1 amp 0 form everything that a Computercan relate to and as a Tester we ensure that thesources that turn into these 1s and 0s are correct atthe human side before being translated to systemside Which means we ensure that the requirementsare met to be God (error free)

Narayan Raman Well given that Shiv Bhagvaan iscalled Maha-Dev

Suresh Gattu God has this on his resumeArchitected Universe Developed Creatures toPerformance test Life Mentored humans onSPEACH SMILE platforms Lead all phases of SDLC(Species Development Life Cycle)

Nikunj Kathiria First god is a Developer (Developshumans) after that god is a tester (test humanity)

wwwTestingCircuscom December 2011 - 09 -

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 9: software Testing Circus

genderWhen that test failedHe Presented Uswith yet another to abide by the TenCommandmentWhen that further failedHe gaveus the current last one to Just accept the gift ofsalvation via His Only SonThe Rest isHistory

Sharad Pawar GOD is Developer as well as tester

Rahul Srivastava God is neither a Developer nortester God is architect

Shubhangi Chhibber God is both developer as wellas tester

Ajay Patel God is first developer and then tester

Amit Bhandari GOD IS DEVELOPER AS WELL ASTESTER

Sapan Dey God is Developer amp Tester both Wecannot give away both of them If they will workwith together then we can give quality product tothe customer So both of them are important Wecannot categorize them

Ajay Godbole If we think from a HinduPerspective then Lord Bramha is a Developer LordVishnu is one who maintains it and Lord Shiva is aTester

Quality Analyst God is Tester for sure he tested usin real time Scenario without any specific Test PlanWith Negative Test cases and check ourcompatibility testing

Suresh Gattu God is neither a tester nor any otherIT faculty to begin with as all these positions are forHomo sapiens Closest our QA understanding canget to god is anything error free(perfect) Also the10 (binary number 2) requirements for being godincludea) Being omnipresent (1) in everything physical andeternalb) Having Neutrality (0) in Bias and Judgment to allAnd at core 1 amp 0 form everything that a Computercan relate to and as a Tester we ensure that thesources that turn into these 1s and 0s are correct atthe human side before being translated to systemside Which means we ensure that the requirementsare met to be God (error free)

Narayan Raman Well given that Shiv Bhagvaan iscalled Maha-Dev

Suresh Gattu God has this on his resumeArchitected Universe Developed Creatures toPerformance test Life Mentored humans onSPEACH SMILE platforms Lead all phases of SDLC(Species Development Life Cycle)

Nikunj Kathiria First god is a Developer (Developshumans) after that god is a tester (test humanity)

wwwTestingCircuscom December 2011 - 09 -

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 10: software Testing Circus

Jude Olisa God is the developer of universe andalso a tester He tests our actions against His writtenWORD

Tom Delmonte If God is perfect then God is adeveloper and testing is not needed because thereare no defects but wait There are defects in thisworld so is He perfect still and if so what happened

Tom Delmonte And if there are defects is there aGod I understand that some have said He is a testerin order to test us but that is not a definition of atester for our role we primarily test because thereare defects not to test and help others grow as hasbeen stated

Tom Delmonte By the way I am a firm believer inGod but to me He is a God that extends grace andworks with us and lifts us up when we are less thanperfect much like testers ought to be when workingwith developers

Randy Rice God certainly tests me My key verse isI Thess 522 - Test everything Hold on the good

Bharath Srinivasa Raghavan God is therequirement Owner He first created the prototype(Adam and eve) and then on they where thedevelopers and when more developers came inGOD as a tester created various test scenarios forhumans to handle

G Bhanu Prakash God is a grey box tester

Peter Bolin I think he is a bit of both working on anagile project Each iteration is supposedly a littlebetter than the last I also think he would have got itright sooner had the requirements been better -) Ijust wish I had as much time as him to complete myprojects I guess thru his example it just goes to showyou that no matter how thorough the testing therewill always be some that wont found until you gointo production Cheers

Tim Hall The developer only thinks hes God )

Francien Ramakers God ndashif he existed- would be adeveloper he created men and bugs alikeEarth is the test environmentThe bible is the requirements document describingexpected behavior The different authors representdifferent customers each wanting their user storiesin the official document leading to many discussionson what writing is really part of the final version ofthe bible (only the Old Document or should weinclude the New Document too)The tester- Is whatever causes the lsquohappy flowrsquo of life- causes all evil things we get thrown at us tosee how they are handled- is the messenger who informs God on(expected versus) actual behaviorAt the end of the test phase the Archangel MANagement decides what to do with Men version 11In the end men will be- send to hell with all other failed builds or- send to purgatory for a few bug fixes or

wwwTestingCircuscom December 2011 - 10 -

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 11: software Testing Circus

- released into the production environmentalso known as heavenPlease note mankind on earth is version 11 Version10 was almost completely removed from the testenvironment after a huge data overflow Thisoverflow caused blue screens on all test machinesexcept for the one machine with a picture of a dovein an olive tree on itrsquo s desktop Almost all data onmen (and bugs) got lost Fortunately the onemachine that kept working had a beta version ofmen on it so the developers did not need to startdeveloping men from scratch Unfortunately bugsreproduce much faster than men which is why thereare many more bugs than man on earth today

Shiva Kumar I think God is neither a Developernor a Tester God is a Customer to whom both theDeveloper amp Tester has difficulties within them inunderstanding the God-The-Customer )

Prayank Kumar GOD is not developer becauseDeveloper never makes anything perfect without atester and our life is perfect based on requirementdocument (Bible Quran Geeta) and GOD makes usto work according to that with EARTH as a testenvironment

Jagadeesan Murugesan God is tester becausewithout proper testing developer effort wasted

Jagadeesan Murugesan Whatever requirementdevelopment is good at last if testing is not good Entire product flops Example Windows Vista

Mustufa Gunderwala GOD used to be a developerbut the development phase was for 6 days andended after the creation of the universe Currentlytesting is being performed with the test cases(destiny) God also uses exploratory testing fromtime to time when he throws us of our paths to checkour quality The Regression phase is scheduled afterapocalypse when everything gets destroyed and lifebegins anew

Priti Jain lrmMustufa Gunderwala completely agreewith youGOD is more of a TESTER always use to testeveryone in different situations on differentparameters but dont give or develop a solution forthe same )

Jagadeesan Murugesan Tester always thinks incustomer perspective and Developer always thinksin own perspective so testers are GOD for product

Riyaj Shaikh God is both Developer and TesterJust the environment is a lot more agilersquo For the firstpart of Life cycle he is a More Developer than testerThen For the next part he is more tester thanDevelopment work Here is some trick Wedevelopers do fixing the problems reported byTester But here Developer directly make newproduct than fixing in the previous product Howabout the Requirement Gathering SO God is morethan developer and Tester He is also Technicalwriter Manager Producer Marketing man and a lot- which requires making his best product calledHuman

Jayshree Rathod God who develops to test us andTests so that we can develop

Suresh Gattu On a second thought I have this aswell God being made with something similar toHiggs boson Life is the Application with Universe

wwwTestingCircuscom December 2011 - 11 -

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 12: software Testing Circus

hosting clusters called galaxies that are capable ofrunning the needed Web+App+DB allowing cloudcomputing to host life Once life is deployed it hasdaily sprints where Requirements drivedevelopment and enhancement to the next versionenhancement to life During this destiny isaccumulated as experience on the resume of livingbeing at the same time reported to a bug trackingtool that reports to God along this God also has thecollective Data warehoused by Nature and uses it tounderstand and build a better Application calledlife

Ranjith Gopa God is a Developer prior to our Birthand a Tester till our Death

Ranjeet Sinha Generator Operator DestroyerGODDevelopers originate the product tester shape(validate) the product and last client who is usingand destroy the product with new requirementsHence i think individually no one either developeror tester or client is the GOD All three combined areGOD (Developer+Tester+Client)

Alfredo Ramiacuterez God is a Developer not a goodone It just sucks at maintaining or testing his work

wwwTestingCircuscom December 2011 - 12 -

Jayshree has doneher masters inPhysics and sheworks as anindependentSoftware Testconsultant from past2 years She hasmore than 3 years ofexperience in

manual testing and she loves exploratorytesting She has experience of testing manydifferent web and desktop based applicationsIn the universe she believes in God and theUser who always lives in her Michael Boltonand Pradeep Soundararajan are herinspirations Apart from testing she enjoyseating painting and reading Bhagavad Gita

She blogs at -httpbeingmyselfisanadventureblogspotcom

Like

Our Facebook PageTo

ParticipateIn more such

Interesting Discussions

Click Here

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 13: software Testing Circus

Be healthy wealthy and wise Always - Testing Circus Team

wwwTestingCircuscom December 2011 - 13 -

Nature had the right IdeaAlways use your reusable bags while grocery shopping

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 14: software Testing Circus

The QATest industry has recently been deluged by anew concept which for the sake of convenience weshall refer to Test Coverage I call this a concept as itstarts off with something in the mind of the Manage-ment fetters down to the Manager and finally is hand-ed down to the Tester to carry out the said instructionsWithout actually realizing soon a graphical represen-tation of his concept takes shape and becomes some-thing which people like to refer to as BusinessIntelligenceAnalysis The graphical representationgoes on to show that the current set of tests which havebeen implementedcreated cover either X lines ofcode or Y number of Business Screens but in generalnever both

The question here is Is this a true representation of thecomplete scenario with which the Coverage of theTests can be measured Not what a Test Manager or aDevelopment Manager who has put in enoughthought process would like to think so The above is amisnomer of how we go about treating an importantissue like Test Coverage Testing is a concept of check-ing that things work properly from the BusinessUsersviewpoint while a Test Coverage should encompass

both ndash Users viewpoint as well as the DevelopmentviewLet me take you through a typical Software Test LifeCycle The requirements come out in the form of a BIGbunch of documentation which has gone through var-ious iterations and reviews with the Business peopleand the other Stake Holders involved (but rarely theTest Team) This bunch of neatly typed bundle is hand-ed over to the Test Team in an official ceremony whichwe call the Beginning of the Test Cycle The TestManager goes over this vast bundle of joyous docu-mentation and then based on his past experiencesprovides an estimate of what all will need testing andwhat test cases can be broadly done This is called theEstimation Period as usually a rough time period isprovided on when the Test Team will finish - includesAutomation Manual Performance Security and thejig-bang

Once this Estimation Period is through the task ishanded over to the Leads to break down and offer anestimate but based on what the Test Manager hasalready provided Till this time the actual team mem-bers are usually not taken into consultation but the

wwwTestingCircuscom December 2011 - 14 -

Test Coveragendash Industry Standards

- Gagneet Singh

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 15: software Testing Circus

seniors of the Team are the confidants who will decideon what the underlings do Finally a document startstaking shape which for the sake of convenience we callthe Test Plan or the Test Strategy for want of abetter name This soon becomes the golden BibleVedasfor the Test Team and they have to adhere to what hasbeen said in it Thereby the official STLC starts

Once you have converted the BRD (Business Require-ment Document) or the PRD (Product RequirementDocument) to your test cases you need to start actuallyimplementing those test cases This is the place whereyou start bringing in concepts like Test Matrix and TestVectors which in layman parlance (developer speak)means the way that your tests are structured across thevarious data points for a particular view on the appli-cation Now comes the really good part Here also liesthe culprit mentioned as Test Coverage where theabove mentioned superior tester comes out and saysthat we are doing a Test Coverage of X lines of codeor a Y number of business screens)(for GUI applications which usually is 90 of testedapplications) But does he actually know what he hascovered with his test cases Some do while some havejust made the assumptions after reading articles suchas this one or from their superiors who again mighthave obtained their knowledge from such places Thetest cases are sorted out and some go over to the Auto-mation Team to put in their regression suite whileothers are manually vetted out and put through thepaces of the Bug Life Cycle (What this means to theglobally scattered teams depends on how much themanagement has spent of procuring a good issue

reporting tool My recommendation would be to lookinto Joel Spolskys FogBugzhttpwwwfogcreekcomfogbugz) But again to addhere - to each his own poison

Once the case of creating test cases and shoving theminto the Automated Test Suite is completed the TestManager will jump and click a variety of buttons on hisconsole (something which has been created by hisTeam to make life a brisk walk for him Or the manage-ment has spent some more money into procuring an-other one of those efficient tools out there) Thus voilaa beautifully coloured report of what passed and whatfailed and specially How much of CodeScreens werecovered by our Testing Definitely a piece of Beautyfor the Management

But what is the real usefulness of such a report In myhonest opinion ndash NIL We did a good job of covering allthe lines of code which were there but did we cover thepaths through which the code would be executed Idont think that is thought of even 25 of the time Didwe make sure that boundary values are covered Itmight be that we have a few test cases making sure ofthis but do they map to our coverage Did we take careof the definite values that a few fields on our screenwork on No this would be a definite gap most of thetimeWhat we did do was this

a) Ensure that at least 85-90 of the code lines arecovered by our test cases executed using the

wwwTestingCircuscom December 2011 - 15 -

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 16: software Testing Circus

Automated Scripts (Good This might be anissue with doing through Manual tests so nooffence to Manual Testing here)

b) Made sure that all the GUI screens are covered

But did we make sure that all the individual fieldvalues on that screen are covered usually not Theseare the places where we get issues Also most of timethe term known as ldquoNegative Testingrdquo is not givenenough importance in such cases The usual rant being

a) Did not have timeb) Is not that important as such a case would not

happen in Production

But these are important things and they convey thecoverage of our tests With this article I have mainlybrought out what is not being tested andor how badlywe test things Will be putting in more thoughts in thevarious test tools in the future See you soon in TestingCircus

wwwTestingCircuscom December 2011 - 16 -

Gagneet has been working in the QualityAssuranceTest field for the past 8 years (withan additional 4 years in System Toolsdevelopment) and has been involved withcompanies such as Toshiba Adobe(Macromedia) McAfee Oracle Yahoo andrecently Microsoft

He likes to blog and to write about theexperiences he faced in the various organizationsand situations His work has mostly been withAutomation Testing along with PerformanceQA Also Security testing over the much hypedldquoCloud Computingrdquo (using Hadoop and Azure)has figured in his work area

Currently working out of this place they call theldquoDown Underldquo where he lives in Sydney NewSouth Wales

ldquoTesting Circus givesme insights frompractitioners thatinspire my team to trynew experimentsrdquo

- Lisa Crispin

Read full interview atPage 61

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 17: software Testing Circus

wwwTestingCircuscom December 2011 - 17 -

Book Wormrsquos CornerDecember is too cold Need books for warmthNeed some nice place to take refuge Decidedto visit the bookshelves of the cartoon testerAndy Glover and Rob Lambert who publishes theTesting Planet Magazine There are testingbooks and there are other books which canbecome testing books This month itrsquos more ofthe latter What they gained from reading thosebooks and why they recommend those books Hearfrom them directly

LoveWoBo

Book RecommendationsFrom

The Mastersamp

What They Have To Say About It

Rob LambertGut Feelings Short Cuts To Better Decision Making by Gerd GigerenzerThis book has some excellent information advice and lessons on why GutFeelings are often the better choice Its packed with ideas which can bebrought to your testing world

Obliquity by John KayAnother interesting book on why decisions are made and how when you reallytry to achieve a lofty end goal you typically fail This books aims toexplain why true success is not a direct line from A to B but a wanderingand meandering journey of exploration opportunity and a little bit of luckLots of lessons to bring to the testing world

Andy GloverLateral Thinking by Edward de BonoWhen testing software and designing good tests testers need to be able tothink outside of the box this book gives testers practical ideas how to dothat

The Duck That Won The Lottery by Julian BagginiTesters are often at the wrong end of a bad argument You should have foundthis bug this book lists different types of arguments and describes howto spot them

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 18: software Testing Circus

Crack The Code - Blindu Eusebiu

wwwTestingCircuscom December 2011 - 18 -

Blindu Eusebiu is a tester for more than 5 years He is currentlyhosting European Weekend TestingHe considers himself a context-driven follower and he is a fan ofexploratory testingHe tweets as testalways You can find more interactive testingpuzzles on his website httpwwwtestalwayscom

Send your answers to testalwaystestingcircuscom

What is the biggest number that is validated asprime number here

httpwwwonlineconversioncomprimehtm

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 19: software Testing Circus

wwwTestingCircuscom December 2011 - 19 -

Naomi KartenSpeaker author presentation skills for tech professionalsmanaging change managing customer expectations introversionPsychology background Love to skihttpwwwnkartencom886 Following1106 Followers50 ListedhttptwittercomNaomiKarten

Test Management ToolTestuff is a provider of SaaS-based Test Management service formanaging and executing manual and automated software testsand for reporting defects httpwwwtestuffcom1805 Following910 Followers59 ListedhttptwittercomTestuff

Thomas VaniotisSoftware test lead in finance Context-driven exploratory tool-as-sisted service-oriented tester by day Musician philosopher bynighthttptvaniotisnet32 Following121 Followers17 Listedhttptwittercomtvaniotis

Tim WesternSoftware DeveloperTester Eagle ScoutScouterhttpdiscoveredtesterblogspotcom314 Following275 Followers25 ListedhttptwittercomVeretax

httpTwittercomTestingCircus

We recommend to follow

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 20: software Testing Circus

wwwTestingCircuscom December 2011 - 20 -

Follow us at Twitter

httpTwittercomTestingCircus

Testing Circus

Testing Circus is a monthly magazine on software testing founded and edited by

ajoysingha The magazine publishes various subjects on software testing

httpTestingCircuscom

343 Following

830 Followers

46 Listed

httptwittercomTestingCircus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 21: software Testing Circus

Software testing feels like a young field doesnt it

Of course compared to medicine law or even some-thing like electrical engineering the software test roleseems young but its more than that

We seem really young Its almost as if we have 100turnover and every few years a new bunch of youngworld-changers arises to try to change the world inmany cases doing the same things as the old ones withnew names

Theydontknow itof coursebecausetheyhaventread theliterature

But sad-ly if they

had read the literature it wouldnt help terribly muchI dont mean to be overly critical Glenford Meyers dida great service to the community with his book on theArt of Software Testing -- it gave us some body ofknowledge to start from Yet when I look at the

literature of the 1970s to the 1990s I see the samethings Heavyweight process slogans mechanicalprinciples interesting applications of graph theory

Ive seen process (and metrics and templates) triedover and over again with very little success Based onthe lack of evidence for the idea yet the dogmaticdevotion to it that I see I have come to slow painfulconclusion that the ideas are more ideological thanpractical Likewise the graph theory is pretty Yes wecan express any program as a directed graph and wecan evaluate coverage according to a model The prob-lem I see is that outside of some specialized domainslike telecommunications avionics and embedded sys-tems nobody ever does

When I say sloganeering I mean the process slogans ofthe 1980s

Testers need to be involved up front

Without a complete consistent correct specification youcant test it

If you didnt write it down it didnt happen

Software Testing should be stable predictable and repeat-able

wwwTestingCircuscom December 2011 - 21 -

Beyond Junior Testing Skills

- Matthew Heusser

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 22: software Testing Circus

We dont need testing What we need is processimprovement and executive buy-in

When I hear these phrases something happens Itbothers me I feel like something is wrong

I used to think that I came from a different school -- thatI was interested in testing and if folks wanted to go dothat prevention stuff well thats great for them but Iwould keep testing as long as I could add value Ifmanagement wants to involve me in the requirementsthats great But Im not going to sit and whine that Ineed to be involved up front Inject me wherever in theproject cycle youd like in a project as good or bad asyoud like and I intend to burrow in and find ways toadd value

Now compare that to all those other slogans - the onesabove between the horizontal lines

What are they really saying

Cmon Break it down to symbolic notation Squint alittle Look at them sideways

I would argue the hidden message above is everyoneelse needs to change to make my job easier

The great irony of course with making the workeasier is that now it can be done easily

That means it will be easy to assign to someone makingless money or to outsource or to get rid of you the guylooking for the cushy job

The slogans arent helpful to the software testing fieldand worse can be actually harmful to the sloganeer(Unless youre selling books in which case Im toldthey can be helpful But I digress)

Instead of whining I want to roll up my sleeves andjump in I want to find bugs and yes I typically startwith that last vestige of the old generation of testingThe Classic Techniques

The Mechanical Techniques

Testing the Boundaries Creating Decision Trees andexercising all the combinations Finding the Equiva-lence Classes Sending invalid input creating race

conditions and using quick attacks -- all the classicstuff Man do I like that stuff It works It finds bugs

These are real techniques techniques you can learninternalize get better at and dog gone it be a bettertester I use these techniques I teach them and I studythem

Theyre great

I also find that not nearly enough testers can do thesethings

When I ask Agilists how they come up with test ideasthe common answer is the whole team will come upwith test ideas

This tells me those folks dont have a theory of wheretest ideas come from -- or at least havent thoughtabout it enough to have a prepared answer on the spot

Moreover I find the idea trivializes the processbecause it assumes that any large group of people withno specific training can make testing happen (Theseare the kind of teams by the way that find bugs thatseem obvious in retrospect This is a natural thingblack swans are a reality but to these guys ithappens a lot if you take my meaning And they arealways surprised And they will be again next monthtoo)

These techniques work and I do believe that a fairamount of my role in the community is teaching themto others

Then something odd happened

Junior Tester Skills

Over the past few months several people I highlyrespect have started to refer to these as junior testerskills Over and over again

The Mechanical skills are simple to explain and easy tolearn and run the risk that software testing is viewedas the kind of thing that is simple to explain and easyto learn

If we can train testers in three days we certainly dontneed to recruit and retain high-quality talent The

wwwTestingCircuscom December 2011 - 22 -

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 23: software Testing Circus

smart people are demanding bossy argumentativeand tend to want a lot of money

No if we can train testers in three days we might aswell get some cheap folks who know how to memorizerules

Now I might be okay with that if all testers were thesame

But there are other forces at play here

You may be turned on to testing in three days you mayhave memorized a set of skills (if you dont know thoseterms above by all means go learn them) but wehavent even touched the surface of things that a goodtester knows how to do and has trained to become ahabit

Of Senior Testers and their Skills

Allow me to give you an example For about a year anda half Ive been developing the GRR AirportParkCalc problem as a test exercise

The basic exercise is simple Heres a website test itQuick attacks work great for this

Once weve done testing it and conducted aretrospective I like to point something out We reallydont know if the software is fit for use - we dont knowthe happy path -- because we dont know how muchwe should be charging for parking So I point theaudience to the actual parking rates which can befound on bottom of the web page with the airport maphave them sharpen pencils and get testing for issuesspecification-in-hand

Thats good too

Sometimesthough someonepoints out theobvious Even ifthis website worksaccording to itsspecifications howdo we know that

the parking garage itself charges the right ratesShouldnt we test that too

I suspect that is the kind of thinking that friends callSenior Tester Skills

Several of my colleagues in the test industry havepointed out to me that senior testers need to figure outthe real risks and I agree They tend to focus oninterviewing the customer and I further agree to apoint

Often I find that the customer doesnt know what hewants or at least he doesnt know what the businessneeds

In many cases it falls to the senior testers role to findout what the business needs and to find out if thesoftware can meet those needs To quote the fifthprinciple of the Context-Driven School The product isa solution If the problem isnt solved the productdoesnt work

Customer Interviews may be one way to gather thatinformation walking around and listening is anotherObserving people doing the work under the existingstate is another reading about the industry orattending sales calls might be another (When I thinkabout this list I am astounded at how many of these arethings that companies right now are activelydiscouraging testers from doing sometimes in thename of process improvement)

If Im on a team I want to get very close to thecustomer Ideally Id like to be a customer someonewho uses the software to get work done like I was atSocialtext Failing that I want to be as close as possible

From that closeness I want to understand the happypath scenarios the consequences when they fail andthe consequences when anything fails

The Virtues of a Tester

Its easy enough to understand the virtues of a tester atleast superficially Creativity the ability to thinkcritically curiosity a dogged perseverance combinedwith knowing when to give up A spidey sensewhich I would define as the ability to recognize

wwwTestingCircuscom December 2011 - 23 -

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 24: software Testing Circus

patterns at least unconsciously and know where tosnoop for bugs

All these things are virtues and we could talk abouthow to grow them

Figuring out what to test first - and once weve donethat what that tell us and whats next -- thats hard

Its tough to nail down It is squiffy

Its tempting to give up and go teach bounds andequivalence classes

Yet it is those skills that ability to pull out the risks thatreally matter to come up with the scenarios that no oneelse thought of to explore the rare combinations thatcan confuse the software and to draw conclusionsfrom those few tiny minute explorations of thesoftware -- that is what senior testers are made of

Its a long hill to climb and its an awkwardconversation Sometimes talking about these skills canfeel a bit like beating the air

But if we want to grow the field we had better get goodat it

Im in

You know where to find me

Lets do this

A contributing editor at STQA Magazine MatthewHeusser is the principal consultant of ExcelonDevelopment The lead editor of ldquoHow to Reducethe Cost of Software Testingrdquo Matt is also a memberof the board of directors of the Association forSoftware Testing and a frequent conference speakerRead more from Matt on his blog athttpxndevblogspotcom at the STP CommunityBlog at httpwwwsoftwaretestprocomblog orfollow him on twitter mheusser

wwwTestingCircuscom December 2011 - 24 -

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 25: software Testing Circus

Exploratory testing is testing without writing test casesand executing them It is the method of diving straightinto testing without all the preparatory work of test casebased testing or laborious script writing of automatedtesting Exploratory testing is sometimes calledcowboy testing the wild west approach to testing dueto its absolute freedom in choosing what to test andhow

Exploratory testing has the following advantages

1 It is fast No time is spent in writing test plansBugs are reported right away so programmerscan start fixing them immediately

2 It is scientific proven to be more effective thantest case based testing Khurram Bhatti andAhmad Nauman in their thesis Effectiveness ofExploratory Testing found that ET is moreeffective than TCBT to find more bugs Quotingfrom their summary Our experimental datashows that exploratory testing was both moreefficient and effective than traditional test casebased testing We do not consider thatgenerating test cases is a total waste as it is

helpful to keep a good test suit But higher thenumber of test cases is not always directlyproportional to total defects detected AlsoAnutthara Bharadwaj a Microsoft employeewrote about exploratory testing that ldquoit findsover 90 of the bugs in the systemrdquo

3 It allows the tester to learn areas of theapplication they have not tested before toimprove their expertise in the application

4 It keeps the tester from getting bored fromrunning the same test cases during regressiontesting It adds variety to the job

5 It frees the tester to try new testing techniquesand tools since the tester is not restricted by thesteps of a test plan

With all test advantages why do some test managersactively not support exploratory testingThe reasons are the following

1 There is no tracking of what was tested exceptfor the list of bug tickets reported Test managershave to report to project managers their progressof testing Having no tracking of testing against

wwwTestingCircuscom December 2011 - 25 -

- Mark Garzone

Bringing Exploratory Testinginto Your Test Department

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 26: software Testing Circus

a test plan makes it impossible to judge if theyare falling behind the project schedule

2 Test managers feel that they have no control andfeel a loss of power since they do not directcontrol of the actions of the testers They cannotsay please execute test case X now since thereare no test cases to execute

3 There is no artifacts produced except for the bugtickets reported Test managers like to say wehave 500 test cases in our test suite to uppermanagement for a sense of accomplishment ETdoes not waste time on writing test cases whichmight become outdated quickly in a rapidlychanging requirement environment It is perfectfor agile development organization whererequirements often change

4 Exploratory testing is not considered to befashionable in some organizations which areprocess documentation oriented eg IS0 9000 inspite of its effectiveness Tester managers arerestricted by the demands of management andthus cannot openly embrace ET

So how can testers win the support of the test manager

1 Try to convince test manager of the effectivenessof ET Show them that the study by KhurramBhatti and Ahmad Nauman

2 Promise to add test cases later to the test suiteafter doing an exploratory test session for thoseareas tested

3 Track what features have been exploratorytested for the test managers reporting purposes

4 Give the test managers a sense of control byasking them if they can test feature x usingexploratory testing

5 Negotiate with test manager for X hours a weekfor exploratory testing Flexibility is key heresince any exploratory testing time is better thanno exploratory testing time

If the test manager does not approve any exploratorytesting is it still worthwhile doing ET discretely whilerunning test cases This form of exploratory testing iscalled scenario-based exploratory testing in whichexploratory testing is injected into the execution of testcases or test scenarios Test managers will not noticescenario-based exploratory testing since the bugs found

by stealth ET can be attributed to ldquoaccidentalrdquo bugdefection while executing the test cases

Exploratory testing is not a replacement for test casebased testing or automated testing but it should occupya considerate portion of any test cycle to benefit fromits strengths

References1 Effectiveness of Exploratory Testing by Khurram

Bhatti and Ahmad Nauman2 Slide Presentation by Anutthara Bharadwaj

wwwTestingCircuscom December 2011 - 26 -

Mark Garzone is the founder and CEO of TesterCrew wwwtestercrewcom a website whichgives testers an opportunity to earn extra incometesting applications He has been a test leadsenior tester team leader and programmer inseveral industries ranging from consumerproducts travel insurance totelecommunications He has worked in the ITfor over 16 years He can be reached athttptwittercomMarkGarzone

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 27: software Testing Circus

How to promoteTesting in YourOrganization

wwwTestingCircuscom December 2011 - 27 -

Testing Circus Regular Feature

- Rob van Steenbergen

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 28: software Testing Circus

I started with my product risk session tips to guideyou a bit when you are doing a risk analysis sessionin your company and told you how to prepare andwhat you would do in a session (with use of stickynotes) Furthermore I mentioned some attentionpoints and pitfalls Now for the last part of thisproduct risk analysis series

Examples of aspects of failuremiddot Frequency of use

middot Complicated or unknown product

middot New tooling

middot Development of product is taken over fromothers

middot Time pressure

middot Functions in subsystems are complex

middot Functions that have been changed a lot

Examples of damagemiddot Loss of image of company or organization

middot Costs of correction actions also extra documen-tation

middot Employees cannot do their work

middot Clients canrsquot be supported

middot The business processes are less efficient (or notefficient)

middot There is arising a negative image of the ICTorganization

You can find more on the internet or by deepthought of course

Classification of risks

There are a lot of ways to classify risks One way Iuse is to let the stakeholders choose between LowMedium and High (1 2 and 5)

middot Low Failure Probability Damage 1

middot Medium FP D 5

middot High FP D 10

So per risk everyone will place a number for FP andfor D Multiply and you get a classification A riskwith a FP of 5 and a D of 10 = 50

So the session phases are in this ordermiddot Discuss scope

middot Defining the risks

middot Classification of risks (F X D)

Conclusionmiddot Risk analysis is a communication process

middot Good starting point for testing strategy (riskbased testing)

middot Stakeholders talks to each other

middot It is experienced as a fun process

Outcome is a risk table but you will have madetesting more visible for the stakeholders too

Good practices and remarksmiddot When doing a session ask someone to help

who has some experience on this

middot Ask to write down risks

wwwTestingCircuscom December 2011 - 28 -

How to promote Testing in Your OrganizationTest promotion Do regular product risk analysis - Part 4

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 29: software Testing Circus

middot Goal of the session is to get as many risks as possible

middot Product risks versus project risks When in doubt Product risk

middot Supply quick feedback as soon as the risk list is completed send this to all stakeholders

Feedback

The main important thing now is to place the list in an MS-excel sheet (or other format) and mail thisto the people that were in the session as soon as possible with a request for review

This Excel sheet should be clear for the readers and simple Herersquos an example of such a sheet

wwwTestingCircuscom December 2011 - 29 -

CriteriaRisk Submitter

Functionality areaof theproduct

Qualityattribute

Chanceof failureHigh = 10Middle =5Low = 1

Damage(whenfailing)

Riskclass

1

There could be known issues inthe application API that we dontknow off that will cause problemsin our system

Jacko APIReliability

1 10 10

2

Support installs the software inproduction in the wrong order Itlooks like installation is completebut at the end it is not

PeterInstallation

Installability

5 10 50

3

Customer does not get feedbackwhen the shop website ishandling 1500+ customers at thesame time

Team GeneralPerformance

1 5 5

4

Error messages that come via theAPI will give information aboutthe product that could be asecurity risk

Team APISecurity

1 1 1

5A customer can reach and editother customers shopping cart

Team GeneralSecurity

5 10 50

6The new page is not translatedinto chickenwings

TeamTranslation

Localizability

1 5 5

7

Emptying a basket is not possiblebecause the customer already didgo to the last page of the orderprocess

JackoProductdatabase

Capability

10 10 100

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 30: software Testing Circus

Testing and results

Now for testing you have an idea that has beencreated by the technical people and the businessThey all provided inputs and need to be updatedabout the results

In this way testing becomes more visible toeveryone that has a relation with the project If thisis done in a professional manner it willautomatically promote the testing you are doingSo think about it discuss it with fellow testers anddo it

Agile

As a last remark you can do this also within agileprojects For example on each iteration you aredoing you can do an informal risk session withyour team Sitting around the table and justdiscussing possible risks of the functionalities oruser stories you are implementing in the iterationThe product owner will be there to get input fromthe business

After a few iterations you then could do a moreformal brainstorming session with more peoplefrom the organization to get a bigger picture Thisis a bit like zooming in (focusing) and zooming out(de-focusing) on your test project

Thank you for reading Bit of special article thistime big subject but from a testing promotionperspective a very important part

wwwTestingCircuscom December 2011 - 30 -

Rob van Steenbergen is an independentsoftware test consultant from The Netherlands

In the last 5 years he has been involved ininfrastructure projects and is now working atLeaseweb He is working in agile projectsinfrastructural and software products coachingnew testers and helping with setting up andimproving the testprocesses for this companyFor more information visit ndashwwwchickenwingsnlRob can be reached at

httptwittercomrvansteenbergenE-mail robchickenwingsnl

Few days to go and New Year 2012 will be hereWith the advent of new year a new era begins andwith it comes new hopes and new possibilitiesEvery year teaches us some of lifes most importantlessons and with that learning we put our stepforward into the new year Testing Circus Teamwishes you a very happy and a bug free New Year

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 31: software Testing Circus

wwwTestingCircuscom December 2011 - 31 -

Advertise with us

Advertisement rate starting $25per month

Write to us at adstestingcircuscom for a detailed media and advertisement kit

Testing Circus is loved by real

testers Reach out to our readers

by placing an ad with us$25 Onl

y

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 32: software Testing Circus

wwwTestingCircuscom December 2011 - 32 -

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 33: software Testing Circus

wwwTestingCircuscom December 2011 - 33 -

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 34: software Testing Circus

wwwTestingCircuscom December 2011 - 34 -

In case of Fire

EXIT BuildingBefore Tweeting

About It

have alough

on alighternoteFun

Corner

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 35: software Testing Circus

The Stolen Idea

When the week began all of us were groaningMonday morning and Delspe (my boss the ldquodel-egation specialistrdquo) was back at work He wasaway at training for an entire week All of uswere praying that the training should extendbut it did not and he came back Do you everwonder at the fact that your productivity in-creases when your bossrsquos away And how itdecreases when he returns How this freedomexists to do your work when hersquos away and howthat freedom is lost when he returns How canyou breathe easy when hersquos away With the bossbeing a desk away therersquos this feeling that youare constantly being judged and that kills pro-ductivity Not sure if many people realize thisI had a brainwave during that period when hewas not around and sent him my thoughts in an

email

Really -Delspepinged me Iknow thatmy email wasmaximizedon his screenand he waslooking intoit

I pinged backand repliedYes I

walked over to his cubicle and told him that wecan achieve 50 of improvement in productivityif we are able to install this software that wouldvoice-record our bug reports and then create adefect from itHe said that hed think about it I came back tomy desk and forgot all about this episode for thenext few months

After a few days Delspe met his boss BigDel-spe Delspe proposed his idea to his bossBigdelspe told him that its an interesting ideaand that it had a lot of potential He also said thatit had a lot of potential to become a bigger ideaand that there might be a huge market for thisidea

Some days later his boss our VP was visitingour location Delspes boss pitched this idea tohim over a conversation in the elevator The VPgave him a very sarcastic look and blasted theidea He said that he does not have time forstupid meaningless conversations and that if hehad something better it would be good use of histime

The VP left and found himself in a sales meetingthe client was a company that had become a 10million USD company in quick time the ownersof that company wanted to work with brilliantyoung minds the client wanted to know whatkind of product idea these guys came withUnable to think of anything the VP pitched thisidea to the clients the young CEO got up andleft

Part 12

wwwTestingCircuscom December 2011 - 35

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 36: software Testing Circus

The VP was flushed when he realized that hescrewed up the account he was more worriedabout how to face his boss than the fact that anaccount was lost

The CEO went back to his company and startedthinking about it overnight he wrote a fullpaper and application on this He rushed nextmorning to the legal department and sent thisidea to be patented within a few weeks thepatent was his

I happened to read in a magazine the cover storyof CEO who had a patent about a talking bugdatabase system

What I learnt from this episode1) No idea is original every idea is stolen

2) Donrsquot bother about feedback from your bosswhen you get a good idea file a patent

3) And every time you read in a magazine that aCEO has filed a patent you know where itoriginated from

Well thatrsquos how the world is Anywaysherersquos wishing you a very happy 2012hellipI hope you do less ldquofake testingrdquo in 2012than you did the years before See younext year

wwwTestingCircuscom December 2011 - 36 -

A platform for softwaretesters to collaborate testvarious kinds of softwarefoster hope gain peerrecognition and be of valueto the community

httpweekendtestingcom

A fake Testerrsquos Diary was first published inTesting Circus January issue New Readers areencouraged to read our old issues athttptestingcircuscom to understand thejourney of a fake software tester

Keep reading future issues of Testing Circus toknow more Do you have anything to sayabout fake testing practices

Write to us faketestertestingcircuscomBy the way have you seen the blog on fakesoftware testing Here it is -

httpfakesoftwaretesterblogspotcomndash Editor

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 37: software Testing Circus

wwwTestingCircuscom December 2011 - 37 -

ldquoWhat is a Testerrsquos Role in Qualityrdquo is a two-part seriesthat discusses quality from both a relationship andprocess perspective Part 1 of this article focus is on therelationships the tester builds with developers productmanagers and business analysts and how those rela-tionships can have a positive impact upon the productrsquosquality The second part of this article discusses theprocesses and testing approaches adopted by a TestingDepartment and how they impact the productrsquos quality

There are different viewpoints on a testerrsquos role indelivering a quality product and what defines qualitySome call a tester ldquoQuality Assurancerdquo implying thetesting department is responsible for the productrsquosquality Others define quality as being inclusive whereeveryone has a role in quality from what the salespeople promised the quality of the requirements thedevelopment and testing groups understanding andtranslation of the requirements and customer supportThe interaction of these departments working togethercan deliver a better product when information and riskis relayed and discussed For the purpose of this articlequality is defined by understanding what is importantto the client based upon their business needs how theyuse the product and how the product influence theirdecision-making

Based upon an inclusive quality approach driven bycustomer needs what is a testerrsquos role in quality Atesting department can play an important role by theinformation they provide and questions they ask to thestakeholders product managers and developers tohelp everyone make better decisions in addition to thetesting strategies adopted

DevelopmentAn important communication tool between testers anddevelopers is the problem report Providing the rightinformation at the correct detailed level not only helpsthe developer in understanding the bug but also theurgency or impact The problem report is a valuabletool that can have a positive impact on product quality(For more information refer to the article ldquoGuidelineson Writing a Meaningful Problem Reportrdquo published inTesting Circusrsquos November 2011 issue)

Working with developers to understand coding risksand their testing concerns can help testers identify newtests to perform The stronger relationships and trustbuilt between testers and developers can open up thegateway for each party to approach the other withconcerns and problems Often these concerns are notdiscovered during a risk-analysis meeting as morehigh-level or broad-stroke risks may be identified A

What is a Testerrsquos Role in Quality

- Bernice Niel Ruhland

Part 1

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 38: software Testing Circus

developer and tester working side-by-side whether it isreviewing code or a tester working through a problemwith a developer can help identify potential risks orvulnerabilities for testing This value-add to the prod-uct quality should not be underestimated as deeperproblems are often discovered before going to produc-tion through these relationships

Product ManagementWorking closely with product managers is important torelay risks as early as possible to help them make deci-sions such as prioritizing bug-fixes and determiningwhat risk-level they are comfortable releasing the prod-uct which may include changing the release date If therisk level is high but yet deadlines cannot change thenidentifying what can be tested before going to produc-tion becomes an important conversation This discus-sion can include

middot Understanding what was promised to the clientto ensure those features are tested

middot Agreeing upon lower-risk items that will havelimited testing

middot Identify if there are other employees who canassist with the testing

middot The feasibility of performing additional testingin the next release to help manage testing criticalareas in the current release

This information can allow product managers tomanage customer expectations as to functionality thatwill be released and future plans for enhancements orbug fixes A close working relationship with the prod-uct managers can be beneficial to the testing team tounderstand what level of risk is acceptable which canhelp target testing approaches Overall this relationship

can have a positive impact upon the productrsquos qualitywhen better decisions are being made and communicat-ed both within the team and to the client

Business AnalystsDiscussions with theBusiness Analysts (oremployee who is incharge of therequirements) can bebeneficial in manyways which caninclude the

followingmiddot Reviewing the requirements to discuss testing

ideas and approachesmiddot Understanding important functionality to the

customer and how they might use the featuremiddot Uncovering any known risks or concerns from a

business perspectivemiddot Discussing testing results that do not meet the

requirements to further understand expectedbehavior

middot Providing feedback on usability and flow offunctionality that might be awkward to use

For new features request a product demo to gain initialtraining and insight A product demo can go a long wayin bridging initial requirements to the product intesting and reducing the learning curve Prior to thedemo read all the requirements and if possible performinitial testing to help identify questions Potential ques-tions could include

middot What is the main business purpose of thisfeature

middot What functionality is most important to theclient

middot What type of decisions will the client make

Developing a two-way relationship with the BusinessAnalysts can help them make better decisions for thecurrent release determine future enhancements andunderstand what type of information is valuable to thetesting team All of these positive outcomes can lead toa better customer experience In some companies theProduct Manager may also be involved closely with theBusiness Analysts on these decisions

Conclusion

wwwTestingCircuscom December 2011 - 38 -

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 39: software Testing Circus

An important factor in product quality is the relation-ships developed within the project team of testers devel-opers and stakeholders These relationships can providethe Testing Department with valuable knowledge onhow the client uses the product and what is important tothem plus understand risks from a developmentperspective This information allows a testing team tobetter target their testing This can result in better infor-mation the testers can provide back to the project teambased upon clientsrsquo requirements Testers providingtimely information to the correct employees can improvethe productrsquos quality through better decisions and com-munication

More on this in the January 2012 issue of Testing Circus

Bernice NielRuhland is aSoftwareTesting Manag-er with morethan 20-yearsexperience intesting strate-gies and execu-

tion developing testing frameworks performingdata validation and financial programming Sheuses social media to connect with other testers tounderstand the testing approaches adopted bythem to challenge her own testing skills andapproaches

When not exploring the testing world Berniceenjoys cooking and spending time with her hus-band living a health-conscious lifestyle Theopinions of this article are her own and not reflec-tive of the company she is employed Apart fromother activities Bernice regularly contributes toTesting Circus Magazine Bernice can be reachedat

LinkedInhttpwwwlinkedincominbernicenielruhlandTwitter bruhland2000G+ and Facebook Bernice Niel Ruhland

wwwTestingCircuscom December 2011 - 39 -

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 40: software Testing Circus

wwwTestingCircuscom December 2011 - 40 -

Do you have an excellent Story to tellConsider publishing your testing article with us

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 41: software Testing Circus

Testing CircusAre you missing our discussions at facebook

Join Testing Circus Fan Club

Get updates and messages directly on your wall

httpwwwfacebookcomTestingCircus

wwwTestingCircuscom December 2011 - 41 -

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 42: software Testing Circus

wwwTestingCircuscom December 2011 - 42 -

strcomp() mid() split() instr() replace()filter()

temp=Welcome BAck temp1=Welcome Back temp2=Welcome Mr Joy Way the Way temp3=come

SPLIT() text=split(temp2) limit=ubound(text) For i=0 to limit msgbox text(i) Next

FILTER() text1=filter(textJam) limit=ubound(text1) For i=0 to limit msgbox text1(i) Next

REPLACE() text=replace(tempJPa) msgbox text

INSTR() text=Instr(1temp1temp3) msgbox text

MID() text=mid(temp143) msgbox text

STRCOMP() Binary amp Text Comprison If strcomp(temptemp10)=0 Then msgbox Pass else msgbox Failed End If

Jaijeet Pandey has over 5 and halfyears of experience in ApplicationDevelopment Maintenance andTesting From more than last 4years he is involved in automationtesting with QTP and LoadRunner tools He is associatedwith various testing initiatives inNCR region of India He teachesQTP on weekends Jaijeet oftenblogs at

httpjaijeetpandeyblogspotcom

He is currently employed withBirlasoft He can be reached athttptwittercomjaijeetpandey

Frequently Used Functions in QTP

Have questions Contact me at jaijeettestingcircuscom

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 43: software Testing Circus

wwwTestingCircuscom December 2011 - 43 -

Software testing co uTest raises $17mSoftware testing company uTest has completed a $17 million series D round of funding The company announcedin its corporate blog today that the round was led by QuestMark Partners with full participation from all ofuTests previous investors including Scale Venture Partners Longworth Venture Partners Egan-ManagedCapital and Mesco LtdThis latest round brings the companys total funding to more than $37 million since its founding in 2007 uTestsays that this marks one of the largest investments ever made in a crowd-sourcing company uTest added that inthe 15 months since its $13 million C round the company has seen its valuation more than double This sharpincrease was driven by the rapid customer adoption of uTests in-the-wild testing services and other contributingfactors

uTest was founded by CEO Doron Reuveni and VP product man-agement Roy Solomon Although today based in SouthboroughMassachusetts the company retains a development center inHerzliyauTest will use the funds raised to Open new offices in app crea-tion hot spots including Seattle Los Angeles Dallas and Chicagodevelop tools that enable companies to launch better apps explore

MampA opportunities in the app-enablement space recruit additional specialized experts - including securitytesters linguists and performance engineers and expand its testing platform for third-party developersReveni said The markets adoption of uTests services has been amazing - particularly among retailers mediacompanies gaming firms and agencies Given the ever-increasing demands by users that a companys apps workflawlessly under real-world conditions the opportunity before uTest is massive This latest round sets us up tohelp even more companies developers and testers launch apps that their users love

httpwwwglobescoilserveenglobesdocviewaspdid=1000703762ampfid=1725

Lack of quality talent concern for software testing QAIThe Indian software testing industry has a lot of growth potential but lack of talent and quality of graduates aremajor concerns workforce development and consulting firm QAI said today Speaking at the 11th AnnualSoftware Testing Conference (STC) in Bangalore QAI CEO Navyug Mohnot said the Indian software testing

Software Testing News

News in Hindi Script

Testing

News

De

livered Fresh

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 44: software Testing Circus

industry has a lot of growth potential but lack of talent and the fact that most of the engineering graduates are notemployable was a major hindrance to the growth of the sectorldquoAround USD 60 billion is spent globally on software testing out of which 20 per cent is on enterprise segment and80 per cent on consumer segment There is a requirement of 30000 people in the industryrdquo he addedMohnot was of the view that a neutral industry platform is needed for exchanging and sharing of ideas with eachother to ensure that the ecosystem thrives wellTo ensure results in a sustained manner at all levels and at all times excellent organisations continuously learnboth from their own activities and performance as well as from that of others he addedMohnot said events like STC provide the industry and the people such a platformAccording to a report by software body Nasscom the software testing industry in India is pegged at about USD 45billion and is growing at 14-15 per cent annuallyEstablished in 1980 in US QAI is a global consulting and workforce development organisation addressing theeducation and operational excellence space in educational institutes IT BPO and knowledge intensive firmsSince its inception QAI has trained over 16 lakh professionals and certified over 40000 professionals worldwideQAI is currently servicing over 300 clients in 30 countries and has offices in US India China and Singapore

httparticleseconomictimesindiatimescom2011-12-02news30467991_1_software-testing-indian-software-testing-industry

Software testing industry to prosper in VietnamThe software testing industry in Vietnam has developed rapidly in recent years as local companies have won theconfidence of multinational technology giantsNguyen Quoc Hung chairman of LogiGear said Vietnam this year had ranked eighth in the list of top tendestinations for software testing by the British AT Kearney Consultancy Group and had remained on this list forfour consecutive yearsHung was speaking at the Vietnam International Software Testing and Automation Conference (VISTACON) 2011which concluded in HCMC on WednesdayThe local software testing market has achieved strong growth with an annual growth rate of 17 and market valueat US$9 billion Hung said Currently Vietnam is holding a significant market share since local software firms havesecured multiple testing contracts with customers in Japan and North AmericaHarry Robinson principal software design engineer at Test Microsoft pointed out the strengths of Vietnam insoftware testing and automation and the advantages in low-cost skilful labor fast infrastructure development safeinvestment environment and low ratio of personnel changesAccording to IT experts Vietnam has to compete vigorously with India and China due to limited human resourcesIn Vietnam the average ratio of software design engineers in testing to programmers is 15 while the internationalstandard is 13Therefore Hung of LogiGear said the country needed to prove that it has the capability to undertake large projectsthat foreign customers are seeking According to the Department of Information Technology of the Ministry ofInformation and Communications the local software industry including software testing recorded an averagegrowth rate of 29 annually over the past years Last year the industry brought in over US$1 billion in revenuewith some 35 sourced from outsourcing servicesSpeaking at VISTACON Nguyen Trong Duong head of this department expected the software industry this yearwould generate the same revenue of US$1 billion as last year

httpenglishvietnamnetvnenscience-technology16313software-testing-industry-to-prosper-in-vietnamhtml

To publish your testing news write to us with your press release to editortestingcircuscom

wwwTestingCircuscom December 2011 - 44 -

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 45: software Testing Circus

wwwTestingCircuscom December 2011 - 45 -

Yogesh Gupta Genpact India Gurgaon

Show yourlove forTestingCircus

Send yourtesting

teams orindividualphoto to

us We willpublish

thephotoshere

It RocksWe LoveTesting Circus

We Love Testing Circus It Rocks

How to get your photo published1 Take printout in a paper with We love Testing Circus It rocks written on it2 Take 2-3 snaps of your team member holding the paper and send toeditortestingcircuscom with Team Name Organization and Location3 Best creative photograph published in Testing Circus will get a chance to win excitingprize (Conditions apply)

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 46: software Testing Circus

minipillar

Grady Booch

wwwTestingCircuscom December 2011 - 46 -

Testing Circus December 2011 Vol 2 - Issue 12

A fool with a toolis still a fool

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 47: software Testing Circus

Tools Journal Testing Corner

Testing Circus in exclusivepartnership with Tools Journal(h t tp too l s jour na l com)presents the Tools JournalTesting Corner

1 [Tool Watch] Top Open SourceTest Management Tools

2 [Tool Review] Load TestingMade Easy By GCLoads ProxySniffer Cloud Offering

3 [Test Opinion] Testing SkillsVs Testing Certification - TheDebate Continues

Thank You to all subscribers who have joinedus and have been giving us some goodfeedback Most of all Thank you TestingCircus for providing us a good platform toshout our views

wwwTestingCircuscom December 2011 - 47 -

About UsA start up journal and aspiring socialcommunity with an aim to gain anddistribute knowledge on softwaretools and concepts in Testing AgileCloud Mobile and EnterpriseIntegrationhttpwwwtoolsjournalcom

With over 500 products listed withquality articles product ownerinterviews we are moving swiftly tolaunch product editorialuserreivews commuity module in next 2months

Connect With Us

toolsjournal

wwwtoolsjournalcom

wwwfacebookcomtoolsjournal

Thank You

Testing Circus amp Tools Journal

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 48: software Testing Circus

The process of documenting executing and tracking test cases and tests is termed as Test ManagementA tool for Test Management enables testers and QA teams to manage manual or automated testsdesigned previously by testers or stakeholders

The top open source test management tools are as follows

Jite is a test management tool used to manage and execute tests relatedto any kind of application or device that needs to be tested verifiedand certificated before its release to the end-user It includes featureslike project management division management creating and updatingtests defining test level mapping test functions linking test to issues

filtering and searching tests test revision management creating test session executing test sessionscheduling test session reporting test session email notify etc

Mozilla Testopia is a test case management extension for bugzilla Itis a generic tool designed for tracking test cases and for allowing testingorganizations to integrate bug reporting with their test case run resultsThough it is aimed at testing software it can be used to track testingon virtually anything in the engineering process It has features like

new reports ability to set priorities on individual case-runs new clone options option to convert testopiainto a true bugzilla extension etc

qaManager is a simple web based application for managing softwarequality assurance projects teams effectively and efficiently Its featuresare tracking engineering releases tracking customer releases online

test case management manage and track resource allocations maintain resource and customer detailssimple online library consultation views for restricted users etc It is a platform independent and enablesmanaging QA projects effectively with a very easy to install procedure

QaTraq Professional is one of the leading test case management toolsIt will help you increase productivity improve visibility of your testprogress and ultimately help you improve the quality of your product

wwwTestingCircuscom December 2011 - 48 -

Top Open SourceTest

ManagementTools

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 49: software Testing Circus

releases It improves repeatability of test runs implements a test script review process creates a formalrelease mechanism creates reusable regression test script sets creates and releases multiple test scriptsin one easy step imports and exports to excel uses advanced HTML editing facilities to edit documentsand much more

Testitool is a Web-based application for QA test management andplanning It enables creation of a test plan and populates it with testcases allows for mapping of test cases to functional requirementssupports test plan instantiation generates reports on your test plans

and the SSA copies test plans and test cases from them Its features are test plan managementmanagement of individual instances of each test plan report generation and importexport to fromexcel etc

TETware is a proprietary multi-platform test framework for test suitemanagement It is the supported version of the test environmenttoolkit offering additional platform support and capabilities Itprovides a multi-platform easy-to-use and uniform testing framework

into which local remote distributed and real time test suites can be incorporated Its features areinstallation configuration binary testing result codes report generation etc It reflects a strongconviction that test developers should spend their time writing tests not designing testing frameworks

XQual Studio is a free graphical and modular test planning andmanagement application that handles the full life-cycle of QAtestingprojects from end to end It is 100 graphical provides integratedmanagement with data stored in MySQL amp is centralizedversioned

XStudio allows scheduling or running directly fully-automated or manual test campaigns

TestLink is a web-based tool for test management The applicationprovides test plans and its execution test specifications requirementsspecification reporting and collaborates with well-known bug trackersIt allows for QA teams to plan create manage execute and track testcases and organize them as test plans Its supports a remote execution

server extended requirement based report requirement revisioning new requirement and test casecomparison method expandcollapse buttons for trees print view for requirements etc

Tesly is a Web application that helps in the creation execution andreporting of test plans It is an integrated application that enables QAleaders and managers to track the progress of testing as testers use auniform interface to report completion of test cases It features are

create and edit test plans assign test plan ownership to users execute a test plan tracking the resultsetc

Radi-testdir is a light weight Test Management tool It supportsfeatures like test plan configuration updating (createedit) the testresults for the test imagebuild backup user management etc

wwwTestingCircuscom December 2011 - 49 -

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 50: software Testing Circus

Salomeacute-TMF is an independent test management tool which helpsthe tester test manager manage the entire testing process ie testscripts creation test execution test results tracking producingdocumentation and more Its features are organizing test cases define

manual tests or automatic define several environments under tests in a project parameterize manualand automatic tests track results etc

The Data Generator script is available for free under the GNU opensource license amp it lets you generate large volumes of custom data ina variety of formats for use in testing software populating databases

etc It is browser-friendly has many data types available with the option to generate data in XML ExcelHTML CSV or SQL supports country-specific data and saves your data generation forms for later use

Rth is a web-based tool designed to manage tests test results requirements and defectsthroughout the software life cycle The tool provides a structured and organized approachto testing whereby it creates a shared repository for all test assets including test cases testplans requirements and test results and thus increases improves the visibility of thetesting process

WebTst is an open-source test management tool aimed at creating andmanaging user-centric testing WebTst is a tool written in Perl anddependent on Apache WebTst does allow for a security net whiledeveloping sites WebTst provides minimal configurationinstall

requirements for people building the tests Provide an extensible and configurable infrastructure todevelopers to allow them to either use prebuilt tests or to roll their own as needed

FitNesse is a collaborative testing and documentation tool that provides a verysimple way for teams to create documents collaboratively specify tests and runthose tests FitNesse is a tool for enhancing collaboration in software developmentFitNesse is a lightweight open-source framework that makes it easy for softwareteams to collaboratively define acceptance tests run those tests and see the results

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 50 -

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 51: software Testing Circus

GCLoads load test offering allows you to use the award winning Proxy Sniffer load testing product on a PayAs You Go basis If youre only sporadically running load tests simply download the free version of Proxy Snifferand when youre ready to execute your load test simply start our Amazon EC2 virtual machines and executeyour load test from the cloud

Global Cloud Load LLC offering (LLC) allows any kind organisation to conduct loadtest against application andwebservers simulating anywhere between 100 and 20000 virtual user Prepare your loadtest offline (withoutpaying any EC2 fees) by installing Proxy Sniffer free edition and when youre ready to run your test start up oneof our EC2 AMIs and run your test As easy as this

Recording Load Test Scenarios

wwwTestingCircuscom December 2011 - 51 -

Load Testing Made Easy ByGCLoads Proxy Sniffer

Cloud Offering

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 52: software Testing Circus

With the universally useable HTTP(S) Proxy Recorder load test scenarios can be recorded using any Web Browserand can include AJAX calls and requests made from Pop-up Windows Alternatively simple test scenarios canbe created automatically with an Integrated Web Crawler which discovers all pages comprising a web site As afurther alternative test scenarios can be created manually by importing pre-defined URL calls from a Self-WrittenDefinition File

Automated Load Test Creation amp Powerful GUI

Proxy Sniffer worksquite different thanother load testingtools which are onlycapable to generatedirectly one-levelcode

On a first level therecorded raw datafrom load testscenarios is initially

retained in virtual memory where it can be extended and post-processed via a powerful and easily understoodGUI For example additional requirements such as logins from individual user accounts or the handling ofdynamically-exchanged session parameters can be efficiently implemented with a few mouse clicks

After all aspects of the load test have been defined in the GUI the load test program is automatically created ona second level in the form of performance-optimized Java code The automatically-created load test program canbe run directly from the GUI on any load generator and will not require any further manual modification Noscripting and no programming knowledge is required in order to use the Proxy Sniffer product

Web Standards and Authentication Methods Supported

Proxy Sniffer supports a wide range of Web standards This means that it is possible to achieve a near-perfectsimulation of the behaviour of natural Web users and their Web browsers without the need for using a full Webbrowser process (per user) during the execution of a load test This saves CPU time and memory on the loadgenerating systems and effects that each load generator is able to simulate hundreds or even thousands ofconcurrent Web users

bull HTTP HTTPS protocols are supports along with data access via GUI to HTML forms hyperlinks redirectsCGI parameters JSON data XML and SOAP data

bull Supports HTTP extensions including compressed response data automatic processing of HTTP(s) sessioncookies uploaddownload of files and execute load tests via outbound HTTP(S) proxy server

bull Supports SSL V2 V3 TLS along with AJAX and J2EE URL Rewriting

bull Proxy Sniffer also supports HTML BasicDigestForm based authentication along with NTLM Kerberos andSSL authentication methods

wwwTestingCircuscom December 2011 - 52 -

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 53: software Testing Circus

In-Depth Measurements

wwwTestingCircuscom December 2011 - 53 -

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 54: software Testing Circus

Proxy Sniffer measures various in-depth values during a load test For example the HTTP Keep Alive efficiencyis measured or for encrypted HTTPS requests the percentage of abbreviated SSL handshakes is measuredDetailed in-depth measurements are also collected for each HTTP(S) request - for example the time used to opena new network connection to the Web server the time to transmit the HTTP(S) request to the Web server or thetime to wait for the first byte of the Web servers response

If a response timeout occurs or when an empty Web page is returned you will see clearly if this is caused by anetwork problem (firewall rooter slow network connection) or caused by an overload of the TCPIP stack onthe Web servers operating system or because the processing time of the Web application is too slow Thus youcan determine exactly on which layer an error occurs

If that is not enough during a load test Proxy Sniffer compares the content of the received response with thecontent of the originally recorded response using a unique heuristic algorithm This feature allows the detectionof errors at the application level (malformed Web pages and stack traces on Web pages) - even when a Web pagewith a correct HTTP response code (200 ok) is returned

Collaborative Load Test Features

bull Real Time Comments Comments or notes can be entered in real-time during load test execution and will bedisplayed in the test result on all time-based diagrams

bull Scheduling of Load Tests An integrated scheduler allows you to trigger test jobs at predefined times

wwwTestingCircuscom December 2011 - 54 -

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 55: software Testing Circus

bull E-Mail and SMS Alerts during Load Test Execution E-Mail and SMS Alert Notifications can be releasedduring the execution of a load test job For example if a predefined threshold of the measured response times isexceeded or if too many errors (session failures) are measured within a configurable interval In additioninformative E-Mail and SMS notifications can also be released when a job cannot be started when a job startswhen a job crashes (internal error) and when a job has been completed

Powerful Reports Test Results Comparison

After the end of every test there are up to 24 different diagrams and statistics available at various layers fromthe most generic to the most specific From these results a complete formatted test report can be created as aPDF document supplemented with your own comments Results of different test runs can be compared to each

other allowingthe efficacy oftuning measuresto be verifiedand to visualizethe responsetime behaviourand the stabilityof the Weba p p l i c a t i o nunder differentload conditions

wwwTestingCircuscom December 2011 - 55 -

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 56: software Testing Circus

Support for Conditional Execution and Waiting LoopsAt GUI

The GUI supports to define Inner Loops which includeonly some Web pages of a recorded Web surfingsession As an example inner loops can be used duringa load test after the point where the users did login torepeat the Web pages between login and logout severaltimes before logout

Support for Conditional Execution of Web Pages

The number of iterations of an inner loop can also becontrolled by a user specific variable and the value ofsuch a variable can also be 0 (zero) that is some of theusers skip parts of the Web pages during the load testThis can be used in combination with an Input Filewhose lines contain values of zero and one which areassigned to the variable of the iterations

Support for Waiting Loops

The run-time behaviour inside of an Inner Loop canbe affected per simulated user by defining break andcontinue conditions at GUI level This functionalityallows you to test Web applications like airline ticketreservation systems at which the Web browser loopsaround the same Web page in a waiting loop until afinal response or a final HTTP status code is received

Full Support for Test Automation of Load Test Jobs

As an alternative to using the GUI up to 30 differentcommands can be entered at a terminal commandprompt or used in own-written shell scripts to startand synchronize the execution of load tests and to getthe test result data This also includes the automaticcreation of PDF reports Furthermore the IntegratedWeb Crawler can also be started from the commandline allowing you to create new test scenarios and thento run them instantly as a load test without that anymanual interaction being necessary

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 56 -

Want to Learn SoftwareTesting in Mumbai

Bangalore Gurgaon and NewDelhi

Courses offered - Manual TestingAutomation Tools Training - QTP

Weekend Classes

Talk to us -

raquo Mumbai raquo Mr Manoranjan Dubey+91-9987276298 for Manual Testing(Near Vashi Railway Station Navi Mumbai)

raquo Bangalore raquo Mr Prasad BG+91-9945563568 for Manual Testing(Sai Mandir Road Girinagar Bangalore)

raquo Gurgaon raquo Mr Sunil Godiyal+91-9990120500 for Manual Testing(New Railway Station Road Gurgaon)

raquo New Delhi raquo Mr Jaijeet Pandey+91-9911050023 for Manual and QTP course(Badarpur Near Metro Station New Delhi)

TextBookPPT less Hands on Software Testing coaching bytesters We dont have very fancy decorated class rooms butwe promise to give you best knowledge from practical andhands on training point of view And we donrsquot cost much

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 57: software Testing Circus

Every tester would have at some point come across thewell know debate on software test certification and itsimportance I have been fortunate to attend one of themeetups organised by software testing club and meetsome greats like Micheal Bolton Rob Lambert andothers One of the topics that was discussed prettyaggressively was Test Certification Debate went inlines of is Test certification required would it helpfreshers would it help people who have been in testingfor few years and so on Made a humble attempt tohighlight the discussion and some take away points thatcame across strongly from the community

Highlights of the discussion

middot 40 optional question and answers cannot assessthe quality and capability of a software tester

middot Testing is an Art NOT paper backed skill

middot Certification will not teach practicalities ofsoftware testing exploratory thinking requiredfor testing

middot Certification is a starting step for a person to getinto world of testing

middot Testing courses like BBST which induce thetesting thought process are better as comparedto certification

middot Writing articles will improve testing thoughtsfuelling imagination of a tester

The Discussion

Discussion started with views being expressed thatcertification today is commercialised rather than aimingat improving the testing skills Answering few optionalquestions in no way will enhance or highlight the abilityof a software tester While most of us I think will agreeto this there is an element of inexperienced personlooking for some kind of start and not to forget a viewthat came across that the first thing that a job seekerwill have to provide is the very Certification

wwwTestingCircuscom December 2011 - 57 -

Testing Skills Vs Testing Certification - The Debate Continues

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 58: software Testing Circus

Some interesting analogies that came out were if aperson is given a brain surgery book and asked toperform a surgery will it work This is something whichwas countered saying fresher with certificationobviously would not be placed as a sole tester for testingsecurity of a critical financial system

Generally people think software testing is the easiestcraft to do but when I started getting involved in testingI could see this is a hardest and critical bit As adeveloper or project manager I could never appreciatethe craft but putting a testing hat on recently I couldinfer the extent of exploration and imagination that isrequired to write a Test is incredible While the rest ofsoftware community have matured tools(eg codegenerators IDEs etc) to do half the work similar kindof tools for testers probably post more challenges thansolving issues (eg Test AutomationPerformance toolsmeans multiple skill sets to be tester and programmer)Will these be addressed by certification Probably not

Historically there are defined testing techniques likeBlack box White box and techniques like boundaryvalue analysis which driven the testing concepts thereby certification and courses However myunderstanding in last five years the world have movedfrom traditional testing to much more exploratory innature due to the fast pace business change Is there aneed for the certification to change in its format toencourage and assess the art and exploratorycapabilities than just few objective questions

Testing world have moved from Testing in Silos orprojects or organisations to testing in communities egweekendtesting and in general organisations havemoved from individual to being social across The bestway one can learn what I released is to write yourexperiences and explorations as much as possible andtake help of expert community to exchange views onyour write ups This came in as one of the preferred bestpractices to address this increasing trend of exploratorytesting especially when you are a newbie entering intotesting world

Summary

middot Nature of testing and challenges aroundtesting is moving from traditional theory baseto more exploratory base

middot Certification definitely adds value while it isnot a match for practical skill evolution

middot The certification has to move with the worldfrom being QampA based to exploratory skillsbase

Tools Journal

An Articleby

wwwTestingCircuscom December 2011 - 58 -

A chance to win10 books fromTesting Circus

Only for

Our registeredsubscribers

Watch out forour

announcementmail on

1st Jan 2012

Subscribe now to get achance to win

= Participate =

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 59: software Testing Circus

wwwTestingCircuscom December 2011 - 59 -

- Claire Moss

- Marc Rambert

- Pekka Marjamaumlki

- ParimalaShankaraiah

- Mohit RanjanVerma

and

Testing CircusJanuary 2012 Issue

Look who is writing for Testing Circus January issue

Submit articles for our future issues athttptestingcircuscomArticleGuidelinesaspx

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 60: software Testing Circus

To Subscribe

Click Here

Still relying onreading

Testing Circusfrom tweetsamp facebook

updatesSubscribe

just with youremail id and

get themagazine

delivered toyour email

every monthfreeTesting Circus

wwwtestingcircuscom

wwwTestingCircuscom December 2011 - 60 -

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 61: software Testing Circus

LISA CRISPIN

Lisa Crispin is the co-author with Janet Gregory of Agile Testing aPractical Guide for Testers and Agile Teams (Addison-Wesley 2009)co-author with Tip House of Extreme Testing (Addison-Wesley 2002)and a contributor to Beautiful Testing (OrsquoReilly 2009) She has workedas a tester on agile teams for the past ten years and enjoys sharing herexperiences via writing presenting teaching and participating in agiletesting communities around the world Lisa was named one of the 13Women of Influence in testing by Software Test amp Performancemagazine For more about Lisarsquos work visit wwwlisacrispincomlisacrispin on Twitter gplustolisacrispin on Google+

Organisation ndash ePlan Services Inc a Paychex CompanyRoleDesignation ndash TesterLocation ndash Denver CO USA

Interview with Testers

wwwTestingCircuscom December 2011 - 61 -

1 How long have you been associated with softwaretestingI started my first programming job in 1982 andswitched to testing in about 1993

2 How did you become a software testerI worked in tech support for a software companystarting in 1986 Nobody at that company (whichwhen I started there was larger than Microsoft) evenheard of testing We tech support folks had the ideathat if we tried out new releases as soon as we gotthem then when customers called in with problemsat least we could say ldquoOh yes we know about thatproblem and wersquore working on a patchrdquo Themanagers realized it was possible to find problemsbefore the customers did so they formed a testingdepartment I jumped right in

3 By any means do you regret being associated withsoftware testingNo it has always been an honor to me Irsquove alwaysenjoyed good relationships with everyone on thesoftware development team We are workingtowards a common goal ndash delighting the customers

4 Do you think software testing is less respectedthan other disciplines within software developmentor professions such as accountancyUnfortunately many companies and manymanagers donrsquot understand testing So they may hirepeople who call themselves testers but who reallydonrsquot want to ever get outside their comfort zoneand learn something new They simply executemanual regression test scripts and wait for code tocome ldquoover the wallrdquo to them These people givetesting a bad name

5 What will you suggest to people who want to joinIT industry as software testersRealize that testing isnrsquot a separate phase (to borrowa phrase from Elisabeth Hendrickson) We must findways to communicate better with programmers andcollaborate with them with the businessstakeholders with other roles in softwaredevelopment to deliver a high quality product

6 You strongly believe that team approach is thebest approach in finding solution within agiledevelopment Why do you think so Are therealternatives to this philosophy or approach

Interviewed by Mohinder Khosla

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 62: software Testing Circus

wwwTestingCircuscom December 2011 - 62 -

Thatrsquos right in my experience the ldquowhole-teamapproachrdquo to quality works the best Everyoneinvolved with delivering software wants to pleasethe customers When we work together with thiscommon goal we have the best chance ofsucceeding For example if we begin by thinkingabout tests and how we will automate them theprogrammers will find ways to design the code tomake automating tests easy

7 People normally say that agile team should be selforganising What benefits do you see with thisapproachSoftware teams must be free to find the bestimplementations of the features the stakeholderrsquosdesire These implementations must be testable Self-organizing teams can experiment look at the resultsof those experiments and adapt accordingly Theteams Irsquove worked on have been able to try thingsthat we thought might not even work because wewere committed to delivering high-quality softwareWe need to make the commitment and then weneed to make the commitment really meaningful

8 Some people criticise that automation isoveremphasized within agile development Do youbelieve these are unfair criticisms and automation isa key to the success of a projectWhen I started working on XP teams in 2000 I saw alot of emphasis on unit test automation If therehadnrsquot been a rule that we needed to automate 100of our regression tests the testers would have beenout in the cold without help in automatingfunctional and other types of testing I personallyhave not seen any situations where automation wasover-emphasized Automating regression tests freesour time for the important exploratory testing

9 With the large scale adoption of agiledevelopment coder is churning code at fast speed

that they are no more bottlenecks in the productdelivery cycle Continuous integration helpsbusiness meet their timescale in majority of cases Itis believed that ops are now the bottleneck in thedelivery chain This has resulted in the introductionof DevOps which is picking up pace Is this just hypeor a reality Have you seen such trends during yourwork and would this speedup the continuousdelivery in real termsIrsquom not that knowledgeable about DevOps andcontinuous delivery though I have read Jez Humbleand David Farleyrsquos excellent book I think the needfor continuous delivery depends on the businessdomain My company produces financial servicesapplications Wersquore capable of delivering toproduction every day or continuously but ourbusiness people do not generally see a need fordelivering new features more often than every twoweeks However we have put a lot of effort into ourcontinuous integration running thousands of testsall day every day to make sure we have a releasablebuild on hand at all times

In my opinion your feedback loop canrsquot be too shortWe work to keep our JUnit suite running in undereight minutes and have feedback from tests at alllevels within 45 minutes of any check in Wersquod likethat feedback to be even faster This helps us stay oncourse and allows us to spend our time addingvalue not stopping to fix regression bugs Eightyears ago we were happy to have a stable build bythe end of the iteration Now we expect to have oneat all times It will be interesting to see what the nextstep is

10 Recently we had a discussion on the role oftesters in the next five year and it was unanimouslyaccepted that testers in future may be called TestMaster like Scrum Master or Test Assurance Expert

LISA CRISPIN

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 63: software Testing Circus

wwwTestingCircuscom December 2011 - 63 -

LISA CRISPIN

How do you see the role of a tester changing in theforeseeable futureThatrsquos interesting Itrsquos hard for me to judge how thetester role might change because Irsquom accustomed tothe tester role on my own team The programmerson my team do lots of testing They look to thetesters for expertise in eliciting examples of desiredand undesired behaviors from customers forexpertise in how to turn those into automatedfunctional tests that drive development and forexpertise in manual exploratory testing I donrsquot seethat role changing

11 In the same discussion it was agreed that thereare four types of testers traditional agile CDT andsecurity and they all require different skill sets tofunction Do you think there are common skills thata middle-of-the-road tester can acquire to cover abroader area of testingPersonally I see more areas of specialization thanthat For example I know testers who are specialistsin performance or reliability testing I think anytester should hone their thinking skills learn how toapply critical thinking to testing learn how tocollaborate with other roles on the team with thegoal of delivering the best quality product I thinkthe key is that every tester should be working onimproving skills that apply within her ownparticular context Everyone should be gettingoutside her comfort zone

12 Where do you see Software Testing heading inthe next five yearsIrsquom not really a visionary I hope software testing isheading towards being an integral part of softwaredevelopment not a separate phase or activity

13 What qualities would you look for in a candidatewhen you want to recruit someone for softwaretesting job

As Kay Johansen said to me several years agoattitude and mindset are everything I feel it isnrsquothard to teach technical skills But you canrsquot teachattitude and mindset I look for someone who ispassionate about software quality and willing towork as part of a whole team to make that happenThe technical skills are just details

14 What do you do when you are not workingI have too many interests I train with horses indressage I work with my miniature donkeys I readextensively I garden I love opera and theatre I loveto hike I have many pets I love travel I do lots offamily activities

15 Complete this sentence ldquoI use twitter because ndashldquoI use twitter because it connects me with asupportive community and helps me improve myskills every day

16 Last question ndash Do you read Testing Circus Ifyes what is your opinion about this magazineTesting Circus gives me insights from practitionersthat inspire my team to try new experiments

BlogSite ndash httplisacrispincomwordpressTwitter URL ndash twittercomlisacrispin

Watch out for this

section in our

January Issue

Read in our January

issue

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team
Page 64: software Testing Circus

Founder amp Editor-in-Chief ndash Ajoy Kumar SinghaAssistant Editors -

Brian Osman (WellingtonNew Zealand)Ashik Elahi (DhakaBangladesh)Ajay Sharma (New DelhiIndia)Gagan Talwar (MumbaiIndia)Asif Iquebal Sarkar (BhubaneswarIndia)

Core Team ndash Jaijeet Pandey Naresh Bisht Kumar Gaurav Sunil Godiyal

Publicity Team ndash Maheepati Tyagi Amit Agnihotri Anuj Batta

Online Collaboration amp Advertisement ndash Bharati Singha

Technical Team ndash Debasish Nath Nasim Ahmed Rajat Verma

Volume 2 - Issue 12 ndash December 2011The contents published in this magazine are copyright material of respective authors Testing Circus does not hold any right on thematerial To republish any part of the magazine permission need to be obtained from respective authors

Testing Circus Published from New DelhiIndia copy Copyright 2010-2011

Testing Circus Team

wwwTestingCircuscom December 2011 - 64 -

  • 00 - Coverpage11
  • 01 - Moolya Ad Style 3
  • 02 - Editorial Page
  • 03 - Table of Content
  • 04 - Letter to the editor
  • 05 - Article1
  • 06 - Social Message 1
  • 07 - Article 5
  • 08a - Book Worm
  • 09 - Puzzle
  • 10 - Twitter
  • 11 - Article 2
  • 14 - Short Article 2
  • 15 - Rob Van
  • 17 - Ads Page
  • 18 - Test Events
  • 20 - OnALighterNote
  • 21 - Fake tester
  • 22 - Article 3
  • 23 - Article submission
  • 24 - Facebook Page
  • 24a - QTP code Corner
  • 25 - Testing News
  • 26 - We love Testing Circus
  • 27 - quote
  • 29a - ToolsJournal 0
  • 29b - ToolsJournal 11
  • 29c - ToolsJournal 22
  • 29d - ToolsJournal 33
  • 30 - Next Issue
  • 31 - Subscribe page
  • 33 - Interview
  • 40 - Team