running realistic load tests: answers to the most important questions - yours!
DESCRIPTION
Hear two software industry veterans as they discuss the answers to the load testing you asked. Get a better understanding of how to make your load tests more realistic. In this webinar, Lino Tadros, CEO of Falafel Software and Sergei Sokolov, Director of Testing and Performance Products at SmartBear Software team up to lead a dynamic discussion about load testing.TRANSCRIPT
![Page 1: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/1.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
Running Realistic Load Tests
Lino Tadros, MVPSergei Sokolov
![Page 2: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/2.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
Sergei Sokolov
Sergei Sokolov is a Director of Product Management for Test and Performance tools at SmartBear Software. In his more than fifteen years in the software industry, Sergei has held positions in every part of the software lifecycle, from QA to engineering and engineering management, to professional services, pre-sales, and product management. His passion in software is to achieve high quality with the least effort.
![Page 3: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/3.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
Lino Tadros, MVP
Microsoft C# MVP for nine years Chairman & CEO – Falafel Software Former member of the Delphi & C++ development team at
Borland. Microsoft established Technical Speaker worldwide (42
countries) in the last 18 years. Architect of major projects for Morgan Stanley, Johnson &
Johnson, Bank of America, Wells Fargo, State of CA, Shell, Chevron and others…
Permanent member of the VSX team at Microsoft. Expert on Web technologies, HTML5, MVC, WCF, Silverlight,
WPF, ASP.NET, SQL databases, Telerik Products and Testing tools.
![Page 4: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/4.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
The Goal of Today’s Webinar
Answer YOUR questions about Load Testing Give a realistic explanation of Load Testing Explain the difference between Performance and
Scalability Why should we measure? What should we measure? What tools are involved in measuring
Performance and scalability?
![Page 5: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/5.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
Web Application Performance
It is about RESPONSIVENESS, THROUGHPUT and RESOURCE utilization under a given workload.
Responsiveness is measured based on a SINGLE Client
Throughput and Resource utilization are measured in terms of the whole systems (All Clients)
Apples to Apples comparision for performance based on workload.
![Page 6: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/6.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
Web Application Scalability
The ability to handle additional workload WITHOUT negatively affecting performance By adding processor power, memory, storage
(hardware) Scalability comes AFTER the Performance has
been measured and FIXED. The Goal is LINEAR, the more resources the
farther the workload will go.
![Page 7: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/7.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
Performance Vs. Scalibility
![Page 8: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/8.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
Benefits of Measuring Assess production readiness
Predict resource requirements Determine capacity of current infrastructure Compare different system configurations Verify application meets desired performance requirements within resource
constraints Assess adequacy of Software
Determine performance impact of specific software changes Compare current and desired performance characteristics
Improve efficiency of performance tuning Analyze application behavior at various load levels Identify bottlenecks Provide information on application speed and scalability prior to release
![Page 9: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/9.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
What To Measure For Performance?
Time To First Byte (TTFB)Total Page Response Time (TTLB)
or as we say: “Time To Last Byte”
![Page 10: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/10.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
What To Measure For LOAD Testing?
User LoadRequest / SecErrors/Sec
![Page 11: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/11.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
What To Measure For Resource Testing?
CPUMemoryDisk / Network
![Page 12: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/12.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
Kind of Tests
Performance Test Determine and validate speed of application
Load Test How an application performs while load increases
Stress Test What happens to the application if pushed beyond
normal conditions.
![Page 13: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/13.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
More Test Variants
Smoke TestCapacity TestEndurance Test
![Page 14: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/14.jpg)
Copyright © 2003 – 2011 Falafel Software Inc.
Testing Tools FireBug and YSlow Chrome Speed Tracer IE9 Developer Tools LoadRunner PerfMon LoadComplete from SmartBear Many others…
![Page 15: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/15.jpg)
Copyright © 2003 - 2011 Falafel Software Inc.
Answers to Your Questions
![Page 16: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/16.jpg)
Copyright © 2003 - 2011 Falafel Software Inc.
Answers to Your Questions
![Page 17: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!](https://reader033.vdocuments.net/reader033/viewer/2022061120/54670e09af7959c6768b57c7/html5/thumbnails/17.jpg)
Copyright © 2003 - 2011 Falafel Software Inc.
You can start today!
Download your FREE trial today with 50 Virtual Usershttp://smartbear.com/products/qa-tools/load-testing/
Schedule your training and/or consulting session today!https://www.falafel.com/store/trainingstore/loadcomplete.aspx
THANK YOU!