firebird.performance.testing
DESCRIPTION
TRANSCRIPT
Basic considerations
● Learn the used test in details. Make sure you understand its goal. Figure out what is actually being tested.
● Pay attention to the hardware and software setup. Avoid exotic configurations.
● Take caching effects and differencies among runs into account. Remove extreme values from the results or comment them appropriately.
● Don't compare apples to oranges.
Firebird settings
● Architecture: Classic or SuperServer.● Database page size.● Page cache size. Remember about the
filesystem cache.● Sort buffer size. It differs between CS and SS.● Lock table settings: LockMemSize,
LockHashSlots.● Forced writes setting.● Garbage collection policy.
Testing analytic queries
● Single user● Involves optimizer decisions
and raw execution efficiency● Hardware: Intel Core2 2.4GHz Quad, 4GB
RAM, SATA2 HDD 7200rpm● Firebird settings: Classic Server, 256 buffer
pages● Results are in seconds, the less the better
Total time spent
10
500
1000
1500
2000
2500
FB 2.1FB 2.5
FB 2.1 : 2052 sFB 2.5 : 271 s
Time distribution among tests
1 2 3 4 5 6 7 8 9 10 11 12 13 14 150
200
400
600
800
1000
1200
1400
1600
1800
2000
FB 2.1FB 2.5
FB cache vs OS cache
● Database is 1.5GB● 1.5GB of Firebird page cache and disabled OS
filesystem cache● 1MB of Firebird page cache and enabled OS
filesystem cache● Results are in seconds, the less the better
Total time spent
10
100
200
300
400
500
600
700
800
FB cacheOS cache
FB cache : 709 sOS cache : 271 s
Time distribution among tests
1 2 3 4 5 6 7 8 9 10 11 12 13 14 150
50
100
150
200
250
300
350
400
FB cacheOS cache
Load speed test
● 4 concurrent users● Database sizes: 9Gb and 22Gb● Hardware: Intel Core2 2.4GHz Quad, 4GB
RAM, SATA2 HDD 7200rpm● Firebird settings: Classic vs SuperClassic,
256 buffer pages● Firebird versions: 2.1 Classic, 2.5 SuperClassic● Results are seconds, the less the better
Classic vs SuperClassic Load
Database 9Gb loading:
2.1 CS : 1759 sec2.5 CS : 1130 sec
2.5 SC: 1302 sec
2.1 Classic 2.5 Classic 2.5 SuperClassic0
200
400
600
800
1000
1200
1400
1600
1800
2000
Database 22Gb loading:
2.1 CS : 4290 sec2.5 CS : 3971 sec
2.5 SC: 3328 sec
2.1 Classic 2.5 Classic 2.5 SuperCalssic0
500
1000
1500
2000
2500
3000
3500
4000
4500
5000
Testing concurrency
● Many concurrent users● Involves raw execution efficiency
as well as overall scalability● Hardware: Intel Core2 2.4GHz, 4GB RAM,
SATA2 HDD 7200rpm● Firebird settings: Classic vs SuperClassic,
256 buffer pages● Results are in completed transactions per
minute, the more the better
Classic vs SuperClassic
100 users 250 users0
50
100
150
200
250
300
350
CSSC
100 users:
CS : 282 tpmSC : 313 tpm
250 users:
CS : 159 tpmSC : 181 tpm
