oracle on z/os performance management at saskatchewan ... · in the prime agricultural growing...

34
1 Oracle on z/OS Performance Management at Saskatchewan Wheat Pool Brian Bell

Upload: others

Post on 13-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

1

Oracle on z/OS

Performance Management

at

Saskatchewan Wheat Pool

Brian Bell

Page 2: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

2Saskatchewan Wheat Pool

• Sask - a - What ?

• What is a “Wheat Pool”?

Page 3: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

3

Page 4: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

4• 251,366 sq. miles (Texas is

261,797 sq. miles)

• North 135,135 sq miles of forest,lakes

• 30% of world uranium production

• 2/3 of world reserves of potash(fertilizer input)

• Also rich in oil, natural gas andcoal

• South is mainly farmland

• Extreme climate

– Ave July max (27C / 80F)

– Ave Jan min (-21C / -6F)

• Capital is Regina

Page 5: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

5

Page 6: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

6

Page 7: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

April 2007

Page 8: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

8What’s a Wheat Pool

• Grew out of a farmers’ co-operative movementin the 1920s

– trying to get a fair price for crops by “pooling”wheat

• Each of the prairie provinces had their own“Pool”

• Market forces have led to many changesincluding Sask Wheat Pool becoming publiclytraded company in recent years

Page 9: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

9Business Activities

• Grain Handling and Marketing

– 42 high throughput terminals and six specialty cropcleaning and handling facilities strategically locatedin the prime agricultural growing regions of WesternCanada.

– two wholly owned port terminal facilities located inVancouver, BC and Thunder Bay, Ont and anownership interest in an export facility in PrinceRupert, BC.

Page 10: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

10Business Activities

• Agri-products

– includes an ownership interest in a fertilizermanufacturer / distributor and a retail network of100 retail locations throughout Western Canada.

– Agri-product sales lines include fertilizer, cropprotection products, seed and seed treatments, andequipment.

Page 11: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

11Business Activities

• Agri-food Processing

– the manufacture and marketing of valued-addedproducts associated with oats and malt barley.

– Wholly owned subsidiary Can-Oat Milling maintainsplants in Portage la Prairie, Man, Martensville, Sask.and Barrhead, Alberta, with the majority of itsproducts exported.

– At its plant located in Biggar, Saskatchewan,affiliate Prairie Malt Limited processes malt barleyinto malt for domestic and export markets.

Page 12: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

12The Pool’s Integrated Pipeline

Destination customers access Canadian grains and oi lseeds through the Pool’s integrated supply chain distribu tion model

Prince RupertPrince Rupert

VancouverVancouver

Thunder BayThunder Bay

21% of total port capacity234,000mmt

24% ownership 210,000mmt

26% of total port capacity7A – 233,000 tonne capacity7B – 130,000 tonne capacity

Alberta (13%)Alberta (13%)

Saskatchewan (35%)Saskatchewan (35%)

Manitoba (10%)Manitoba (10%)

5 Grain: 182,000mmt5 Retails

34 Grain: 867,000mmt 6 Specialty plants 90 Retails

3 Grain: 104,000mmt5 Retails

Western Canada Market Share 2005 (estimated)

Pool 23%

AU 34%Other 17%

Cargill 9%

JRI 12%

Page 13: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

13The Grain Pipeline

Grain is cleaned andunloaded at port and loadedonto vessels

Grain is cleaned andunloaded at port and loadedonto vessels

Margins are earned oncleaning/drying/blending/elevating/storing grain

Margins are earned oncleaning/drying/blending/elevating/storing grain

Railways pay incentives formoving grain in efficient multi-car units

Railways pay incentives formoving grain in efficient multi-car units

Grains and oilseeds are soldto international traders andfood processing companies

Grains and oilseeds are soldto international traders andfood processing companies

The Pool buys grainsand oilseeds fromfarmers & pays a marketprice less fees forservice

CWB sets market pricefor wheat & barley. Forcanola, oats, peas andothers, the Pool paysopen market price

The Pool receives amargin for elevating,cleaning, storing, &transporting services

Incremental margin canbe gained throughadditional storage fees,rail incentives andblending efficiencies

Typical shipments - 60%CWB - 40% non-Brd

Gross margin istypically $20-$22/tonne

Page 14: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

14The Agri-products Pipeline

The Pool also sellsherbicides, insecticides, etc.& manufactures ( WCFL) &sells fertilizer

The Pool also sellsherbicides, insecticides, etc.& manufactures ( WCFL) &sells fertilizer

The Pool operates a R&D labfor plant breeding and varietydevelopment

The Pool operates a R&D labfor plant breeding and varietydevelopment

The Pool sells proprietary(57%) & non-proprietaryseeds (43%) primarily canola

The Pool sells proprietary(57%) & non-proprietaryseeds (43%) primarily canola

Storage equipment is alsosold through prairie retaillocations – primarily bins andaugers

Storage equipment is alsosold through prairie retaillocations – primarily bins andaugers

The Pool sells a widevariety of crop inputs tofarm customers throughretail locations

The Pool providesagronomic services andthird party financing tosupport farmers’ cashflow through thegrowing season

Approximately 75% ofseed, fertilizer andcrop protectionproducts are sold anddelivered from mid-April to the end ofJune – a 4 th quarterbusiness

CPP & Fertilizeraccount for 80% ofsales

Industry supports grossmargins in the range of15% annually at theretail level

Page 15: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

15Spring Peak is Critical

• 75% of Agriproducts sales come in 2 monthperiod

– 2006 - first full season on new application writtenby external company (longer turn-around for tuningchanges; some not-so-good practices)

– Agri-products workload goes from 10% of workloadto 50% - 60% of workload for an intense 2-3 weekperiod

– $300 million in revenue during spring peak - thisapplication gets A LOT of attention

Page 16: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

16

Agrosoft

0

5000

10000

15000

20000

25000

30000

35000

8/1/

2005

8/15

/200

5

8/29

/200

5

9/12

/200

5

9/26

/200

5

10/1

0/20

05

10/2

4/20

05

11/7

/200

5

11/2

1/20

05

12/5

/200

5

12/1

9/20

05

1/2/

2006

1/16

/200

6

1/30

/200

6

2/13

/200

6

2/27

/200

6

3/13

/200

6

3/27

/200

6

4/10

/200

6

4/24

/200

6

5/8/

2006

5/22

/200

6

6/5/

2006

6/19

/200

6

7/3/

2006

7/17

/200

6

7/31

/200

6

8/14

/200

6

8/28

/200

6

9/11

/200

6

9/25

/200

6

10/9

/200

6

10/2

3/20

06

11/6

/200

6

11/2

0/20

06

12/4

/200

6

12/1

8/20

06

1/1/

2007

1/15

/200

7

1/29

/200

7

2/12

/200

7

2/26

/200

7

Page 17: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

17MVSO LPAR

• Oracle Only LPAR (z/OS.e 1.7)

• 3 Production Databases

– OPRD - Mostly Grain Apps

– GPRD - Agri-products - spring peak critical

– TOLP - tools database

– 2 Reporting Databases (copies of OPRD & GPRD)

– 8 Test Databases

Page 18: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

18Workload Manager

• All Databases Run in Enclave(Call) mode

– The key to managing Oracle workloads

– See Tom Russell’s presentation from last year

• Service Classes

– Prod Databases - higher priority - better responsetime targets - play with durations

– Test & Reporting Databases - lower priority - poorerresponse time targets

Page 19: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

19

Page 20: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

20Workload Manager

• Resource Groups

– All databases assigned to Resource Groups

– Test Databases have a Service Unit Cap

– Don’t get hit badly by a misbehaving Test database

– Caps can easily be raised in special situations

– Occasional grumpy developer during spring peak

Page 21: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

21

Page 22: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

22

Page 23: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

23Changes for 2007

• Improvements to Agri-products Application

– tuning changes based on last year

– Cursor Sharing - turned on "Cursor Sharing", that forces Oracleto rewrite each SQL to utilize bind variables before it runs it.

– Session Cached Cursors - turned on a feature that would allowusers to cache cursor information at the user level. Thisresulted in a reduction on shared pool contention on thedatabase

– App allows us to use “style sheets” so we can tune their SQLourselves.

Page 24: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

24Changes for 2007

• On-Off Capacity on Demand

– Pre-arranged capacity upgrade

– add 20% capacity on-the-fly

– very short notice

– ordered via IBM web site (Resource Link)

– priced / day

– Only needed for a few days per

Page 25: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

25Use of Oracle SMF Records

• SMF Reports produced daily for each Database

• Application Changes must be tested forperformance

– developers compare resource utilization oftransactions before and after changes

– any significant change is investigated for possibletuning

Page 26: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

26Use of Oracle SMF Records

• I have modified the default report

– report the full 30-character Oracle User Id

– report start date & time and end date & time

– these are useful in later processing

– report the IP address of the user when TCP/IPconnection is found (can be useful)

Page 27: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

27

SERV SMFAUTH SMFCONN ORACLE ID DATE TIME CPU SECONDS LOG READS LOG WRITES DMC DMR PHY READS HI STG K DATE TIME

OPRD 192.168.236.1 TCP/IP NAMEADDR_INTF_ 07.090 00:00:17.63 .075880 93 25 2 0 0 1385 K 07.090 00:00:18.47OPRD 198.169.206.162 TCP/IP DBMON 07.090 00:02:02.62 .025309 59 4 0 0 1 909 K 07.090 00:02:02.93OPRD 198.169.206.162 TCP/IP DBMON 07.090 00:02:03.16 1.551091 59076 4 0 0 8459 4865 K 07.090 00:02:08.60OPRD 192.168.236.1 TCP/IP NAMEADDR_INTF_ 07.090 00:00:17.63 .075880 93 25 2 0 0 1385 K 07.090 00:00:18.47OPRD 198.169.206.162 TCP/IP DBMON 07.090 00:02:02.62 .025309 59 4 0 0 1 909 K 07.090 00:02:02.93OPRD 198.169.206.162 TCP/IP DBMON 07.090 00:02:03.16 1.551091 59076 4 0 0 8459 4865 K 07.090 00:02:08.60OPRD 192.168.236.1 TCP/IP NAMEADDR_INTF_ 07.090 00:00:17.63 .075880 93 25 2 0 0 1385 K 07.090 00:00:18.47OPRD 198.169.206.162 TCP/IP DBMON 07.090 00:02:02.62 .025309 59 4 0 0 1 909 K 07.090 00:02:02.93OPRD 198.169.206.162 TCP/IP DBMON 07.090 00:02:03.16 1.551091 59076 4 0 0 8459 4865 K 07.090 00:02:08.60OPRD 192.168.236.1 TCP/IP NAMEADDR_INTF_ 07.090 00:00:17.63 .075880 93 25 2 0 0 1385 K 07.090 00:00:18.47OPRD 198.169.206.162 TCP/IP DBMON 07.090 00:02:02.62 .025309 59 4 0 0 1 909 K 07.090 00:02:02.93OPRD 198.169.206.162 TCP/IP DBMON 07.090 00:02:03.16 1.551091 59076 4 0 0 8459 4865 K 07.090 00:02:08.60

Use of Oracle SMF Records

Page 28: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

28Capacity Planning

• All In-house built apps track the applicationname at logon time in the Client Info columnof v$session

• Daily - this information is matched up with thecorresponding SMF record for that session

– we have the User Name, Application and resourcesused during a specific time period

• The starting and ending date & time are usedto assign resources used on an hourly basis

• Information is stored in a Database

Page 29: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

29Capacity Planning

Page 30: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

30Capacity Planning

• Additional Info is tracked for Agri-products App

– This information is stored in a "Star" schema in the InformationWarehouse allowing us to complete multidimensional analysis. Weare currently tracking the following hourly:

• # Users

• # Of invoices

• # Of products invoiced

• $ Amount of invoices

• # Of prepays

• $ Amount of prepays

• # Of Payment

• $ Amount of payments

Page 31: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

31

Page 32: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

32Capacity Planning

• Benefits

– Allows us to relate capacity requirements tobusiness activity

Page 33: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

33Future Developments

• Feed to a Web-based Graphics Package

– Provide graphical presentation of data

– Drill down capability

• Take advantage of ZIIP processors for Oracleworkloads

Page 34: Oracle on z/OS Performance Management at Saskatchewan ... · in the prime agricultural growing regions of Western Canada. ... – This information is stored in a "Star" schema in

34Questions

• For more information

[email protected]

[email protected]