a conversion from oracle to netezza from - sas · pdf filea conversion from oracle to netezza...
TRANSCRIPT
![Page 1: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/1.jpg)
A Conversion from Oracle to Netezza From
the Perspective of the Company’s SAS Users June 19, 2015
![Page 2: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/2.jpg)
Andrew T. KuligowskiManager – CRM
Infrastructure & Reporting
![Page 3: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/3.jpg)
Introduction
![Page 4: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/4.jpg)
Introduction
• Introduction
• What needs to be changed?
– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
• Process improvements
– Comparing run times – Oracle vs. Netezza
![Page 5: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/5.jpg)
Introduction
• Process improvements (continued)
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
• Conclusion
![Page 6: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/6.jpg)
• What needs to be changed?
![Page 7: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/7.jpg)
What needs to be changed?
• What needs to be changed?
– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand
![Page 8: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/8.jpg)
What needs to be changed?
• What needs to be changed?
– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand
![Page 9: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/9.jpg)
What needs to be changed?
• What needs to be changed?
– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand
![Page 10: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/10.jpg)
What needs to be changed?
• What needs to be changed?
– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand
120+ Production Routines
80 in regular use
NOTE: DO NOT WORRY ABOUT THE OTHERS
NOTE: IN FACT, KILL THE ONES YOU CAN GET AWAY WITH KILLING!!
64 perform one or more database queries. NOTE: We can ignore the others.
39 use “the main query” – further analysis needed.
![Page 11: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/11.jpg)
Implement the changes
![Page 12: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/12.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 13: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/13.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 14: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/14.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 15: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/15.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 16: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/16.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 17: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/17.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 18: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/18.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 19: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/19.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 20: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/20.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 21: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/21.jpg)
Implement the changes
• Implement the changes
– Macro vs. Hard-coding
– Tracking progress
![Page 22: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/22.jpg)
Process improvements
![Page 23: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/23.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
![Page 24: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/24.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
![Page 25: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/25.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
– Comparing run times – Oracle vs. Netezza
![Page 26: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/26.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–
• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!
![Page 27: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/27.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–
• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!
![Page 28: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/28.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–
• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!
![Page 29: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/29.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–
• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!
![Page 30: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/30.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–
• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!
• Useful Options
– BL_USE_PIPE=YES (default for Netezza) or NO (default for Oracle)Use a named pipe to transfer data between Netezza and SAS/Access
– BULKUNLOAD=YES or NO (default)Calls the Netezza Remote External Table Interface[There is a parallel BULKLOAD option.]
SO WHY DIDN’T THEY WORK – AND, IN FACT, MADE THINGS MUCH WORSE??
![Page 31: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/31.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–
• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!
• Useful Options
– BL_USE_PIPE=YES (default for Netezza) or NO (default for Oracle)Use a named pipe to transfer data between Netezza and SAS/Access
– BULKUNLOAD=YES or NO (default)Calls the Netezza Remote External Table Interface[There is a parallel BULKLOAD option.]
SO WHY DIDN’T THEY WORK – AND, IN FACT, MADE THINGS MUCH WORSE??
![Page 32: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/32.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–
• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!
• Useful Options
– BL_USE_PIPE=YES (default for Netezza) or NO (default for Oracle)Use a named pipe to transfer data between Netezza and SAS/Access
– BULKUNLOAD=YES or NO (default)Calls the Netezza Remote External Table Interface[There is a parallel BULKLOAD option.]
SO WHY DIDN’T THEY WORK – AND, IN FACT, MADE THINGS MUCH WORSE??
Netezza SAS
![Page 33: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/33.jpg)
Process improvements
• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–
• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually going on and try to resolve it!!
libname temp netezza database=&Ntzdb. user=&user. password=&password. server=&server. direct_sql=yes BULKUNLOAD=YES connection=global dbcommit=0 dbmstemp=yes;
Netezza SAS
![Page 34: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/34.jpg)
Conclusion
![Page 35: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/35.jpg)
Conclusion
• Have a plan … Follow your plan … be prepared … yada, yada, yada …
• “Transparent to the user” usually translates to “BOHICA”
• Improvements still Work in Progress
![Page 36: A Conversion from Oracle to Netezza From - SAS · PDF fileA Conversion from Oracle to Netezza From the Perspective of the Company’s SAS Users June 19, 2015. ... server=&server. direct_sql=yes](https://reader034.vdocuments.net/reader034/viewer/2022051523/5a731f467f8b9abb538e57ed/html5/thumbnails/36.jpg)