datamining wilm 09/19 - wordpress.com
TRANSCRIPT
WILM Report Strategy
WILM – Reporting Strategy
PeopleSoft – lost many or all reports from legacy
Report Strategy -The strategy for WILM reporting is to develop and deploy queries and reports in a timely manner that meets the needs of all the WILM users.
WILM – Reporting Strategy
Active Supportive
High Usage
Low Usage
Categories of Managed DataCategories of Managed Data
Real-Time Operations
Data Reported through Query
Data Repositories
REPORTING
Data Warehouse
* *
Recovery & Active Archiving
Data Recovered from Microfiche
Data Mining
Data Mining (Automotion of
patterms, trends, etc.)
WILM – Reporting Strategy
Peoplesoft
Live Data
RDS SA/HR
Last Nights Data
Data Warehouse
Historical
Data
WILM Database Infrastructure
Peoplesoft Data Base Peoplesoft RDS Data Base WILM Data Warehouse Data Warehouse Actual “Live” Data Data replaced Nightly extract Historical Data Cubes 1,000’s of data fields 4,000+ data elements from 600+ Tables
COGNOS Decision Stream
Extraction
COGNOS Decision Stream
Extraction Tool
Data Warehouse
Cube
Date Warehouse
Cube
WILM – Reporting Strategy
RDS – Reporting Database Service
“Free the Data!!”
• RDS• SA/HR
• Last Nights Data
WILM – Reporting Strategy
Decisions Information
Operation
Strategic
Unscheduled Summarized Infrequent Wide Scope
Prespecified Scheduled Detailed Frequent Internal Narrow Focus
Information Characteristics Decision
Structure
Unstructured
Structured
Management
Operational
Strategic
WILM – Reporting StrategyT ra n sa c tio n R e po rtin g :
P S /Q u e ry
se cu re , fa s t, e a sy , a d -h o c a cce ss to p rod u c t io n d a ta‘re su lt se t ’ p a ssed to re p o rt in g to o ls
WILM – Reporting Strategy
T ra n sa c t io n R e p o rt in g : C ry s ta l R ep o rts
F a s t a n d e a sy
R e p o rts , lis ts , la b e ls ,c ro s s ta b s , m a il-m e rg e
E x te n s iv e ca lcu la t io n s
S o rt in g /g ro u p in g
T o ta ls a n d su b to ta ls
E -m a il, W e b
WILM – Reporting Strategy
S o … W h a t ’s T h e Is su e ?
Q u e ry a n d C ry s ta l a re e x ce lle n t to o ls
S o … w h y is re p o r t in g s lo w a n d co m p le x ?
D a ta S tru c tu re s !d e s ig n e d fo r tra n sa c t io n s - - n o t re p o rt in g d a ta b a se s a re n o rm a lize d re p o rt in g to o ls w o rk w e ll w ith fe w ta b le sre p o rt in g fro m m an y ta b le s is co m p le x a n d s lo w
E xa m p le … a C la s s L is t R e p o rt
WILM – Reporting Strategy
D a ta S tru c tu re C h a lle n g e : T h e C la ss L is t R ep o rt
w h a t d a ta d o y o u w a n t?
c la s s d a ta , m e e tin g t im e s , in s tru c to r, b u ild in g , s tu d e n t, c a re e r, m a jo r, ...
lo ca te th e ta b le s th a t co n ta in th o se d a ta ite m s
se le c t d e s ire d d a ta f ie ld s
WILM – Reporting Strategy
D a ta S tru c tu re C h a lle n g e : T h e C la ss L is t R ep o rt
m a n y f ie ld s a re co d e s
d e sc r ip t io n s in X LA T s , E d it T a b le s
th e se a re “E ffe c t iv e D a te d ”
q u e r ie s n e e d JO IN s a n d E ffe c t iv e D a te lo g ic
WILM – Reporting Strategy
D a ta S tru c tu re C h a lle n g e : T h e C la s s L is t R e p o rt
H o w m a n y JO IN s?
Y o u w a n t m o red a ta o n th is re p o r t?
se s s io n , m e e t in g t im e s ?
WILM – Reporting Strategy
D a ta S tru c tu re C h a lle n ge : T h e C la ss L is t R ep o rt
m o re d a te = m o re ta b le s
s t ill m o re d a ta n ee d ed ?
ro o m n u m b e r, lo ca tio n , in s tru c to r, ...
WILM – Reporting Strategy
D a ta S tru c tu re C h a lle n ge : T h e C la ss L is t R ep o rtit ’s lo o k in g co m p le x … 1 3 JO IN s so fa r
o u te r JO IN s , E ffe c tiv e D a te d
o h … yo u w a n te d s tu d en t d a ta o n th a t C la ss L is t R ep o rt?
WILM – Reporting Strategy
D a ta S tru c tu re C h a lle n ge : T h e C la ss L is t R ep o rt
P S /Q u e ry g oo d fo r fe w tab le sm an ag e m en t re p o rts n ee d m an y tab le sp ro g ram m in g to o ls lik e S Q R a re n ee d e d
WILM – Reporting Strategy
H ig h e r E d u ca tio n R ep o rtin g D a ta M a rt (R D M ): Fa s t, E a sy , A ffo rd ab le
n ig h tly e x trac t
h ig h e r e d u c a tio n
r e p o r tin g d a ta m a r t (R D M )
tr a n sa c tio n a p p lic a tio n
n igh tly e x tra c ts from tran sac t io n sy s temload d a ta in to R e po rtin g D a ta M a rt (R D M )d a ta m a rt o p tim ize d fo r re p o rt in g
WILM – Reporting Strategy
H ig h e r E d u ca t io n R ep o rtin g D a ta M a rt (R D M ): F a s t , E a sy , A ffo rd a b le
STUDENT DIMENSIONSTU_PKSTU_DATE_TIMESTU_EMPLIDSTU_SSNSTU_NAMESTU_GENDERSTU_BIRTHDATESTU_CAMPUS_EMAIL_CDSTU_CAMPUS_EMAILSTU_CAMPUS_ADDR_CDSTU_CAMPUS_ADDR1STU_CAMPUS_ADDR2STU_CAMPUS_ADDR3STU_CAMPUS_CITYSTU_CAMPUS_STATESTU_CAMPUS_ZIPSTU_CAMPUS_PHONE_CDSTU_CAMPUS_PHONESTU_CAMPUS_PHONE_EXTSTU_HOME_EMAIL_CDSTU_HOME_EMAILSTU_HOME_ADDR_CDSTU_HOME_ADDR1STU_HOME_ADDR2STU_HOME_ADDR3STU_HOME_CITYSTU_HOME_STATESTU_HOME_ZIPSTU_HOME_PHONE_CDSTU_HOME_PHONESTU_HOME_PHONE_EXTSTU_CITZ_STATUS_CDSTU_CITZ_SDESCSTU_CITZ_LDESCSTU_ETHNIC_CDSTU_ETHNIC_PRIMESTU_ETNHIC_PRIME_SDESCSTU_ETHNIC_PRIME_LDESCSTU_ADMIS_EXT_PKSTU_FINAID_EXT_PKSTU_STUFIN_EXT_PKSTU_CITZ_LDESCSTU_ETHNIC_CDSTU_ETHNIC_PRIMESTU_ETNHIC_PRIME_SDESCSTU_ETHNIC_PRIME_LDESCSTU_ADMIS_EXT_PKSTU_FINAID_EXT_PKSTU_STUFIN_EXT_PK CLASS DIMENSION
CLS_PKCLS_DATE_TIMECLS_COURSE_IDCLS_COURSE_OFFER_NBRCLS_TERMCLS_TERM_SDESCCLS_TERM_LDESCCLS_SESSION_CDCLS_SESSION_SDESCCLS_SESSION_LDESCCLS_CLASS_SECTIONCLS_INSTITUTION_CDCLS_INSTITUTION_SDESCCLS_INSTITUTION_LDESCCLS_CAMPUS_CDCLS_CAMPUS_SDESCCLS_CAMPUS_LDESCCLS_LOCATION_CDCLS_LOCATION_SDESCCLS_LOCATION_LDESCCLS_ADDRESS1CLS_ADDRESS2CLS_CITYCLS_STATECLS_ZiPCLS_GROUP_CDCLS_GROUP_SDESCCLS_GROUP_LDESCCLS_ORG_CDCLS_ORG_SDESCCLS_ORG_LDESCCLS_SUBJECT_CDCLS_SUBJECT_SDESCCLS_SUBJECT_LDESCCLS_CIP_CDCLS_HEGIS_CDCLS_CATALOG_NBRCLS_COURSE_LDESCCLS_CLASS_NBRCLS_CLASS_COMPONENT_CDCLS_CLASS_COMPONENT_SDESCCLS_CLASS_COMPONENT_LDESCCLS_CLASS_TYPECLS_CLASS_TYPE_SDESCCLS_CLASS_TYPE_LDESCCLS_ASSOCIATED_CLASS_NBRCLS_START_DATECLS_END_DATECLS_FACILITY_CODE1CLS_FACILITY_SDESC1CLS_FACILITY_LDESC1CLS_STANDARD_MTG_PATTERN1CLS_MTG_START_TIME1CLS_MTG_END_TIME1CLS_FACILITY_CODE2CLS_FACILITY_SDESC2CLS_FACILITY_LDESC2CLS_STANDARD_MTG_PATTERN2CLS_MTG_START_TIME2CLS_MTG_END_TIME2CLS_INSTRUCTOR_EMPLIDCLS_INSTRUCTOR_NAMECLS_INSTRUCTOR_PHONECLS_ENROL_TOTAL
CAREER_TERM DIMENSIONCTRM_PKCTRM_DATE_TIMECTRM_STUIDCTRM_ACAD_CAREERCTRM_ACAD_CAREER_SDESCCTRM_ACAD_CAREER_LDESCCTRM_ACAD_CAREER_NBRCTRM_INSTITUTIONCTRM_INSTITUTION_SDESCCTRM_INSTITUTION_LDESCCTRM_STRM_CDCTRM_STRM_SDESCCTRM_STRM_LDESCCTRM_STRM_BEGIN_DTCTRM_STRM_END_DTCTRM_WEEKS_OF_INSTRUCTCTRM_TERM_CATEGORY_CDCTRM_TERM_CATEGORY_SDESCCTRM_TERM_CATEGORY_LDESCCTRM_ACAD_YEARCTRM_WITHD_CDCTRM_WITHD_SDESCCTRM_WITHD_LDESCCTRM_WITHD_REASON_CDCTRM_WITHD_REASON_SDESCCTRM_WITHD_REASON_LDESCCTRM_WITHDRAW_DATECTRM_ACAD_PROG_PRIME_CDCTRM_ACAD_PROG_PRIME_SDESCCTRM_ACAD_PROG_PRIME_LDESCCTRM_ACAD_PROG_STATUS_CDCTRM_ACAD_PROG_STATUS_SDESCCTRM_ACAD_PROG_STATUS_LDESCCTRM_ACAD_PROG_ACTION_CDCTRM_ACAD_PROG_ACTION_SDESCCTRM_ACAD_PROG_ACTION_LDESCCTRM_ACAD_PROG_REASON_CDCTRM_ACAD_PROG_REASON_SDESCCTRM_ACAD_PROG_REASON_LDESCCTRM_ACAD_LOAD_CDCTRM_ACAD_LOAD_SDESCCTRM_ACAD_LOAD_LDESCCTRM_ACAD_LEVEL_BOT_CDCTRM_ACAD_LEVEL_BOT_SDESCCTRM_ACAD_LEVEL_BOT_LDESCCTRM_ACAD_LEVEL_EOT_CDCTRM_ACAD_LEVEL_EOT_SDESCCTRM_ACAD_LEVEL_EOT_LDESCCTRM_CUR_GPA_RANGECTRM_CUM_GPA_RANGE
DATE_TIME DIMENSIONDTIM_PKDTIM_DATE_TIMEDTIM_TYPEDTIM_DESCRDTIM_ACAD_YEARDTIM_ACAD_MONTH_NBRDTIM_CAL_YEARDTIM_CAL_QUARTERDTIM_CAL_MONTH_NBRDTIM_CAL_MONTH_SDESCDTIM_CAL_MONTH_LDESCDTIM_CAL_WEEK_NBRDTIM_CAL_WEEK_NBR_YTDDTIM_CAL_DAY_NBRDTIM_CAL_DAY_SDESCDTIM_CAL_DAY_LDESCDTIM_CAL_DAY_NBR_YTDSA_VERSIONSA_RDBMS_VERSIONDECISION_STREAM_VERSIONDS_ODS_VERSIONother fields that would help us auditchanges to the ODS …
CLASS_SECTIONENROLLMENT FACTS
ENRL_PKENRL_STU_FKENRL_CLASS_FKENRL_DATE_TIME_FKENRL_HEADCOUNTENRL_UNT_TAKENENRL_GRADE_POINTSENRL_GRADE_OFFENRL_PKENRL_STU_FKENRL_CLASS_FKENRL_DATE_TIME_FKENRL_HEADCOUNTENRL_UNT_TAKENENRL_GRADE_POINTSENRL_GRADE_OFF
STUDENT DIMENSIONSTU_PKSTU_DATE_TIMESTU_EMPLIDSTU_SSNSTU_NAMESTU_GENDERSTU_BIRTHDATESTU_CAMPUS_EMAIL_CDSTU_CAMPUS_EMAILSTU_CAMPUS_ADDR_CDSTU_CAMPUS_ADDR1STU_CAMPUS_ADDR2STU_CAMPUS_ADDR3STU_CAMPUS_CITYSTU_CAMPUS_STATESTU_CAMPUS_ZIPSTU_CAMPUS_PHONE_CDSTU_CAMPUS_PHONESTU_CAMPUS_PHONE_EXTSTU_HOME_EMAIL_CDSTU_HOME_EMAILSTU_HOME_ADDR_CDSTU_HOME_ADDR1STU_HOME_ADDR2STU_HOME_ADDR3STU_HOME_CITYSTU_HOME_STATESTU_HOME_ZIPSTU_HOME_PHONE_CDSTU_HOME_PHONESTU_HOME_PHONE_EXTSTU_CITZ_STATUS_CDSTU_CITZ_SDESCSTU_CITZ_LDESCSTU_ETHNIC_CDSTU_ETHNIC_PRIMESTU_ETNHIC_PRIME_SDESCSTU_ETHNIC_PRIME_LDESCSTU_ADMIS_EXT_PKSTU_FINAID_EXT_PKSTU_STUFIN_EXT_PK
ex tra c t
r e p o r t in g d a ta m a r t (R D M )
tr a n sa c tio n a p p lic a tio n
m a g ic h a p p e n s
h e re
WILM – Reporting Strategy
R D M :Fa s t, E a sy , A ffo rd a b le
3 ,0 00 + d a ta ite m s e x tra c te d fro m 6 0 0 + S A ta b le s
cam p u s co m m u n ityb io g r a p h ic / d e m o g r a p h ic a tt r ib u te sg ro u p s , in te re s ts , c o m m u n ic a t io n s , c o m m e n ts , c h e ck lis ts
ad m is s io n sp ro s p e c ts , re c ru ite rs , a p p lic a n t s , h ig h s c h o o ls , te s t s c o re se v a lu a t io n s , ra t in g s , s ta tu s , a t t r ib u te s , o u tc o m e s
s tu d e n t re co rd sc a re e rs , p ro g r a m s , p la n s , s u b -p la n s , te rm s , e n ro llm e n ts , g r a d e sc la s s e s , s e c t io n s , c o m p o n e n ts , m e e t in g t im e s , in s tru c to rs , fa c ilit ie s
f in an c ia l a idIS IR s , fe d / lo c a l c a lc u la t io n s , C O A , P C , P E L L , p a c k a g in g , d is b u r s e m e n ts
s tu d e n t f in an c ia lsa c c o u n ts , re fu n d s , 3 rd p a rty , p a y m e n t p la n s , c a s h ie r in g , G L , c o lle c t io n s
WILM – Reporting Strategy
Student Administration is only suite in RDS currentlyHuman Resources suite is planned to be added in Spring 2003
WILM – Reporting Strategy
Purchased Crystal Reports 8.5 interimRFP – JuneCognos Tools of Impromptu and PowerPlayConract Signed – AugustCognos Training – October 14
WILM – Reporting Strategy
Peoplesoft
Live Data
RDS SA/HR
Last Nights Data
Data Warehouse
Historical
Data
WILM Database Infrastructure
Peoplesoft Data Base Peoplesoft RDS Data Base WILM Data Warehouse Data Warehouse Actual “Live” Data Data replaced Nightly extract Historical Data Cubes 1,000’s of data fields 4,000+ data elements from 600+ Tables
COGNOS Decision Stream
Extraction
COGNOS Decision Stream
Extraction Tool
Data Warehouse
Cube
Date Warehouse
Cube
WILM – Reporting Strategy
Data WarehouseData
Warehouse Cube
Data Warehouse
Historical Data
Data Warehouse
Cube
WILM – Reporting Strategy
Why a data warehouse?Relieves transactional database for reporting needsRDS is replaced nightlyComparisons require stable number to compare toHolds a snapshot of the dataAbility to analyze patterns and trends over a period of timeAbility to users to drag-and-drop, swap, etc.
WILM – Reporting Strategy
StepsPlanningGathering Data Requirements and Modeling
Defining FieldsDefining Dimensions
DevelopmentPhysical Database DesignData Mapping and TransformationData Extraction and Load
Testing and VerificationTraining Rollout
WILM – Reporting Strategy
R D S SA /H R
L ast N ights
D ata
D ata W arehouse
H istorical D ata
W IL M R eports C O G N O S
- Im prom ptu W IL M R eports
C O G N O S - P ow erP lay
Peop lesoft
L ive D ata
D ata W arehouse
C ube
D ate W arehouse
C ube
W IL M R ep orting In frastructure
WILM – Reporting Strategy
Outlook for ReportingReal-time, secure, and personalized data access, analysis, and sharing for all information usersMust be applicable for all technical and non-technical usersMust have performance consistent with desktop applications from both a functionality and speed perspective
WILM – Reporting Strategy
Must be easy to use and supportMust interface with/access data in applicationsMust deliver immediate return on investmentMust be well-documented and easily accessible and easy to understand
Must be Web-based and flexible to meet the needs of all the users
Thank you!
WILM – Reporting Strategy