ronette engela pcas, the presidency · 2011-09-23 · revitilised m&e task team coordinating...

Ronette Engela PCAS, The Presidency

DPSAPerformance management

12 June 2008

ContentGWM&E system

Performance measures Additional information

In 2005 Cabinet approved an implementation plan

to developa monitoring and evaluation system

for use across government

1MonitoringEvaluationEarly warningVerificationData collectionAnalysis Reporting

3 Components

1) Principles 2) Compendium

of indicators3) Implementation

plan

Linked to planningframework

Cabinet memorandum

2005

2Based on standard, shared indicators

3Composite systemBuilt over timePilotRoll-out

Not a single automated IT system

Framing phase

Quality improvement and analysisphase

IT systems

Schematic vision of roll out

Fellowship Battle Victory Quest

2005-2007 2008-?2010 2011 onwards =indicative

Composite system that draws its data from contributory systems Emerging system built up over time with consistent and sustained participation by all stakeholders

Conceptual anchor matrix of indicators

National vision doesnNational vision doesn’’t justt justhappenhappen’’ at provincesat provinces

Well Well conceptualisedconceptualised, consistent , consistent with international practicewith international practice

‘Green Book’

SYSTEMS Large existing systems in place that have taken years to build upPerformance monitoring system by NT of 500 indicators of concurrent functionsExtensive systems in Housing, Education, Health, DWAF, SAPS, Soc DevSome provinces – FS, GT, WC & EC

What do we have?What do we have?Status quo

Good CAPACITY and experienceConceptual coherencebetween core national departments, even joint projects

Need to focus on quality improvement

Policy platform established 2007GWM&E frameworkPPI frameworkSA Statistical Quality Assurance frameworkDraft DPLG LG framework

Common definitions document

Products and Processes Products and Processes Status quoCross cutting M&E

products PoA Development IndicatorsPublic Mang WatchIGR publication of non financial informationENE include performance indicatorsProvincial Budget Statements –performance indicators

Revitilised M&E Task Team Coordinating Forum

Learning Network2 events, 300 att, Web link

GWM&E System: Policy platformGWM&E System: Policy platform

Social, Economic & Demographic Statistics

Registers and Admin data

Evaluations

Programme Performance Information

GWM&E framework

PPI framework

SASQAF

Common definitions

GWM&E System: data terrainsGWM&E System: data terrains

Social, Economic & Demographic Statistics


Evaluations


NationalIndicators

PoAPoA

Established the culture of reportingDoes not allow proper outcome/impact assessment

Sometimes need process - court casesWill be assessed, redesigned end 2007Building custom based web system

PoAPoAAnnual State of the Nation –priorities are announcedWeb based system 300 usersBi-monthly report to Cabinet

Positive

NegativeNegative

72 72 Development IndicatorsDevelopment Indicators

Economic growth and transformation

Education

Employment Social cohesion

Poverty and inequality Safety and security

Household and community assets

International

Health Good governance

www.ThePresidency.gov.zawww.ThePresidency.gov.za

NationalIndicators

GWM&E Framework: Programme Performance Information

PPIDept sector sector sector

Derived information system DPLGDWAF

Transversal systems PERSAL BAS

Stats

E

E

C&SStats

E


sector

Derived information system

Transversal systemsLine manager

Dept exec

Programme manager

Exec Authority

dept

PPI service delivery information500

indicators

Annual MTSF informs MTEF - budgetAnnual Performance Plans tabled in parl / legislaturesProv APP prescribed format with indicators that measures delivery of servicesQuarterly reports to provincial Treasuries who passes it on to NTTo be publishedMonitor Annual Report against APP 8 years to build8 years to build

Education

Number of learner days covered by the nutrion

programme

Number of schools w ith an adequate

number of functional toilets

ATPrelimenary

Q1 ATPrelimanery

Q1 ATPrelimaner

y Q1 ATPrelimanery

Q1Eastern Cape – 53 – 4 657 – 895 – 20 204Free State 184 27 30 – 42 – 8 285 9 804Gauteng 199 48 1 963 1 963 1 963 1 963 30 000 45 754Kw aZulu-Natal 233 992 800 42 012 000 4 893 4 801 3 766 3 647 – – Limpopo – – – – – – – – Mpumalanga 156 39 1 763 – 438 – 51 376 51 376Northern Cape 174 27 620 450 600 500 22 648 22 648North West 196 50 1 403 – – – 34 000 42 505Western Cape 34 680 000 9 150 075 1 450 1 450 164 162 46 900 46 900* Zero's indicate no information *(SDD) versus (AT) First Quarter 2007/08 - Education

Programme 2: Public Ordinary School Education

Number of learners benefitting from scholar

transport

Number of public Ordinary schools w ith

water supplyProvinces

Health

PHC total headcount Utilisation rate-PHC

ATPrelimenar

y Q1 ATPrelimanery

Q1 ATPrelimanery

Q1 ATPrelimanery

Q1 ATPrelimane

ry Q1Eastern Cape – 1,103,422 - R 68 2.7 1.9 - 3.4 70.0% - Free State – 1,018,446 R 99 - 2.3 0.3 3.8 0.9 78.0% 79.1% Gauteng 30,000,000 2,454,049 R 52 R 151 2.5 1.5 4.5 1.3 100.0% 68.0% Kw aZulu-Natal 19,986,457 4,231,976 R 206 R 86 2.0 2.0 4.0 4.0 100.0% 85.0% Limpopo – 2,924,118 R 238 R 63 3.0 2.2 3.3 4.9 80.0% 79.0% Mpumalanga – – - - - - - - - - Northern Cape 2,500,500 401,758 R 182 R 52 3.5 5.0 5.0 10.0 70.0% 45.0% North West – 1,142,181 R 78 R 125 3.5 1.2 5.0 2.6 100.0% - Western Cape – – - - - - - - - -

Programme 2: District Health Services

Utilisaton rate for under 5 year olds - PHC Supervision visit rate

Clinics and community health centres

Provinces

Expenditure per PHC headcount (province)

Social Development

Number of children who stay in Children Homes -

Government

Number of children who stay in Children Homes -

NGO

Number of children who stay in Places of Safety - Government

Prov ATPrelimenary

Q1 ATPrelimanery

Q1 ATPrelimanery

Q1 ATPrelimanery

Q1Eastern Cape - - 2 111 527 500 250 - - Free State 800 934 See Govern - 100 260 - - Gauteng - - - - - - - - Kw aZulu-Natal 60 64 2 250 1 962 750 276 1 500 241 Limpopo 500 270 257 350 120 200 - - Mpumalanga 80 20 648 445 - - 720 111 Northern Cape - - 672 1 258 20 23 750 555 North West 160 30 1 704 405 - - 300 78 Western Cape - - 2 198 2 198 - - - - * Zero's indicate no information *(SDD) versus (AT) First Quarter 2007/08 - Social Development

Programme 2: Social Welfare Services

Number of Children who stay in Secure Care

Centres - Government

2.6 Child Care and Protection Services

Agriculture

Number of emerging farmers supported w ith

advice

Number of commercial farmers supported w ith

advice

Number of contacts sharing research related

information

Prov ATPrelimenary

Q1 ATPrelimanery

Q1 ATPrelimanery

Q1Eastern Cape 14,000 1,265 90 24 75 25 Free State 1,162 719 451 277 540 168 Gauteng 600 89 - - - - Kw aZulu-Natal 16,162 9,118 1,043 238 296 180 Limpopo - - - - - - Mpumalanga 120 35 110 10 133 36 Northern Cape 6,000 - 100 - - - North West 12,073 4,644 1,530 926 157 12 Western Cape 1,000 579 500 171 - - * Zero's indicate no information *(SDD) versus (AT) First Quarter 2007/08 - Agriculture

Programme 3: Farmer Support and Development3.2 Extension Services

Transport

Number of kilometres resealed tarred roads

Number of kilometres regravel roads

Numver of kilometres routine maintenance on al

roads

Prov ATPrelimenary

Q1 ATPrelimanery

Q1 ATPrelimanery

Q1 ATPrelimanery

Q1Eastern Cape - - 974 297 51,900 20,600 100 200 Free State 20 - 90 - 85,000 14,465 2,227 137 Gauteng 2 2 5,200 2,303 - - - - Kw aZulu-Natal - 12 1,000 90 - - - - Limpopo - - - - - - - - Mpumalanga 200 58 114 - 1,000 150 14,557 1,130 Northern Cape - - - - - - - - North West 52 - 370 - 71,000 14,270 - - Western Cape 340 100 410 69 32,182 32,182 5,000 2,210 * Zero's indicate no information *(SDD) versus (AT) First Quarter 2007/08 - PW Roads & Transport

Programme 3: Road Infrastructure

EPWP Employment - Number of jobs created

3.5 Maintenance

PROVINCIAL DEPARTMENT

PROVINCIAL TREASURY

NAT CONCURRENT SECTOR DEPT

NATIONAL TREASURY

PREMIERS OFFICE

DPSAHuman resource info

Output & outcome infoOutput & outcome info

Gov tPoA indicators

PRESIDENCY

PoA

Performance information

Performance information

PROVINCIAL DEPARTMENT

PROVINCIAL TREASURY

NAT CONCURRENT SECTOR DEPT

NATIONAL TREASURY

Financial information

Financial information

PREMIERS OFFICE

Outpu

t & ou

tcome

info

DPSAHuman resource info

Output & outcome infoOutput & outcome info

CABINET

•Systems initiated in response to specific needs•Hard working, but not smart working systems•Smart analysis to align information

Status quo

Focus for 2008

Premier’s office guideline on M&EGeneric framework for M&E – to be work shopped in each sectorData forums per sectorDemographic data & HH data seminarAdmin datasets (300)

Massive GIS projectNeed to develop institutional M&E system –Thusongcentres

Ke ya lebogaKe a leboha

Ke a lebogaNgiyabonga

NdiyabulelaNgiyathokoza

NgiyabongaInkomu

Ndi khou livhuhaDankie

Thank you

EvaluationEvaluationNeed for detailed policy

evaluations on a number of different levels:Departmental led reviews and evaluation of policies and programmesSectoral reviews (Pres & NT)Broad, cross cutting reviews led by centre of government (15 Y R)

Monitoring and Monitoring and evaluation have evaluation have different different purposespurposes

“M” before “E”part of public sector reform initiative

Programme Performance Programme Performance InformationInformation

National Treasury

Constitution S.215 S.216Budget & Exp Management

PFMA & MFMA

Ensure information on inputs, outputs and outcomes …

MandateTreasury

…underpins planning, budgeting, implementation management and accountability reporting…

…to promote transparency andexpenditure control.


E

C&SDept


Area of Responsibility

Transversal systemsLine manager

Dept exec

Programme manager

Exec Authority

Dept

Develop a Develop a ProgrammeProgramme Performance Performance Information Information manual for each sectormanual for each sector

•The process for updating the Manual•Structures and systems to manage performance information•Processes to identify performance information••Listing and definitions of all the performance information Listing and definitions of all the performance information collected by the institutioncollected by the institution

••Technical standards for the institutions performance informationTechnical standards for the institutions performance information•Collecting and collating performance information•Checking and verifying information•Confidentiality•Use of performance information•Publication of performance information

PPI policy frameworkCurrent focusTreasury

Part of budget documentation requirementPart of budget documentation requirement

Ensure Programme Performance Information is appropriately used for planning, budgeting and managementplanning, budgeting and management purposes •set performance standards and targets priorto the start of each year•review performance and take management action•evaluate performance at the end of a service delivery period

PPI manual per sector - extensive consultation to determine needs of

different usersNext stepsTreasury

IMPACTS

OUTCOMES

OUTPUTS

INPUTS

ACTIVITIES

CENSUS AND SURVEY INFORMATION

PROGRAMME PERFORMANCE INFORMATION

PERFORMANCE EVALUATIONS

10 YEAR PERFORMANCE REVIEWS

END TERM REVIEWS

PERIODIC PROGRAMME EVALUATIONS

SERVICE DELIVERYEVALUATIONS

PERFORMANCE MANAGEMENT

THE CENSUS

HOUSEHOLD SURVEYS

BENEFICIARY / USER SURVEYS

MANAGEMENTSURVEYS

Methodology

National Statistical SystemNational Statistical System

StatsSA

Evaluations

PPI

Dept Dept


Transversal systems

Dept

Area of Responsibility

Census and Survey Information


The Statistics Act (No. 6 of 1999) The Statistics Act (No. 6 of 1999) 2002 January Cabinet 2002 January Cabinet LegkotlaLegkotla

State of the Nation Addresses State of the Nation Addresses 2004 and 20052004 and 2005

•Section 14 subsection 6 clauses (a), (b) and (c) where the Statistician-General may advise an organ of state on the application of quality criteria and standards

•Section 14 subsection 7 clauses (a) and (b) grants the Statistician-General power to designate statistics produced by other organs of state as official statistics

•Section 14 subsection 8 clauses (a) and (b) authorisesthe Statistician-General to comment on the qualityof national statistics produced by another organ of state; and to publish such other department’s statistics

MandateStatsSA

Demand for information[user groups or

indicator categories]

Stats SA Other producersdepartments

• Insufficient supply of quality information• Uncertain quality?Poor comparabilityIsolated producersNo shared standards• Insufficient statistical skills

Official statistics

Unknown quality

Problem

Demand for information[user groups or

Indicator categories]

Stats SAOther producers

[departments, CSOs, etc]

Regulatory environment• Statistics Law• Governance structure• Quality standards• Advocacy programme• Code of conduct

• Adequate information• Reliable information

[quality, sustainable]• Sufficient skills

Coordination

Feedback

Proposed solution

Feed

back

Proposed new approachProposed new approach

Use official statistics to ensure quality

• SASQAF [quality framework]•Framework of international best practice•UN Principles of Official Statistics

Maintain the decentralised system of statistical production

Transform all national statistics into official statistics

SASQAFDraft available

Transform existing departmental Transform existing departmental data (registers & surveys) data (registers & surveys) into sustainable sources into sustainable sources

of official statisticsof official statistics

•More use of administrative data than of surveys - sustainability and cost

• Agreements and collaboration between Stats SA and individual dept

• Joint Working Party between Stats SAand each of the departments to improve quality

ProgrammeNSS

ConcernsConcerns

Inadequate appreciation of the practice of managing for results

• Measurement of performance and “objective” info for planning and decision-making not a priority

• Current practice of existing M&E units without measurement

Circumlocutionary behaviour of public officers (multiple formalities)

• Waiting for approval (all the way to the minister!): inadequate delegation of authority

• Lack of institutional memory in government departments [change the head: start afresh]

•Operational silos – protecting one’s turf•Cover-ups: fear of exposure

Derived system:Derived system:DPLG local government DPLG local government

DPLG

GWM&E Framework: DPLG Derived Information

PPIE

C&SDept Dept Dept Dept


Transversal systems

Constitution Chapter 3 & 7 Constitution Chapter 3 & 7 Municipal Systems ActMunicipal Systems Act

Municipal StructureMunicipal Structure’’s Acts ActMandate

DPLG

5 Local Govt 5 Local Govt KPAsKPAs•Municipal Transformation and Organisational Development

•Basic Service Delivery•Local Economic Development•Financial Viability and Management•Public Participation and Community Involvement

Collaboration with key Collaboration with key national departmentsnational departments

ResponsibilityDPLG

•The Presidency•National Treasury•Dept of Public Service and Administration•Dept of Water and Forestry•Dept of Mineral and Energy•Dept of Housing•Statistics South Africa•South African Institute for ManagementDevelopment (MR&E capacity building)

Varying degrees: Varying degrees: ofof understanding understanding and and

ofof M&E capacity and readinessM&E capacity and readiness

•Lack of integrated approach to local governmentM&E across 3 spheres

•Lack of appropriate M&E reporting structures tomonitor local government service delivery•Capacity and capability to monitor local govtservice delivery

DPLG assessed readiness of provincial depts of local govt and Office of Premiers to do

Local govt M&EProblem

Types of local government Indicators

43%

36%

21%

9%

2%

20%

0%

45%

27%

8%

0%5%

10%15%20%25%30%35%40%45%50%

Input Activities Output Outcome Impact

Indicator category

Perc

enta

ge

Initially 500

Collated allCollated allindicators indicators

on local on local govtgovtPhase 1Phase 1

Now ±150

Shared understanding of Local government indicator Shared understanding of Local government indicator development across all three spheres Phase 2development across all three spheres Phase 2

GWM&E System

National

Provincial

District

Local

GPOA

PGDS

IDP

IDPIndicators

Achievements to dateAchievements to date Done

Readiness assessment of provincial dept of local governmentDraft Local Government MR&E framework, aligned to GWM&EMR&E business process mapping of Local government indicatorsNational Local Government MR&E forum establishedCollaboration with SAMDI and NT TAU for capacity building

Next stepsNext stepsPlans

Finalise Local Government M&E policy frameworkDevelop a compendium of indicators for Local GovernmentDesign and implement Local govt MR&E system that extracts information with multiple sector departments that deal with Local Government –based on impact model Capacity building for provinces and municipalities

ConcernsConcernsNeed to incorporate Public Opinions/ Imbizo processesIncorporate indicators into performance contracts

Conceptual clarity - IGRKey role players involvedConvergence around indicators

Data quality will improve with public attention and utilisationAG auditing

on performance mangsystem, not content

Myth: Myth: ““at the press of a at the press of a buttonbutton””Systems to alert about Systems to alert about problem, need political problem, need political will to deal with itwill to deal with it

Conclusion

Steady does it

KeKe yaya lebogalebogaKeKe a a lebohaleboha

KeKe a a lebogalebogaNgiyabongaNgiyabonga

NdiyabulelaNdiyabulelaNgiyathokozaNgiyathokoza

NgiyabongaNgiyabongaInkomuInkomu

NdiNdi khoukhou livhuhalivhuhaDankieDankie

Thank youThank you

ronette engela pcas, the presidency · 2011-09-23 · revitilised m&e task team coordinating...

Documents