ALAC METRICSAssessing ALAC Performance

ALAC metrics 2008

AttendanceVotingFOCUS (ROP):

ACHIEVINGNOT ACHIEVING

Commitments of ALAC Members 2008

ALAC Rules of Procedure 2013 #9

FOCUS:

Performance

Metrics

Remediation

ALAC ROP – Section 9

9. Performance, Metrics and Remediation

The ability of the ALAC to represent the interest of Internet users depends on strong participation from all ICANN regions. Furthermore, the ALAC can function effectively only if all ALAC Members and Appointees meet the obligations of their positions. Satisfactory performance is a complex concept including both objective and subjective issues and must factor the very significant personal contributions made by At-Large volunteers. Moreover, the ALAC and At-Large receive significant funding from ICANN, both for travel and other activities, and the ALAC must be able to justify such expense.

MONITORING PERFORMANCE

PERFORMANCE FOCUS:

Attendance – ICANN meetings, ALAC sessions & teleconfsRegular and significant contributions to the ALACActive Participation and Roles in ALAC, and other, WGs

Definition of the involvement and participation Criteria

Attendance: Attend ALAC conference calls and any other virtual

or face to face meeting

Contribution: Contribute to the ALAC discussions and/or to the

ICANN policy development through • Discussion during calls/meetings (transcripts, Adobe

chat)• mailing lists • wiki pages

Voting: Vote in the • elections of ALAC officers and representatives within

and on various ICANN constituencies • any other kind of vote (ratification of statement,

survey, etc.)

Self reporting: This is a means to measure the commitment of the members, and a way for cross checking the criteria mentioned above

Members’ Status Active less active Standby

Metrics Thresholds Active: 60%+ Less active: 40-60% Standby: 0-40%

These metrics thresholds should apply for each criterion alone.

If a member meets one the four criteria metrics over a defined period of time (3 months), he may be considered as active

Definition of the involvement and participation Metrics

Less Active members are contacted by the ALAC chair notifying them that they are not seen to be involved or participating in the ALAC and ICANN related activities. They have the opportunity to respond to show how they are involved and active, or to explain the reason of their modest activity. Based on their rationales, they may either be returned to Active status or remain in the less active one.

Active members who have one or more criterion metric not met will still be considered Active but will be subject of the remediation actions as the less active members.

If there is no improvement after a period of 6 months, the less active members will be considered as in standby status.

Members in Standby status: lose their voting rights are removed from the quorum needed for voting on motions and elections should be notified of the status change and may regain their “less active” status and even their “Active” status if within the next 12 months they fulfill the conditions required for the concerned status, otherwise, …..

Remediation

Feedback from Consultation ProcessORIGINAL METRIC MODELS:

• Were too specific and did not measure what was relevant to the RALO.

• Focused more on consequences and the need for remediation, rather than reward for work well done.

• Measuring attendance alone did not indicate meaningful participation that resulted in action items or other follow-up.

• Need to balance ordinary meetings with contributions the members make to working groups, as pen holders, or even in online and written conversations.

• Measurement needs to be task driven.• Who will manage the metrics?

Feedback from Consultation ProcessRECOMMENDATIONS

• Active involvement and accountability could be more appropriately measured through actual LEADERSHIP of working groups activities and achieving results according to benchmarks or key performance indicators

• Some indicators could include:

• Input of time and commitment (eg number of working groups actively engaged in)• Leadership  responsibilities  (WG leader, penholder)• Mentoring skills (eg co-chairing to build capacity of other ALS members)• Team participation - collaborative skills• Other contributions…            

• eDemocracy tools – encouraging interaction between ALAC members and ALSes

• ALAC members could provide a brief report to their RALOs at each RALO update meeting

Metrics 2014Quantitative

Attendance Sheet will record attendance at:• ALAC meetings and sessions at

ICANN and teleconferences

(initially)• ALAC (and other) working group

meetings (later)

• Gives a visual representation of commitment to attendance of ALAC and WG meetings.

Qualitative

• Individual ALAC wiki page will record:

• Contribution and any action items personally involved in

• Leadership responsibilities in working groups and outputs

• Mentoring and team roles, etc

Gives a transparent representation of a member’s “regular and significant contribution” to ALAC and WG meetings

Managed by staff Managed by the ALAC member

Model of an ALAC member report

PRESENTATION OF SAMPLE MEASURES AND METRICSDev Anand Teelucksingh

PROBLEM WITH THE WIKI?• Post to the staff and they will put it online for you

From the Metrics WG

QUESTIONS?