Treasury Board of Canada Secretariat
Symbol of the Government of Canada

ARCHIVED - Guidelines for Core KPIs (Key Performance Indicators)


Warning This page has been archived.

Archived Content

Information identified as archived on the Web is for reference, research or recordkeeping purposes. It has not been altered or updated after the date of archiving. Web pages that are archived on the Web are not subject to the Government of Canada Web Standards. As per the Communications Policy of the Government of Canada, you can request alternate formats on the "Contact Us" page.

10.0   Key Performance Indicators - Internet Channel

The Canadian Gateways team has published a definitive report on Internet Measurement identifying the suitability and meaning of specific web measures (for example, hits versus visits). Readers are asked to review this document (see Appendix B).

MAF Category:  Citizen Focused Service

Metrics for Access

In the Internet Channel, the access theme includes measures concerning the availability of the site to potential site visitors.; There are two primary components to site availability:

  1. How easily can site visitors locate the site through search engines, links from other sites or via publication of the URL through other channels such as the phone and mail? and
  2. Is the site available for site visitors once it has been located?

Other qualitative characteristics contributing to access include compliance with W3C Accessibility Standards to ensure the site is fully inclusive and available to persons with disabilities.

KPI:

Search Engine Ranking

Description:

Relevance ranking weighted from distribution of site visitors who entered the site through commercial search engines. Metric assumes that a high search engine rank provides maximum accessibility to those visitors who access the site via search.

Objective:

Measures overall site access through search engines.

Definition:

Sum of (relevance ranking multiplied by search engine referring count) divided by total search engine referrals

Derivation:

Relevance rank from top five referring search engines using visitor representative sample of search terms

Suggested benchmark / Range:

 

Status:

Proposed as a Core KPI



KPI:

Direct Access Ratio

Description:

Percentage of visits which access the site directly via same or known URL to total visitors.This metric assumes that visits accessing the site directly are either typing or pasting a URL in from another source (e.g. a brochure) or have bookmarked the site as a result of repeated visits.

Objective:

Assessment of site 'memory' through known URL or bookmarking;

Definition:

Visits arriving at any page in site who do not have a referring URL associated with the visit.

Derivation:

Web traffic statistics counting visits arriving at site without referring URL.

Status:

Proposed as a Core KPI



KPI:

Server Availability Percentage

Description:

Total available server hours over total planned server hours during reporting period.

Objective:

Indicative of overall Internet service capacity

Definition:

sum of total available server hours less scheduled maintenance hours divided by total planned server hours

Derivation:

Server/Operating System Logs

Status:

Proposed as a Core KPI



KPI:

Referral percentage

Description:

Percentage of total visits arriving at the site from planned referral sites. This KPI can be further broken down into specific sites: e.g. GoC Gateways, other GoC sites, other jurisdictions etc.

Objective:

Measures another access route to the site and can be used to adjust access strategies.

Definition:

Total visits arriving from specified websites divided by total visits.

Status:

Proposed as Core KPI



KPI:

Conversion Rate

Description:

Rate at which visitors initiate transactions and reach the 'submit' page.

Objective:

Key Measure of overall service level and visitor satisfaction

Definition:

Total visits reaching "submit" pages divided by total visits viewing transaction start pages.

Derivation:

web monitoring package

Suggested benchmark / Range:

 

Status:

Proposed as Core KPI



KPI:

Abandonment Rate

Description:

Rate at which visitors initiate transactions but do not reach the 'submit' page PLUS visitors exiting site from non-content pages

Objective:

Key Measure for overall service level.

Definition:

Visits with unsatisfactory exit pages divided by total visits

Derivation:

web traffic statistics

Suggested benchmark / Range:

 

Status:

Proposed as Operational Measure



Metrics for Delay


KPI:

Average Visit Duration

Description:

The average duration of a visit. This metric can provide some indication of visitor need.  However as more and more transactions are put online, statistics for visit duration may need to be separated according to type of visit (e.g. transactional, browse, search)

Objective:

Assessment of site "stickiness" - overall relevance of site content and transactions to visitors' requirements.

Definition:

Total elapsed seconds from site entry at any page to site exit for all visits divided by number of visits

Derivation:

Measured by web traffic software.

Status:

Recommended as an operational measure.



Metrics for Quality


KPI:

Site Error Messages

Description:

Capture of all computer identified error conditions. Such as page not found message, invalid links, transaction aborts etc.

Objective:

Improves overall site quality and response.

Definition:

Total 'error' page views divided by total visits

Derivation:

Web activity tracking

Status:

Recommended as Core KPI



KPI:

Internet Channel Feedback

Description:

Total criticisms, complaints and compliments categorized into effective topics, received through all sources. It is recognized by working group that this is difficult to track today. However, it is recognized as high value.

Objective:

Contributes to program integrity.

Definition:

Count of complaints by topic over reporting period.

Derivation:

E-Mail, Phone Incident Tracking System, Ministerial Correspondence system

Status:

Recommended as an operational measure but not currently used within most departments.



KPI:

Professionalism

Description:

Encompasses a range of soft skills that govern the approach to delivering accurate information and reliable services.

Objective:

Identifies and reinforces effective web design and web authoring skills.

Definition:

Best measured through the use of focus groups and independent testing organizations. Some input may be available from Media Metrics. Quality of e-mail responses where implemented can be verified by Email Response Management System (# of QA corrections, etc).

Status:

Proposed as Core KPI but must be further developed by working group.



Metrics for Client Satisfaction


KPI:

Client Satisfaction Level

Description:

Application of Common Measurement Tool  (CMT) to assess and benchmark client satisfaction

Objective:

Primary indicator of client perception of service quality, measured repeatedly, trends provide strong evidence of service improvement levels

Derivation:

The multi-channel survey tool will be used (at a minimum) to determine the core measures relevant to the Internet channel. As well, period exit surveys should be conducted upon site exit. Timeliness of speed of e-mail response can also be measured.

Status:

Proposed as Core KPI