Treasury Board of Canada Secretariat
Symbol of the Government of Canada

ARCHIVED - Treasury Board Submission Process Audit - September 2003

Warning This page has been archived.

Archived Content

Information identified as archived on the Web is for reference, research or recordkeeping purposes. It has not been altered or updated after the date of archiving. Web pages that are archived on the Web are not subject to the Government of Canada Web Standards. As per the Communications Policy of the Government of Canada, you can request alternate formats on the "Contact Us" page.





Treasury Board Submission Process Audit
September 2003






Table of Contents

1.0 Executive Summary

2.0 Introduction

3.0 Audit Results

4.0 Audit Findings

Annex A

 




1.0 Executive Summary

The objectives of the audit were to evaluate the effectiveness and efficiency of the Treasury Board Submission process and identify areas of risk within the process for which controls should be in place. The audit included the following:

  • Assessing whether the Treasury Board Secretariat's (the Secretariat) processes are effective in assisting departments and other government agencies with the preparation of submissions.
  • Reviewing the existence and effectiveness of policies and controls in place to ensure appropriate, timely analysis and recommendations are made to Treasury Board.
  • Assessing whether resources appear to be adequate and effective in undertaking the Treasury Board Submission process.

The scope of the audit included the Secretariat's processes supporting its role to assist departments with the preparation of Submissions and ensuring the Submission is ready to be presented to Treasury Board. For purposes of the audit, the Treasury Board Submission process included the activities performed by the Secretariat:

  • Prior to a formal submission being submitted; and
  • Once a formal Treasury Board submission from a department has been received by the Secretariat.

In addition, the audit assessed whether controls were in place to ensure that identified risks were addressed, and to ensure there is integrity throughout the entire process. It also assessed whether the Secretariat's processes were effective in assisting organizations with the preparation of submissions. The audit did not address the views of the President or other Treasury Board Ministers on the quality of either the submissions or the recommendations presented to them for approval.

The results from this audit indicated that that there is an established process in place at the Secretariat for review and approval of Submissions. A number of areas for improvement have been identified and recommendations made to address them. The more significant areas noted for improvement are:

  • The development of additional formal policies and procedures to improve the consistency of process throughout the Secretariat, and
  • Improvement in the processes established to support new analysts to understand their role and responsibilities prior to reviewing any Submissions.

Additional observations and recommendations are included in section 4.2 of this report.

 




2.0 Introduction

2 .1 Background1

The Treasury Board (The Board) is a statutory committee of Cabinet, established under the Financial Administration Act. It consists of six ministers, including the President of the Treasury Board (Chairperson) and the Minister of Finance. In June 1997, the Prime Minister designated the Treasury Board as the government's management board. In addition to the traditional roles of the Treasury Board and its Secretariat as employer and expenditure manager, the management board is also expected to have a comprehensive view of government operations and to provide sustained leadership in improving management practices.

The responsibilities of the Treasury Board include:

  • As expenditure manager, the Treasury Board is responsible for preparing the government's expenditure budget (the Estimates) that is tabled annually in Parliament, and for monitoring program spending in government departments.
  • As the employer, the Board sets the terms and conditions under which the federal public service attracts and retains the staff it needs. Furthermore, the Board is also responsible for the general direction of the federal policies and programs relating to implementation of the provisions on language of service to the public, language of work and the equitable participation of English-speaking and French-speaking Canadians in all federal institutions.
  • As management board, the Treasury Board provides policy direction in such areas as access to information, accounting, audit and evaluation, contracting, financial management, information technology, real property, as well as on the management of the government's assets, privacy, security, and personnel management in the public service.

A Treasury Board Submission is an official document submitted by a minister on behalf of her or his department to seek approval or authority from Treasury Board ministers to carry out a proposal that otherwise the department would not be able to undertake, or would be outside its delegated authorities.

The recommendations and advice from the Secretariat on a particular submission are provided to the Treasury Board in documents referred to as précis.

Legislation, Treasury Board policies, or other Cabinet decisions usually establish the requirements for Treasury Board approval.

Typical examples include seeking Treasury Board authority to:

  • Allocate resources previously approved by Cabinet or included in the federal Budget;
  • Authorize or amend terms and conditions of programs governing grants or contributions;
  • Recommend approval of Orders in Council that have resource (e.g. cost recovery) or management implications;
  • Carry out a project or initiative, the costs of which would exceed a department's delegated authority;
  • Enter into a contract; and,
  • Obtain an exemption from Treasury Board policy.

A department may submit a proposal to the Board if it believes that the latter's collective judgement is necessary or desirable.

The table below shows the timelines and process for preparing a submission. Though the shortest possible time to process a submission from start to finish is approximately six weeks, most submissions require several more weeks in order to ensure content is finalized and issues resolved. Two to three months is the average processing time for a Submission. Some departments build in an additional month for submissions requiring inter-departmental consultation or sign-off.

Week

Monday

Tuesday

Wednesday

Thursday

Friday

1

The Secretariat analyst receives draft #1 of Treasury Board submission from department

   

The Secretariat analyst provides comments to department

 

2

Meeting (if required) to discuss the Secretariat analyst's comments

 

The Secretariat analyst receives draft #2 of submission from department

   

3

The Secretariat analyst provides further comments to department

 

Meeting (if required) to discuss the Secretariat analyst's comments

   

Note: More time may be needed to revise the draft submission further.

4

Penultimate draft submission due to the Secretariat analyst

The Secretariat analyst drafts précis and recommendation

 

The Secretariat analyst's draft précis due to the Secretariat senior management

 

5

Submission signed by minister due in SCDC2 by noon

     

Briefing books to Treasury Board ministers

6

     

Treasury Board meeting

The Secretariat analyst informs departmental Corporate Services of Treasury Board decision

2.2 Audit Objectives

The objectives of the audit were to evaluate the effectiveness and efficiency of the Treasury Board Submission process and identify areas of risk within the process for which controls should be in place. The audit included the following:

  • Assessing whether the Secretariat's processes are effective in assisting departments and other government agencies with the preparation of submissions.
  • Reviewing the existence and effectiveness of policies and controls in place to ensure appropriate, timely analysis and recommendations are made to the Board.
  • Assessing if resources appear to be adequate and effective in undertaking the Treasury Board Submission process.

2.3 Audit Scope

The scope of the audit included the Secretariat's processes supporting its role to assist departments with the preparation of their Submissions and the work done by TBS analysts to prepare the précis and Submission for presentation to Treasury Board. For purposes of the audit, the Treasury Board Submission process included all the activities performed by the Treasury Board Secretariat:

  • Prior to a formal submission being submitted by a department; and
  • Once a formal Treasury Board submission from a department has been received by the Secretariat.

This audit assessed whether controls were in place to ensure identified risks are addressed and that there is integrity throughout the entire process. It also assessed whether the Secretariat's processes are effective in assisting organizations with the preparation of submissions. Ministerial views on the quality of the advice and recommendations were not sought.

2.4 Audit Approach / Methodology

The following table provides a high level overview of the different activities that Ernst & Young undertook to conduct the internal audit of the Treasury Board Submission process.

Approach and Work plan

Activity 1: Perform preliminary planning for the audit

  • Review Treasury Board Submission Guide, and develop audit approach;
  • Review documentation from previous reviews related to the Treasury Board Submission process, policies, etc.;
  • Conduct kick off meeting with program teams;
  • Finalize the audit approach and schedule.

Activity 2: Obtain an overall understanding of the Process.

  • Map the submission process to confirm our understanding of the process and evaluate whether it serves as an effective vehicle for review of Treasury Board Submissions;
  • Review submission documentation to ensure documentation of key factors supporting the Secretariat's recommendations to the Board;
  • Select a sample of recent submissions representing the 15 types and various sectors and assess their compliance with the guidelines stipulated in the Treasury Board submission guide;
  • Interview a sample of Secretariat members to obtain their understanding of the current operations of the process and assess whether appropriate resources are available to meet the requirements of the process;
  • Interview selected representatives of management from organizations having recently submitted Submissions.

Activity 3: Identify and Assess Risks

  • Identify potential risk factors based on the above interviews and documentation reviews;
  • Perform an independent evaluation of the risk severity and risk probability of each of the risk factors identified above;
  • Review the risk mitigation actions identified by management and recommend additional actions where appropriate;
  • Confirm findings and observations.

Activity 4: Finalize and Report

  • Draft preliminary audit report and confirm findings;
  • Debrief project teams and management;
  • Prepare and present final report.

 




3.0 Audit Results

The Audit has been designed to provide senior management with an assessment of the effectiveness and efficiency of the Secretariat's current Submission process.

The results from this Review indicated that that there is an established process in place at the Secretariat for review and approval of Submissions. However, a number of areas for improvement have been identified. In particular, significant areas noted for improvement included the development of additional formal procedures, completion of documentation, and elimination of delays in notifying departments of the Treasury Board's decisions.

Specific details on the findings and recommendations on areas identified for improvement are provided in section 4.1.

3.1 Audit Criteria

Provided below is a summary of the audit criteria developed for this Audit and, where applicable, the recommendations related to a particular criterion. Criteria were developed based on the Treasury Board Submission Guide, our understanding of the process for preparation and review of Treasury Board Submissions, and procedures and controls anticipated in a process of this nature based on our experience reviewing other processes.

Audit Criteria

Recommendations

P&P 3

Other

Assess whether the Secretariat's processes are effective in assisting organizations with the preparation of Submissions

  1. The Treasury Board Secretariat's Submission Guide is an effective resource for assisting departments when writing a Submission.
 

4.1.7

  1. The Treasury Board policies are an effective resource to assist a government department with the preparation of a Submission.
 

4.1.3

  1. Departments are able to contact a Secretariat analyst prior to writing a draft Submission to get the Analyst's opinion. The Secretariat analysts are helpful.

No recommendation

  1. Program analysts are efficient in returning comments regarding a draft Submission.
 

4.1.8

  1. Departments are satisfied with the level of assistance received from the Secretariat analyst.
 

4.1.2

  1. Analysts within the government departments have adequate information regarding requirements prior to preparing a Submission.
 

4.1.7

  1. There is a procedure regarding how a draft Submission is to be sent to the analyst for review.

4.1.1

 

Review the existence and effectiveness of policies and controls in place to ensure appropriate and timely recommendations are made to the Board

  1. Analysts are properly trained and mentored prior to assisting a department with a Submission.
 

4.1.2

  1. Analysts have the experience to assist a department with the Submission, write the précis, and determine the risk and category for the précis.
 

4.1.2

  1. The Treasury Board policies are a helpful resource to the Secretariat analyst.
 

4.1.3

  1. There is a formal definition of the classification of Submissions.

4.1.1

 

  1. There is a defined, objective and logical risk matrix to assist the analyst in determining the risk to be placed on the Précis.
 

4.1.4

  1. Policy experts have an opportunity to review the Submission prior to it going to the Board.

No recommendation

  1. There are formal policies and procedures in place to define the requirements for review and sign-off by policy experts.

4.1.1

 
  1. Policy expert sign-offs on the comment copies of the Submission are kept on file with the original Submission.

4.1.1

 
  1. Submissions are not going to the Board until Submission Control (SCDC) has received all policy expert sign-offs.

4.1.1

 
  1. Program analysts and SCDC understand and comply with the procedures for completing the Pink Jacket.

4.1.1

 
  1. The Pink Jacket is retained with the original Submission as a back up of the evidence that Policy Sectors have reviewed the final copy of the Submission.

4.1.1

 
  1. SCDC notes on the précis what sign-offs are outstanding in the final submission file.

4.1.1

 
  1. There are formal procedures in place that outline who should follow up on outstanding policy expert sign-offs on the final Submission.

4.1.1

 
  1. Electronic versions of Submission documents are appropriately stored and tracked.
 

4.1.9

Review management practices for monitoring decision making and the approval process.

  1. The Assistant Secretaries attend the strategy meetings.

No recommendation

  1. The Directors sign the précis to verify that they are accountable for the précis.

4.1.1

 
  1. Directors review the Pink Jacket and comment copies received from SCDC.

4.1.1

 
  1. The analyst formally notifies the department of the Treasury Board decision within two weeks of the Board meeting.

4.1.1

 
  1. The electronic copies of the final submission documents are appropriately stored.
 

4.1.9

  1. The original copy of the Submission, the précis, the decision letter and the sign-offs are archived in SCDC.

4.1.1

4.1.10

  1. The original copy of the Submission is stored in a secure locked location.
 

4.1.5

Assess to determine if there is a process to record and archive completed Submission files.

  1. There is a policy that states what should be kept with the original Submission at SCDC.

4.1.1

 
  1. Completed files are archived after three years.
 

4.1.10

Other

  1. Submissions are received from departments by the deadline of noon Monday.
 

4.1.6

3.2 Summary of Findings

As part of this audit we tested a sample of 69 Treasury Board Submissions from the files in SCDC. Below is a summary of the results of this testing:

Decision Letters

  • 14% of completed Submission files did not have the Decision Letter or Turnaround Document in the file.
  • 40% of decision letters were sent to the department later than the two-week deadline.

Précis

  • 3% of files did not have a copy of the Précis signed by the Program Sector Director.

Policy Sector Sign-Off

  • 59% of the files did not include the Policy Sector Sign-offs.

Expenditure Status Report (ESR) Sign-off

  • 36% of the files did not contain the ESR sign-off.

The results above indicate the inconsistencies within the Treasury Board Submission process. See observation 4.1.1 for a discussion regarding the risk of inconsistencies.

 




4.0 Audit Findings

Overall we found that there is an established process in place at the Secretariat for review and approval of Submissions. We found that Secretariat staff are dedicated and committed to the preparation of information for Treasury Board ministers that permits them to understand the submissions put forward to them and to question or challenge them as needed. The analysts work hard with departments to ensure Submissions are ready for presentation to Treasury Board.

The observations and recommendations below reflect a lack of formalization and inconsistencies in the process used by the Secretariat for Treasury Board Submissions. They also relate to the need for improved documentation standards.

4.1 Observations and Recommendations

The following are areas where we have identified recommendations for improvements to the Treasury Board Submission process.

Observations Rated High Risk

4.1.1 Treasury Board Submission Policies and Procedures

The audit identified several aspects of the Treasury Board Submission process where formally documented policies and procedures have not been developed. This may create inefficiencies and inconsistencies in the process for reviewing Submissions.

Our interviews indicated that, among the branches, there are inconsistencies in the understanding of the roles and responsibilities of the Program Analyst, Policy Analyst, Directors and Assistant Secretaries.

Below is a list of some of the areas that have been identified where policies and procedures should be developed:

Method of Transferring a Submission from the Government Department to the Secretariat, i.e. via e-mail or Secured Courier

It is common practice to send draft submissions to and from the Secretariat using unsecured email or fax. The analysts interviewed for the audit were uncertain as to whether the draft Submissions should be handled similarly to the final Submissions, which are "Confidence of the Queen's Privy Council" requiring properly secured methods of communication.

We recommend policies and procedures for handling the communication of draft Treasury Board Submissions should be developed to clarify the level of security required.

Management Response

Agreed. TBS will review current practices for communicating draft TB Submissions to and from departments, using the government policy on Confidences of the Queen's Privy Council for Canada as a general guide and will develop a new procedure that will clarify for staff the level of security required for draft TB submissions by November 2003. However, it should also be noted that the Privy Council Office is in the process of revising guidelines for the use of Cabinet Confidence level of security.

The Secretary will communicate this new procedure to departments and all TBS staff as well

as ensure that an increased number of secure facsimile machines and secure courier services are available for use by TBS staff.

Policy Expert Review and Sign-0ff

There are no formal policies or procedures in place regarding the review of Submissions by policy experts and whether their sign-off is required prior to the Submission being presented to Treasury Board. In our discussions with analysts, it was evident that there is no common understanding of whether and when policy sign-offs are required and what such sign-offs would signify. This has led to inconsistencies in the way analysts handle policy reviews for submissions. In our test sample of Submissions, 62% were missing at least one policy sign-off.

We recommend that policies and procedures be developed to clearly define what is required for policy expert review and what this sign-off in fact constitutes. The following areas should be addressed:

  • Required policy expert review and sign-off should be completed prior to the Submission being presented to Treasury Board to ensure that all submissions are free from policy issues.
  • In some cases, there may be instances where a review by a policy expert is not required. In these cases, there should be a requirement for the rationale for this decision to be documented.
  • Procedures for filing and archiving the evidence of sign-offs to ensure records for all Submissions are complete, consistent and properly filed should be developed.
  • Ensure that the program analyst and SCDC understand and concur with the procedure for the Pink Jacket. The Pink Jacket's original intent was to ensure the Policy Sectors could review the final submission so that all policy matters have been addressed. Occasionally not all Policy Sectors receive the Pink Jacket, as the program analysts do not always note on the Jacket the Policy Sector that they consulted. This could potentially result in final Submissions going to the Board with outstanding policy matters.
  • The Secretariat should establish procedures and guidelines defining the responsibility for review and follow-up when sign-offs are outstanding.

Management Response

Agreed. Current TBS practice is for Official Languages, the Expenditure Strategies Division, the Expenditure Operations Division as well as the Program Division review and sign-off all TB Submissions. Current procedure is to record these sign-offs on the pink jacket covering every submission that goes to Treasury Board.

In addition, there are many other TBS policy experts who review and sign-off submissions depending on the issues raised. In all cases, the sign-off of the Program Director sponsoring the submission, on the pink jacket, indicates that appropriate policy input has been sought and taken into account in TBS's advice to the Treasury Board.

In addition, TBS has developed a formal internal policy sign-off protocol for TB submissions related to Grant and Contribution Programs. TBS will review this model to assess whether it could be developed for use more broadly as a guideline or tool for TBS Analysts to clearly define what is required for policy expert review including procedures for: review and follow-up when sign-offs are outstanding, and filing and archiving the evidence of sign-offs to ensure records for all submissions are complete.

Director Level Review

There are no procedures that define the responsibility of Directors for reviewing the final précis prior to it being presented to Treasury Board. In our sample of 69 Submissions, the Director or delegate had not signed three of the précis. Thus, it is not possible to confirm that the Director or delegate had reviewed and approved the précis.

We recommend the development of a procedure that outlines the responsibility of Directors to review the précis and Submission as well as the areas that they should ensure are completed prior to signing-off on the précis.

Management Response

Agreed. The Submission and Cabinet Document Centre will not accept a précis unless it has been signed-off by a Director.

In addition, TBS will review its internal procedure for sign-off of the précis of a Submission generated by a branch or sector within TBS to clarify responsibilities.

Decision Letters

There is a requirement that decision letters are issued to the government department within two weeks of the Treasury Board decision. In our test sample, 40% of the decision letters did not meet this deadline.

We recommend procedures be developed to ensure that decision letters are issued within the required time frame to allow departments to proceed with their activities using the accurate and formal documentation of the Treasury Board decision.

Management Response

Agreed. The Secretary will remind TBS management and staff of TBS's performance target to issue decision letters within two weeks of the Treasury Board decision.

The Program Sectors will further streamline existing manual procedures to produce Decision Letters to improve TBS's performance in achieving this target.

In 2004, the Expenditure Management Information System (EMIS) Project Team and the Submission and Cabinet Document Centre will automate the production of Decision Letters as a key feature of a new submission tracking and information module of EMIS.

Definition of Classification

A classification system is used to guide Treasury Board Ministers in the review a particular Submission. The Analyst handling the Submission initially assigns the classification. There is guidance available through discussions with other analysts and unofficial documents such as "A Program Analyst Survival Guide". There is no formal readily available definition of the criteria for these classifications.

The lack of a formal readily available definition of criteria for these classifications could lead to inconsistencies or inappropriate classifications of Submissions. This is mitigated to some extent since the classification is reviewed by the analyst's director and at executive meetings prior to the Submission being presented to Treasury Board. Without formal definitions, the process could be subjective.

We recommend a formal definition for each of the classifications should be widely and continuously disseminated to help ensure that Submissions are properly and consistently classified.

Management Response

Agreed. TBS will review and update as necessary definitions of the criteria used to structure agendas for Treasury Board meetings.

The Submission and Cabinet Document Centre and the Learning and Knowledge Management Team within the Program Sectors will communicate and promote more widely a common understanding of the updated definitions.

4.1.2 Analyst Turnover

The role of the analyst is critical to ensure that the précis and, to the extent possible, Submissions are properly prepared before they are presented to Treasury Board. Based on our interviews, there has been a high level of turnover of analysts in recent years. This high level of turnover means that there are many inexperienced analysts, which increases the risk that appropriate review may not be performed on Submissions. As well inconsistent training and a lack of formal guidance material make it more difficult for new analysts to understand what they are required to do. While there is material available to assist them to understand their role, many of the analysts we interviewed were not aware of what was available or were not referencing it. Some of the departments interviewed indicated that the TBS analysts they deal with are not always adequately trained.

Although there is training available for new analysts, referred to as Boot Camp, as well as a workshop covering the information they need to know for reviewing Submissions and preparing précis, it was evident from our interviews that not all new analysts attended the training prior to being required to assist with submissions.

We recommend that formal procedures be developed to ensure that new analysts receive initial training in advance of being required to assist with Submissions. For an introductory period, analysts should be required to review the available guidance and material prior to being asked to review any Submissions. If it is not feasible for new analysts to attend the training, they should be required to review the virtual versions of the training on-line. New analysts should also be required to review other guidance material available through the Intranet prior to reviewing Submissions.

We recommend that a mentoring system be formalized for the entire Secretariat to ensure that new analysts have access to experienced analysts to provide guidance and answer questions as needed. While there are mentoring programs in place within the Sectors, they are not necessarily formalized and may therefore be inconsistent and not as effective as possible. During our interviews with new analysts, they indicated that the more experienced analysts were often too busy to be able to provide them with the mentoring they required.

We recommend that the Secretariat develop a process anticipating that there will be turnover of analysts and implement a knowledge transfer process to ensure that information from departing analysts is retained and accessible.

We recommend that the Secretariat improve information systems and documentation of Submissions as discussed in this document, to help facilitate the transfer of knowledge as analysts change.

We recommend that the Secretariat consider measures to encourage retention of analysts for a longer period of time.

Management Response

Agreed. New TBS analysts receive initial training and orientation in advance of assisting with the analysis of a TB Submission.

In addition, the Learning and Knowledge Management Unit within the Program Sectors will continue to offer "Program Analyst Boot Camps" to orient all new program analysts to their role as well as a variety of internal workshops, sessions and courses on how to analyse TB Submissions and Memoranda to Cabinet, develop their negotiating skills, as well as technical instructions on all phases of the Government's Expenditure Management System.

Over the past two years, TBS has worked hard to develop programs to support recruitment and retention of TBS analysts including a mentoring system and succession planning for the entire Secretariat. Throughout 2003, these programs have become embedded and formalized across the Secretariat.

Through the implementation of RDIMS, TBS, and in particular the Program Sectors, have been able to standardize and better coordinate the electronic repositories of documentation related to TB submissions to help facilitate the transfer of knowledge to new analysts as analysts change. More fundamentally, TBS is developing a new Expenditure Management Information System (EMIS) that will provide improved information management and analytical support to TBS Analysts.

Observations Rated Medium Risk

4.1.3 Treasury Board Policies

Treasury Board has numerous policies (300+) that may be appropriate to consider when preparing and reviewing a Submission. There is a key group of policies that analysts usually consider when they are preparing or reviewing Submissions. While some of the key policies are listed in the Treasury Board Submission guide, this is not a comprehensive resource for assessing which policies should be considered for a particular Submission. Guidance on policies is also available on the Secretariat's Intranet site that can be accessed by analysts. Based on our interviews, the analysts are not consistently using this information and are not always aware that it exists. Due to the number of different policies, analysts can have difficulties in determining the specific policy instruments that are particularly applicable to an individual Submission.

The Treasury Board Secretariat has launched a major review of its total policy suite with a view to reducing and enhancing the relevance of policy instruments and reports, improving the accessibility of policy instruments and targeting them to appropriate audiences. This review may well result in a significant reduction in the number of policy instruments and a greater clarification of their objectives.

Until such a time as the review is complete, we recommend consideration be given to reviewing why analysts may not be using available policy information and taking the necessary steps to ensure that there is a practical guide or road map available on the Treasury Board policies.

Management Response

Agreed. TBS will ensure that all future TBS orientation programs, Program Analyst Boot Camps and various other training and information sessions for TBS analysts who deal with TB submissions provide an overview of the TB Policy suite including a walk through of the TBS intranet site where more detailed information on all TB policies can be found.

In addition, as work on the TB Policy Suite progresses and new policy instruments come on line, TBS will develop and deliver a calendar of learning and information sessions to both TBS analysts and horizontal communities most affected by the policy change to ensure a deeper knowledge and understanding of the objectives of these policies.

4.1.4 Risk Matrix

The Secretariat has implemented a new risk matrix to assist Treasury Board ministers in determining the relevant risk associated with a Submission. According to some of the analysts interviewed, the criteria for the risk matrix are judgemental, not well defined and not a useful tool to assist them when determining the rating for the Submissions. As the Board members are placing reliance on this rating, the Secretariat has to ensure that the assessment of risk is applied consistently and is a meaningful tool to define the level of risk.

We recommend that the criteria to assess the risk for the matrix be revised to be more objective and useful to assist analysts when determining the level of risk.

Management Response

Agreed. Throughout the fall of 2003, TBS will identify the "lessons learned" after more than one year of experience with its Risk Matrix and will fine-tune and revise the criteria and ensure they are objectively and consistently applied to all TB submissions.

4.1.5 Storage of Paper Copies of Submissions

The original copies of the Submissions are filed in the Submission and Cabinet Document Centre (SCDC). During our initial visit to the SCDC, the door was unlocked and once inside, there was no other security in place, although SCDC staff was present and would have noticed if someone entered the filing room. Since our visit, the recently installed card access system has been repaired thus only people with building access can enter the SCDC area.

Treasury Board Submissions are classified as "Confidence of the Queen's Privy Council" and as such require appropriate security.

We recommend that access to SCDC at all times be restricted to people with a Secretariat Building pass. As well, we recommend that access to the paper copies of Submissions be further restricted to authorized personnel only.

Management Response

Agreed. Access to Submission and Cabinet Document Centre is restricted to people with a Secretariat building pass.

Access to the paper copies of Submissions has been further restricted to authorized personnel only.

4.1.6 Submission Time Line

Currently the deadline for final Submissions to reach SCDC from the departments is noon on the Monday eight working days prior to the Treasury Board meeting when it is to be considered. The deadline for the final translated précis to reach SCDC is noon the following Friday, 4 days prior to the Treasury Board meeting. Since the department may make changes to the Submission, the analyst cannot finalize the précis until the final Submission is received. This results in a short time line for the analysts to finalize the précis and have it translated. As a result, the Friday noon deadline is frequently missed for a Submission that is on the Treasury Board agenda. SCDC then has to courier additional information to the Ministers after the binders with the Submissions have been issued but prior to the Treasury Board meeting.

We recommend the time line for receiving final Submissions be revised to allow adequate time to complete the necessary procedures in advance of the Submissions being sent to the Treasury Board Ministers.

Management Response

TBS revised its deadlines for receipt of the final Treasury Board submissions in 2001 to reflect a balance between meeting reasonable scheduling demands of departments and allowing adequate time for analysts within the Secretariat to perform the due diligence necessary to advise TB Ministers.

It is also understood that it is not always feasible for departments to respect existing submission timelines when the submission is driven by unplanned, urgent government or Cabinet priorities and the strict deadlines imposed by the government's supply calendar. TBS philosophy has and will continue to be, to accommodate these urgent situations when it is reasonable to do so.

TBS believes that the current approach is achieving a reasonable balance and that an additional year's experience would be useful before undertaking a further review of its deadlines for final submission in 2004-05.

Observations Rated Low Risk

4.1.7 Support Available to Departments to Assist with Preparation of Submissions

Based on our interviews, it is apparent that some departments are not familiar with the requirements for preparing Submissions and require extensive help from Secretariat analysts before their Submission is ready to be presented to Treasury Board. While there are resources available to assist departments develop expertise in Submission preparation, they do not appear to be extensively used.

The Secretariat has prepared a Guide to Preparing Treasury Board Submissions, which is available to all government departments to assist them with the preparation of Submissions. Our discussions with representatives from a sample of five departments indicated that this guide was not being extensively used.

There is also training available through Training and Development Canada called "Preparing Treasury Board Submission and Cabinet Documents". The departmental analysts we interviewed did not indicate that they were aware of the availability of training. As well, we obtained feedback from TBS analysts that many departmental analysts are not familiar with the requirements for preparing Submissions indicating that they likely have not attended the available training.

We recommend the Secretariat consider conducting a survey of departments to ascertain why the guide is not being used extensively and why departments are not taking advantage of the available training. Consideration should be given to making changes based on the survey to improve the level of expertise within departments for preparing Submissions.

Management Response

Agreed. The Secretary will remind TBS management and staff to actively communicate and promote the "Guide to Preparing Treasury Board Submissions" and the training available through Training and Development Canada as supports available to departments to prepare Treasury Board Submissions.

TBS will also consult with departments to determine the best approach to assist departments in the preparation of Treasury Board Submissions in the context of broader consultation initiatives with departments.

4.1.8 Communication of Analyst Comments

The current process does not have a formal cut-off point for the Secretariat to send comments to departments on their draft Submission. Since departments are not certain when they have received all comments, there is a risk that a department may forward a Submission to its Minister for signature and then have to recall the signed Submission to insert additional information to reflect the most recent comments.

We recommend the Submission process timeline reflect a cut-off date by which time any Secretariat comments on the Submission are to be provided to the department. This will allow a department to know all comments have been received prior to forwarding a Submission to their Minister for signature. To achieve this, the Secretariat should establish a process to ensure all review procedures for the draft Submission have been completed prior to the cut-off date. With a clearly defined timeline for the review process and then communication with the departments, all parties will have a clear expectation of the process thus minimizing the risk of error.

Management Response

Consistent with the TBS management response to recommendation 4.1.6, TBS will include a review of the need for a cut off date by which time any Secretariat comments on the Submission are to be provided to the department in its review of deadlines for final submissions in 2004-05.

4.1.9 Electronic Tracking and Storage of Submission Information

Currently, there are several systems used by the Secretariat to track and record information about Submissions including the Submission Tracking System, Expenditure Status Report, RDIMS and TARS. Information management is inefficient due to the systems not being linked requiring duplication of information in each system and the lack of one system containing all of the information about a Submission. This creates extra work updating each system as well as making it difficult to find out information about a particular submission, which may require access to several different sources. Nor is there one system that contains all the information about a Submission, which would provide a complete record for each Submission. An additional area of concern relates to the adequacy of the security of the systems being used to store Submission information. Only the Submission Tracking System has an appropriate level of security for information, which is "Confidence of the Queen's Privy Council". It is not clear whether Submission information should be entered into the other systems since they may not be properly secured.

We recommend TBS consider developing a system that can be used for all aspects of tracking and recording Submission information. All of the information relating to a Submission would be stored on this system ensuring that there is a complete record for all Submissions. The system would be designed to generate the various Submission documentation including the précis and decision letter reducing the need for duplicate entry. This system would need to have the appropriate level of security for Submission information.

Alternatively, we recommend the Secretariat consider developing a process to ensure that all systems and documents are updated as required. This may involve requiring analysts to make the necessary updates or using administrative support to make the updates. Policies and procedures would need to be developed to ensure that it is clear what information is required to be entered into which system, by whom and when. As well, the issue of the security of the information needs to be addressed.

Management Response

TBS will ensure that over the medium term all aspects of TB submission information will be tracked, recorded and linked to the new Expenditure Management Information System (EMIS) discussed in our response to recommendation 4.1.2.

4.1.10 Archived Submissions

The final Submission file consisting of the Submission, decision letter/turnaround, précis, and sign-offs are archived after three years. As the sign-offs are typically not sent to SCDC, they are not being archived with the final Submission. This results in an incomplete Submission file. As past Submissions are sometimes retrieved for additional review or information, if the file is incomplete, it may be difficult to follow and may not have all the necessary information.

We recommend that the documents noted above be sent to SCDC when the Submissions are finalized so as to ensure that all archived files are complete. A formal policy should be developed which outlines the requirements for archiving and what documents should be included in the archived file.

Management Response

Throughout the fall of 2003, TBS will review its procedures for filing Treasury Board Submissions and revise as necessary to ensure that all archived files are complete

4.1.11 Volume of Submissions

The large volume of Submissions presented to Treasury Board for approval creates an enormous workload on program analysts. There was some speculation amongst analysts that some of this workload was self-inflicted due to new policies that call for Treasury Board approval when a bureaucratic solution may have been appropriate; by attaching conditions, which require subsequent approval by Ministers; and by existing requirements for Treasury Board approval that may be outdated. We recommend that the Secretariat study the reason for the high volume with the aim of reducing the number of Submissions.

Management Response

The volume of TB submissions expected in the future will be significantly affected by changes to the Treasury Board Policies as a result of the review that is currently underway as well as new requirements for Treasury Board approval emerging from its new responsibility for conducting a 5-year cycle of Expenditure and Management Reviews across Government, announced in Budget 2003.

The Stewardship business line of TBS has established a "Workload Reduction Team" mandated to provide advice on immediate, medium and long term and ongoing measures to reduce workload at the Treasury Board Secretariat including identifying opportunities to reduce the number of TB submissions required. Their report will be presented to Stewardship and TBS management for consideration in the fall of 2003.

4.1.12 Availability of Human Resources

One of the objectives of this report was "assessing whether resources appear to be adequate and effective ...". This objective involved assessing many elements of resources including adequacy of staff training, availability of information resources and appropriateness of tools available to support the Submission process. One element of the adequacy and effectiveness of resources is the availability of sufficient human resources to meet the volume of work within the Submission process.

Through the interviews conducted for this audit, it was evident that many people involved with the Treasury Board Submission process are periodically working long hours to ensure that the Submissions are ready for presentation to Treasury Board as scheduled. Many of the recommendations included in this report may improve the efficiency of the Submission process potentially reducing the workload of the analysts.

Once changes have been implemented to improve the efficiency, we recommend that the Secretariat consider undertaking a study of requirements of the Submission process given the volume of Submissions to determine whether the resources available are appropriate given the level of activity.

Management Response

TBS will reconsider the need to review the TB Submission process in 2005-06 to determine whether the resources available are appropriate for the volume and nature of TB Submission activity at the time. That is; once all of the changes discussed above to improve efficiency of the process have been implemented.

 




Annex A

Provided below is a list of the Secretariat employees that we interviewed and/or performed testing with, as part of our audit.

Name Title Sector
Pierre Labelle Submission and document Control Submission and Cabinet Document Centre
John Hartin Senior Analyst Government Operations Sector
Jean Burns Finance and Correspondence Comptrollership - DCG's Office
Alec Attfield Senior Analyst Economic Sector
Tony Dittenhoffer Senior Analyst Social and Cultural Sector
Frank Lofranco Principal Analyst Economic Sector
Denise Stevens Senior Analyst Social and Cultural Sector
Danielle Rosmarin Analyst Social and Cultural Sector
Catherine Newell Senior Analyst Economic Sector
Caroline Leclerc Senior Analyst Government Operations Sector
Elisa Mayhew Senior Analyst Government Operations Sector
Robert Dykstra Senior Analyst Government Operations Sector
Sharon Smith Senior Analyst Government Operations Sector
Scott Pittendrigh Analyst Economic Sector
Michel Guay Senior Financial Analyst Expenditure Operations & Estimates
Mary Jane Jackson Director Expenditure Strategies
Kim Elliot Senior Analyst Comptrollership Financial Management Policy
Jennifer Crich Analyst Government Operations Sector
Anne Lipman Principal Analyst Active Monitoring Coordination Centre
Joanna Nowakowski Analyst Active Monitoring Coordination Centre
Lorraine McCollum Analyst Real Property and Materiel Policy Directorate
Roman Klimowicz Principal Analyst Government Operations Sector
Renee-Marie Vanasse Senior Analyst Economic Sector
David Bickerton Executive Director Expenditure Operations and Estimates
Jane Cochran Executive Director Procurement and Project Policy
Blair James Executive Director Real Property and Materiel Policy
Bill Austin Assistant Secretary Social and Cultural Sector
Maryanne Boughner Senior Policy Analyst Procurement and Project Management Directorate
Andrew Treusch Assistant Secretary Economic Sector
Ross Hornby Assistant Secretary Government Operations Sector
Christiane Talbot-Horne Program Director Social and Cultural Sector
Barbara Jordan Program Director Economic Sector
Mike Joyce Assistant Secretary Expenditure and Management Strategies Sector
Ruta Danaitis Principal Analyst Social and Cultural Sector
Alfred Tsang Program Director Government Operations Sector
Jennifer Lew Analyst Government Operations Sector
Doug Shaw Senior Analyst Government Operations Sector

Provided below is a list of the contacts at Government Departments that we interviewed as part of our audit.

Name Title Department
Peter Traversy Director, Financial Analysis and Program Review Indian & Northern Affairs Canada
Om Kaura Manager, Policy Research and Advisory Services Indian & Northern Affairs Canada
Pierre Faucher Director, Financial Management Transport Canada
Corrine Chisamore Senior Evaluation Officer Transport Canada
Rob Brun del Re Director, Financial Management Transport
Jeff Parker Executive Director, Technology Partnerships Industry Canada
John Brunet A/Deputy Executive Director, Technology Partnerships Industry Canada
Sonya Heikkila Director, Corporate Services National Defence
Micheline Gauthier Manager, Corporate Services National Defence
Louise Holmes Manager, Treasury Board Submissions and Investment Analysis Public Works and Government Services Canada

Endnotes

1. Background obtained from the information contained on the Treasury Board  Secretariat website. [ Return ]

2. Submission and Cabinet Document Centre. [ Return ]

3. As a number of criteria related to documented policies and procedures ("P&P") at the departmental level, we have isolated these recommendations within the table above. [ Return ]