Evaluation of the PAHO/WHO Training Workshop on Guideline Development Methods, 16-17 September 2010 Coordination The Research Promotion and Development Team - Health Systems Based on Primary Health care (HSS)
Objectives The workshop was conducted by Dr. Holger J. Sch端nemann and Nancy Santesso from the Department of Clinical Epidemiology and Biostatistics at McMaster University. The workshop responds to the findings of the evaluation of PAHO/WHO guidelines (presented at the Managers Meeting in Quito, at the Advisory Committee on Health Research, and at the PAHO Meeting on Technical Guidelines in April 2009). Activities for the improvement of guidelines have been implemented at WHO-Headquarters, and this was the first regional office to implement them.
Summary of commentaries and /questions about guideline development in PAHO: During the sessions, participants raised and discussed a number of issues concerning the production of guidelines in PAHO:
-
How will PAHO develop and implement procedures for guideline development that ensure that guidelines are consistent with internationally accepted best practices?
-
Defining appropriate and standardized processes related to guideline development in PAHO
-
Exploring ways to ensure that PAHO guideline proposals and final manuscripts could be evaluated whether by the WHO Guidelines Review Committee or by a PAHO Guidelines Review Committee.
-
How PAHO will coordinate and provide support to departments producing guidelines
-
Including speaking Spanish, Portuguese and French members as part of the WHO Guidelines Review Committee.
-
Ensuring that all guidelines prepared by PAHO staff comply with the WHO handbook for developing Guidelines
-
Developing and implementing a plan to ensure that the staff developing guidelines in PAHO have appropriate knowledge of the approved methods for guideline development.
-
Monitoring the quality of PAHO guidelines
-
Creating a repository of PAHO guidelines as well as country developed guidelines in the region in the Virtual Health Library.
Summary of the training course evaluation Twenty two participants attended the two-day workshop on "Guideline Development Methods" held in 16-17 September 2010 at the Washington DC PAHO Headquarters. The purpose of the workshop was to promote the implementation of recommended processes for technical documents and guidelines using scientific research evidence.
Fifteen of the attendees (68%) filled an evaluation form. The results from the evaluation the PAHO/WHO Training Workshop on Guideline Development are presented.
Overall, how would you rate this workshop? Only 30% of those attendees that filled the survey had prepared guidelines before attending the workshop. Overall, participants agreed that the objectives of the workshop were met. However, a lower proportion of attendees agreed that there was sufficient time allocated for interactive learning. A more detailed description of the results of the evaluation are reported in box 1: Box 1. Overall, how would you rate this workshop?
Disagree Agree Median .. Range [ ]
The objectives of the workshop were clear.
1
2
[3
4
5]
The content of the workshop met the objectives.
[1
2
3
4
5]
The length of the workshop was appropriate.
[1
2
3
4
5]
There was sufficient time allocated for interactive learning.
[1
2
3
4
5]
The workshop increased my knowledge of how to conduct a Cochrane review.
1
[2
3
4
5]
Usefulness of sessions Overall participants rated the usefulness of each session positively: How useful were the following sessions?
not useful very useful
Overview of guideline development and scoping the guideline
1
2
[3
4
5]
Guideline group: Function and composition Group Process and consensus methods, voting and how to present controversies
1
2
[3
4
5]
Conflict of Interest: What it is, why it is important and how to manage it
1
2
[3
4
5]
Formulating questions and choosing outcomes
1
2
[3
4
5]
Small group work and discussion – question and outcomes formulation
1
2
[3
4
5]
Evidence retrieval and synthesis: Systematic review basics and practicalities
1
[2
3
4
5]
Introduction to assessing the quality of evidence and grading recommendations
1
2
[3
4
5]
An introduction to evidence assessment (see note 1) Using and preparing GRADE tables
1
2
[3
4
5]
Small group work and discussion, then feedback.
1
2
[3
4
5]
Assessing resource use and costs for guidelines
1
2
[3
4
5]
Incorporating values and preferences
1
2
3
[4
5]
Formulating and grading recommendations
1
2
3
[4
5]
Small Group work and discussion: Developing Recommendations
1
2
[3
4
5]
Peer reviewing and publishing your guideline
1
2
[3
4
5]
Take home messages, wrap up
1
2
[3
4
5]
What did you like about this workshop? Response
Participants
Teachers – top experts in the field
XXXXXXX
The interactive learning
XXXXX
Capacity building (Knowledge)
XXXXX
Methodology of workshop
XX
Timing
XX
GRADE-pro:
XX
Adapted for WHO/PAHO environment
XX
What could be improved about this workshop? More interactive
XXXX
Hands-on training
XXXX
More realistic agenda
XXX
More Small groups and discussion
XXX
More time for GRADEpro training
XXX
Readable Materials and earlier distribution
XX
Little time for learning each step
XX
Lack of Public Health/policy examples
XX
More details on the processes for guideline
XX
development Better Slides
X
Presentations rushed/tedious
X
Too Highly technical information
X
Compliance with schedule
X
Executive summary of the material to be used
X
Time for asking practical questions
X