Evaluation design, planning, and tool development is still in process for the 2023 Bree guidelines on Diabetes Care. If you are interested in participating in the evaluation design process, please contact Karie Nicholas, Evaluation and Measurement Manager, at knicholas@qualityhealth.org.

The evaluation design, planning and tool development is currently in progress, in parallel with the report creation. The design for evaluations is anticipated to be completed in the Fall of 2024 for:

• Behavioral Health: Early Intervention for Youth
• Health Effects of Extreme Heat & Wildfire Smoke
• Treatment for Opioid Use Disorder (OUD) Revision

If you are interested in participating in the design process, please contact knicholas@qualityhealth.org. If you are interested in participating in the evaluation, please check back for more information.

The Bree Collaborative has developed a new evaluation design process for all new guidelines. The evaluation subcommittees will create an evaluation plan and tools, in parallel with the guidelines development, that the Bree staff will operationalize.

We are using both qualitative and quantitative methods for evaluation of our guidelines and are interested in evaluating five broad areas of our work:

1. Guideline usefulness and clarity
2. Uptake and Concordance of Care
3. Barriers and facilitator
4. Equity
5. Metrics and impact of guideline

We have developed a multi-pronged approach to data collection. Some of our standard methods include:

• Health System Surveys: Sent out through partners and contacts to be filled out by any health system stakeholder. The purpose of this survey is to collect data on stakeholder perceptions of the usefulness of the guidelines and to better understand barriers and facilitators for specific audiences. This data is used to inform changes to the Bree process, to identify topics to address during guidelines creation, and to identify organizations for further evaluation purposes. A copy of this survey can be found HERE
• Data Capacity Surveys: sent out through partners and contacts to be filled out by individuals responsible for implementing or managing IT services. The purpose of this survey is to collect data on IT roles perceptions of the usefulness of the guidelines and to better understand barriers and facilitators for specific audiences. This data is used to inform changes to the Bree process, to identify topics to address during guidelines creation, and to identify organizations for further evaluation purposes. A copy of this survey can be found HERE
• Evaluation “score cards”: Designed in conjunction with new guidelines, the purpose of this method is to collect data on which guidelines are being used, the extent to which care processes are concordant with the guidelines. Score Cards can be found in our IMPLEMENTATION GUIDE.
• Evaluation Survey Question Bank: This tool can be found on our website. It is modeled after the CDC Question Bank and allows multiple organizations to use the same questions when they perform PDSAs or evaluate programs or implementation projects. The aim of the question bank is to help organizations use validated questions or survey tools and reduce the burden of evaluation work and improve the validity of their findings.Our Question Bank can be found HERE
• Case Studies: Each year the Bree chooses a topic area to develop new case studies that can illustrate impact and demonstrate the “how to” of implementation.