Policy Coalition Evaluation Tool (PCET)

Constructs Assessed:

Constructs assessed by the assessment instrument (linked to constructs included in the D&I models webtool)

• Context – Inner setting
• Context – Outer setting
• Fit
• Identification
• Implementation
• Innovation characteristics
• Sustainability
• Outcomes – Quality Improvement/Practice or Policy Change
• Process
• Stakeholders

Theories, Models, Frameworks Relevant:

The D&I TMFs relevant for the assesment instrument based on constructs assessed

• ACE Star Model of Knowledge Transformation
• Active Implementation Framework
• Adherence Optimization Framework
• Advancing health disparities research within the health care system
• Availability, Responsiveness & Continuity (ARC): An Organizational & Community Intervention Model
• Behaviour Change Wheel
• Blueprint for Dissemination
• CDC DHAP's Research-to-Practice Framework
• Caledonian Practice Development Model
• Canadian Institutes of Health Research Knowledge Translation within the Research Cycle Model or Knowledge Action Model
• Choosing Wisely Deimplementation Framework
• Collaborative Model for Knowledge Translation Between Research and Practice Settings
• Community Based Participatory Research (CBPR)
• Conceptual Framework For The Comparative Analysis of Policy Change
• Conceptual Framework for Research Knowledge Transfer and Utilization
• Conceptual Model of Implementation Research
• Conceptual Model of Knowledge Utilization
• Conceptualizing Dissemination Research and Activity: Canadian Heart Health Initiative
• Conduct and Utilization of Research in Nursing (CURN)
• Consolidated Framework for Implementation Research (CFIR)
• Consolidated Framework for Implementation Research (CFIR) 2.0
• Context and Implementation of Complex Interventions (CICI) framework
• Convergent Diffusion and Social Marketing Approach for Dissemination
• Coordinated Implementation Model
• Critical Realism & the Arts Research Utilization Model (CRARIUM)
• Davis' Pathman-PRECEED Model
• Designing and evaluating interventions to eliminate racial and ethnic disparities in health care
• Dissemination and Implementation Framework for an Early Childhood Obesity Prevention Program
• Dissemination of Evidence-based Interventions to Prevent Obesity
• Dynamic Sustainability Framework
• EMTReK - Evidence-based Model for the Transfer and Exchange of Research Knowledge
• EQ-DI Framework
• Effective Dissemination Strategies
• Evidence Integration Triangle
• Exploration, Preparation, Implementation, Sustainment (EPIS) model (Conceptual Model of Evidence-based Practice Implementation in Public Service Sectors)
• Facilitating Adoption of Best Practices (FAB) Model
• Framework for Analyzing Adoption of Complex Health Innovations
• Framework for Dissemination of Evidence-Based Policy
• Framework for Enhancing the Value of Research for Dissemination and Implementation
• Framework for Knowledge Translation
• Framework for Spread
• Framework for Translating Evidence into Action
• Framework for the Dissemination & Utilization of Research for Health-Care Policy & Practice
• Framework for the Transfer of Patient Safety Research into Practice
• Framework of Dissemination in Health Services Intervention Research
• General theory of implementation
• Generic Implementation Framework
• Greenhalgh Diffusion of Innovations in Service Organizations
• Health Equity Implementation Framework
• Health Promotion Research Center Framework
• Health Promotion Technology Transfer Process
• Implementation Effectiveness Model
• Interacting Elements of Integrating Science, Policy, and Practice
• Interactive Systems Framework
• Intervention Mapping
• Johns Hopkins Nursing Evidence-Based Practice Model and Guidelines
• Kingdon's Multiple-Streams Framework
• Knowledge Exchange Framework
• Knowledge Transfer and Exchange
• Linking Systems Framework
• Model for Improving the Dissemination of Nursing Research
• Model for Locally Based Research Transfer Development
• Model for Predictors of Adoption
• Normalization Process Theory
• Organizational Theory of Innovation Implementation
• Ottawa Model of Research Use
• OutPatient Treatment in Ontario Services (OPTIONS) Model
• Pathways to Evidence Informed Policy
• Practical, Robust Implementation and Sustainability Model (PRISM)
• Pragmatic-Explanatory Continuum Indicator Summary 2
• Precede-Proceed Model
• Process Model of Implementation from a Policy Perspective Depicting the Process at One Policy Level
• Proctor's Implementation Outcomes
• Promoting Action on Research Implementation in Health Services (PARIHS)
• Pronovost's 4E's Process Theory
• Push-Pull Capacity Model
• RAND Model of Persuasive Communication and Diffusion of Medical Innovation
• RE-AIM 1.0 Framework
• RE-AIM 2.0/Contextually Expanded RE-AIM
• Real-World Dissemination
• Replicating Effective Programs Framework
• Research Development Dissemination and Utilization Framework
• Research Knowledge Infrastructure
• Six-Step Framework for International Physical Activity Dissemination
• Sticky Knowledge
• Streams of Policy Process
• Technology Transfer Model
• The SPIRIT Action Framework
• Transcreation Framework for Community-engaged Behavioral Interventions to Reduce Health Disparities
• Translational Framework for Public Health Research
• Translational Research Framework to Address Health Disparities
• US Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI)
• Utilization-Focused Surveillance Framework
• Weiner organizational readiness
• conNECT Framework

Implementation Outcomes:

The relevance of the assessment instrument to various implementation outcomes

• Acceptability
• Appropriateness
• Feasibility
• Implementation
• Sustainment

Implementation Strategies:

The implementation strategy/ies evaluated by the assessment instrument

• Adapt and tailor to context
• Develop stakeholder interrelationships
• Engage consumers
• Provide interactive assistance
• Train and educate stakeholders
• Utilize financial strategies
• Use of evaluative and iterative strategies

Phase of Implementation Process:

Phase of implementation process when the assessment instrument can be used

• Implementation
• Sustainment

Levels of Data Collection:

The level(s) from which the assessment instrument collects data

• Policy

Intended Priority Population:

Intended priority population from whom data are collected using the assessment instrument

• Administrator
• Public Health Practitioner

Intended Priority Setting:

Intended priority setting in which the assessment instrument is used

• Public Health Agency

Policy:

Assessment instrument is relevant to policy

• Public (Laws, Regulations)

Equity Focus:

Scoring:

The assessment instrument produces a composite score

Norms:

Measures of central tendency and distribution for the total score are based on small, medium, large sample size

Responsiveness:

The ability of the assessment instrument to detect change over time (i.e., sensitivity to change or intervention effects).

Validity:

The extent to which an instrument measures what it is intended to measure accurately.

Reliability:

The extent to which results are consistent results over time, across raters, across settings, or across items intended to measure the same thing.

Factor Analysis:

A statistical method that uses the correlation between observed variables to identify common factors.

Time to Administer:

The amount of time required to complete the assessment instrument

Uses Secondary Data:

Assessment instrument relies on a secondary data source

Cost:

Cost associated with access to assessment instrument (Some instruments might require login.)

Literacy:

Readability of the items reported on.

Interpretation:

Expertise needed for interpretation of data is reported.

Training:

Expertise needed to use the assessment instrument is reported

Resources Required to Administer:

Resources needed to administer the assessment instrument (FTE for data collector, equipment, etc.)

User Guidance:

Guides are provided to support administration of assessment instrument/data collection, and/or analysis of data from the assessment instrument, and/or interpretation of data, and/or action/decision on how to use data

• Guidance to Administer

Obtrusiveness:

Degree of intrusion the participants will experience because of the data collection when using the assessment instrument (e.g., assessment instruments that rely on use of secondary data or automated data will be less obtrusive)

• High: Observation and syncronous collection of data

Interactivity:

Data collection and/or result generation involves interactive components.