Measure constructs
This section of the webtool provides a list of constructs affiliated with D&I models included in this webtool. Additional information on each construct is provided when clicking the Description.
Measure links are providing direct access to the Dissemination and Implementation Measures Initiative Workspace at the NCI Grid-enabled Measures Database (D&I GEM). To access D&I GEM, you will need to register and login.
D&I Measure can also be found at the Society of Implementation Research Collaboration Implementation Science Instrument Repository which can be accessed with a membership.
![]() Construct | ![]() | ![]() Number of Models | ![]() Measure |
---|---|---|---|
Acceptability/feasibility Description ![]() | Acceptability: Perception among implementation stakeholders that a treatment, service, practice or innovation is agreeable, palatable, or satisfactory….[D]different from the larger construct of service satisfaction…it is more specific, referencing a particular treatment or set of treatments, while satisfaction typically references the general service experience." Stakeholders need specific knowledge about aspects or components of the treatment/innovation are needed in order for acceptability to be assessed. Acceptability should be considered in conjunction with other constructs throughout the implementation process (e.g. acceptability must be considered for adoption during the early stages).
Feasibility: The extent to which a new treatment, or an innovation, can be successfully used or carried out within a given agency or setting. Related to appropriateness but may include other concerns specific to an agency or organization like resources or staff training needs. Feasibility should be considered during the early stages of implementation during adoption. | GEM D&I link: Acceptability GEM D&I link: Feasibility | |
Adaptation and evolution Description ![]() | For the success of D&I, interventions often need to be adapted to fit the local context (i.e., needs and realities). Adaptation is defined as the degree to which an evidence-based intervention is changed or modified by a user during adoption and implementation to suit the needs of the setting or to improve the fit to local conditions. The need for adaptation and understanding of context has been called Type 3 evidence (i.e., the information needed to adapt and implement an evidence-based intervention in a particular setting or population). Ideally, adaptation will lead to at least equal intervention effects as is shown in the original efficacy or effectiveness trial. To reconcile the tension between fidelity and adaptation, the core components (or essential features) of an intervention (i.e., those responsible for its efficacy/effectiveness) must be identified and preserved during the adaptation process. | GEM D&I link: Adaptation and Evolution | |
Adopter/implementer/decision maker characteristics Description ![]() | The characteristics, attitudes, and behaviors of individuals within an adopting organization include position in the organization, education, individual concerns and motivations and may determine the uptake and use of an innovation. Rogers classifies the individual adopters according to their degree of innovativeness into five categories: (1) innovators, (2) early adopters, (3-4) early and late majority, and (5) laggards. | GEM D&I link: Adoption GEM D&I link: Adopter Attitudes | |
Adoption Description ![]() | The intention, initial decision, or action to try or employ an innovation or evidence-based practice. Adoption also may be referred to as ‘‘uptake.’’ Adoption occurs in the early to mid implementation stage and is assessed from the organizational or provider perspective. | GEM D&I link: Adoption | |
Awareness Description ![]() | |||
Barriers and facilitators Description ![]() | Individual characterstics and contextual factors and strategies that enhance or impede the dissemination and implementation of evidence-based interventions. | ||
Champion/field agent Description ![]() | Champion: Effective, influential individuals at the implementation site who can facilitate the implementation of the intervention by mobilizing internal support for the presence of strong champions, often correlated with large implementation fidelity.
Change agent: Change agents are representatives of change agencies that are external to an organization or community, and their goal is to influence the innovation decisions of members of the organization or community. Change agents often use opinion leaders from an organization or community to facilitate the dissemination and adoption process.18 | ||
Communication Description ![]() | Formal or informal channels, which employ mass
media, social media, and which may involve personalized face-to-face contact. Links those with knowledge of innovation with those who don't possess knowledge. Mass-media channels: radio, television, newspaper. Interpersonal channels: face-to-face interaction Interactive communication channels: internet | GEM D&I link: Communication | |
Communication channels Description ![]() | Route of message delivery (e.g., mass media, community, interpersonal) or pathways by which intervention is delivered to participants (e.g., face-to-face; small group; telephone). | ||
Compatibility Description ![]() | The degree of tangible fit between meaning and values attached to the intervention by involved individuals, how those align with individuals’ own norms, values, and perceived risks and needs, and how the intervention fits with existing workflows and systems. | GEM D&I link: Compatibility | |
Complexity Description ![]() | Perceived difficulty of implementation, reflected by duration, scope, radicalness, disruptiveness, centrality, and intricacy and number of steps required to implement | GEM D&I link: Complexity | |
Context Description ![]() | Contextual factors may include the political, social, and organizational setting for the implementation of the intervention and include social support, legislations and regulations, social networks, and norms and culture. Understanding the delivery context for the intervention is essential for the success of the D&I and closely linked to the concepts of fidelity and adaptation. | ||
Context - Inner setting Description ![]() | Inner setting includes features of structural, political, and cultural contexts through which the implementation process will proceed. | Edited by Jon 7/12/21GEM D&I link: Context - Inner setting | |
Context - Outer setting Description ![]() | Outer setting includes the economic, political, and social context within which an implementing organization resides. | Edited by Jon 7/12/21GEM D&I link: Context - Outer setting | |
Cost Description ![]() | Cost can refer to multiple aspects of the development, testing, and implementation of an intervention including the intervention's cost-effectiveness, the cost around intervention development, implementation of the intervention, and recruitment of subjects into a trial. Cost information can inform adoption decisions and contribute to comparative effectiveness considerations. | GEM D&I link: Cost | |
Development of an Intervention Description ![]() | GEM D&I link: Intervention Characteristics GEM D&I link: Planning | ||
Dissemination Description ![]() | Active and planned efforts to persuade target groups to adopt an innovation. | GEM D&I link: Dissemination | |
Dose Description ![]() | The amount of the intervention/program delivered | ||
Engagement Description ![]() | Involving appropriate individuals in the implementation and use of the intervention through a combined strategy of social marketing, education, role modeling, training, and other similar activities. | GEM D&I link: Engaging | |
Evaluation Description ![]() | Assessment of the efficacy, effectiveness, dissemination, or implementation of an intervention. | GEM D&I link: Reflecting and Evaluating | |
External Validity/Generalizability Description ![]() | External validity is concerned with the generalizability or real-world applicability of findings from a study and determines whether the results and inferences from the study can be applied to the target population and settings. Standardized and detailed reporting on factors that influence external validity (such as the ones recommended in the RE-AIM framework) can contribute to more successful D&I efforts. | ||
Fidelity Description ![]() | Degree to which an intervention was implemented as it was prescribed in the original protocol or as it was intended by the program developers." Fidelity of the intervention as it is implemented in a "real world" setting may be compared to the fidelity from the original evidence based intervention. Fidelity should be considered within the early and middle implementation stages. | GEM D&I link: Fidelity | |
Fit Description ![]() | The degree to which the characteristics of all evidence-based interventions are compatible with the delivery system structure and values. | ||
Goals Description ![]() | GEM D&I link: Goals | ||
Health Equity Description ![]() | Health equity means that everyone has a fair and just opportunity to be as healthy as possible. This requires removing obstacles to health such as poverty, discrimination, and their consequences, including powerlessness and lack of access to good jobs with fair pay, quality education and housing, safe environments, and health care.
For the purposes of measurement, health equity means reducing and ultimately eliminating disparities in health and its determinants that adversely affect excluded or marginalized groups. Update by Jon | ||
Identification Description ![]() | GEM D&I link: Identification | ||
Implementation Description ![]() | At the setting level, implementation refers to the intervention agents' fidelity to the various elements of an intervention's protocol. This includes consistency of delivery as intended and the time and cost of the intervention. | GEM D&I link: Implementation | |
Innovation characteristics Description ![]() | The objects of D&I activities are interventions with proven efficacy and effectiveness (i.e., evidence-based). Interventions within D&I research should be defined broadly and may include programs, practices, processes, policies, and guidelines. In D&I research, we often encounter with complex interventions (e.g., interventions using community-wide education) where the description of core intervention components and their relationships involve multiple settings, audiences, and approaches. | ||
Knowledge and Knowledge Synthesis Description ![]() | , | ||
Maintenance and Sustainability Description ![]() | Maintenance: The extent to which a program or policy becomes institutionalized or part of the routine organizational practices and policies. Maintenance in the RE-AIM framework also has referents at the individual level. At the individual level, maintenance has been defined as the long-term effects of a program on outcomes after 6 or more months after the most recent intervention contact.
Sustainability: "Extent to which a newly implemented treatment is maintained or institutionalized within a service setting’s ongoing, stable operations." A part of late implementation stages, sustainability of a treatment/innovation can be observed within aspects of organizational culture through "policies and practices." Often there is high sustainability when penetration is strong. Sustainability is also defined as the existence of structures and processes which allow a program to leverage resources to most effectively implement evidence-based policies and activities over time. | GEM D&I link: Maintenance and sustainability | |
Observability Description ![]() | Degree to which the results of an intervention are visible to others | ||
Outcomes Description ![]() | Outcome variables, the end results of evidence-based interventions, in D&I research are often different from those in traditional health research and have to be defined broadly, including short- and long-term outcomes, individual and organizational- or population-level outcomes, impacts on quality of life, adverse consequences, and economic evaluation. Although individual-level variables can also be important (e.g., behavior change variables such as smoking or physical activity), outcome measures in D&I research are typically measured at organizational, community, or policy level (e.g., organizational change, community readiness for change). | ||
Outcomes - Health/QOL/Satisfaction/Clinical Description ![]() | |||
Outcomes - Implementation Description ![]() | The effects of deliberate and purposive actions to implement new treatments, practices, and services. Implementation outcomes have three important functions. First, they serve as indicators of the implementation success. Second, they are proximal indicators of implementation processes. And third, they are key intermediate outcomes in relation to service system or clinical outcomes in treatment effectiveness and quality of care research. Because an intervention or treatment will not be effective if it is not implemented well, implementation outcomes serve as necessary preconditions for attaining subsequent desired changes in clinical or service outcomes. | ||
Outcomes - Quality Improvement/Practice or Policy Change Description ![]() | |||
Patient/target audience characteristics and needs Description ![]() | Individuals who will be impacted by the intervention. For health care and public health interventions, these are often patients, consumers, or community members. These individuals can be, but are most often not, the user of the intervention. | ||
Pre-implementation Description ![]() | GEM D&I link: Planning | ||
Process Description ![]() | |||
Reach Description ![]() | The absolute number, proportion, and representativeness of individuals who are willing to participate in a given initiative. | GEM D&I link: Reach | |
Readiness Description ![]() | |||
Relative advantage Description ![]() | Stakeholders’ perception of the advantage of implementing the intervention versus an alternative solution. This construct includes the concept of visibility or observability of the benefits. | GEM D&I link: Relative Advantage | |
Stakeholders Description ![]() | |||
Strategies Description ![]() | Dissemination strategies describe mechanisms and approaches that are used to communicate and spread information about interventions to targeted users. Dissemination strategies are concerned with the packaging of the information about the intervention and the communication channels that are used to reach potential adopters and target audience. Passive dissemination strategies include mass mailings, publication of information including practice guidelines, and untargeted presentations to heterogeneous groups. Active dissemination strategies include hands on technical assistance, replication guides, point-of-decision prompts for use, and mass media campaigns. It is consistently stated in the literature that dissemination strategies are necessary but not sufficient to ensure wide-spread use of an intervention.
Implementation strategies refer to the systematic processes, activities, and resources that are used to integrate interventions into usual settings. Some authors refer to implementation strategies as core implementation components or implementation drivers and list staff selection, pre-service and in-service training, ongoing consultation and coaching, staff and program evaluation, facilitative administrative support, and systems interventions as components. | ||
Translation Description ![]() | Knowledge translation is the term used by the Canadian Institutes of Health Research (CIHR) to denote "a dynamic and iterative process that includes synthesis, dissemination, exchange and ethically sound application of knowledge."Knowledge translation occurs within a complex social system of interactions between researchers and knowledge users and with the purpose of improving population health, providing more effective health services and products, and strengthening the health care system. | ||
Trialability Description ![]() | The ability to test the intervention on a small scale in the organization, and to be able to reverse course (undo implementation) if warranted. | GEM D&I link: Trialability |