Organizational readiness to change assessment (ORCA)

Qualitative/Quantitative:
The assessment instrument uses quantitative and/or qualitative data

Quantitative

Type of Instrument:
The type of the assessment instrument

Survey

Number of Items:
Number of items in the assessment instrument

Subscale Information:
Names of each of the subscales and the number of items for each of the subscales

Evidence Assessment:
Amount of discord within the practice team about evidence (2)
Research evidence (3)
Clinical experience (3)
Patient preferences (4)

Context assessment:
Senior leadership culture (3)
Staff culture (4)
Leadership behaviour (4)
Measurement (leadership feedback) (4)
Readiness for Change/Opinion leaders (4)
General resources (4)

Facilitation Assessment:
Senior leaders practices (4)
Champion characteristics (4)
Leadership implementation roles (4)
Implementation team roles (4)
Implementation plan (4)
Project communication (4)
Project progress tracking (4)
Project resources and context (6)
Project evaluation (5)

Language Availability:
Language(s) in which the assessment instrument is available

English

Brief Description:
Brief summary description of assessment instrument

The Organizational Readiness to Change Assessment (ORCA) measures organizational readiness to implement evidence-based practices in clinical settings. It consists of three major scales that measure: 1. Strength of the evidence for the proposed change/innovation; 2. Quality of the organizational context to support the practice change; and 3. organizational capacity to facilitate the change.

Website:
Website providing access to and/or describing the assessment instrument

National Collaborating Centre for Methods and Tools

Instrument and/or related documentation:
Related files uploaded (instrument if directly available) including descriptions for each

Organizational readiness to change assessment (ORCA).pdf (178.92 KB) - Instrument Attachment

Citing Literature - Development/Original:
Reference for publication describing the development of the assessment instrument

Helfrich, C. D., Li, Y.-F., Sharp, N. D. & Sales, A. E. (2009). Organizational readiness to change assessment (ORCA): Development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implementation Science, 4: 38. doi: 10.1186/1748-5908-4-38.

Citing Literature - Empirical Use/Application:
Reference for publications on the application of the assessment instrument

Hagedorn, H. J., & Heideman, P. W. (2010). The relationship between baseline Organizational Readiness to Change Assessment subscale scores and implementation of hepatitis prevention services in substance use disorders treatment clinics: a case study. Implementation science : IS, 5, 46. https://doi.org/10.1186/1748-5908-5-46

Amenta, E., Grigoryan, L., Braund, S., Ramsey, D., Donnelly, J., Hernandez, R., … Trautner, B. (2024). Organizational Readiness for Change Depends on Facility Complexity When Developing a National Stewardship Intervention. Antimicrobial Stewardship & Healthcare Epidemiology, 4(S1), s48–s48. doi:10.1017/ash.2024.163

Noe, T., Kaufman, C., Kaufmann, L., Brooks, E., & Shore, J. (2014). Providing culturally competent services for American Indian and Alaska Native veterans to reduce health care disparities.. American journal of public health, 104 Suppl 4, S548-54 . https://doi.org/10.2105/AJPH.2014.302140.

Version:
Number/name of the most recent version of the assessment instrument

Not Found

Related Instruments:
Indicate if assessment instrument is related to another instrument in the repository.

integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) Interview Guide

Implementation Science Considerations

Intended Focus

Psychometric Properties

Pragmatic Properties

Assessment Instrument Characteristics

Characteristic Title	Characteristic Description	Response options	Domain
Brief Description	Brief summary description of assessment instrument	Open Text	General Characteristics
Citing Literature - Development/Original	Reference for publication describing the development of the assessment instrument	Open Text	General Characteristics
Citing Literature - Empirical Use/Application	Reference for publications on the application of the assessment instrument	Open Text	General Characteristics
Website	Website providing access to and/or describing the assessment instrument	Open Text	General Characteristics
Instrument and/or related documentation	Related files uploaded (instrument if directly available) including descriptions for each	Open Text	General Characteristics
Version	Number/name of the most recent version of the assessment instrument	Open Text	General Characteristics
Qualitative/Quantitative	The assessment instrument uses quantitative and/or qualitative data	Multi Select Qualitative Quantitative See Values	Summary Statistics
Type of Instrument	The type of the assessment instrument	Multi Select Checklist Documentation Guide EMR Form Ethnographic Assessment Focus Group Interview Individual Interview Observation Guide Periodic Reflection Reporting Tempate Reporting Template Survey Template/Worksheet Undisclosed online tool Worksheet See Values	Summary Statistics
Levels of Data Collection	The level(s) from which the assessment instrument collects data	Multi Select Community Implementer Individual (Patient, Community Member) Organizational Policy System See Values	Intended Focus
Language Availability	Language(s) in which the assessment instrument is available	Multi Select Albanian Chinese Danish Dutch English French German Italian Portuguese Spanish Swedish See Values	Summary Statistics
Constructs Assessed	Constructs assessed by the assessment instrument (linked to constructs included in the D&I models webtool)	Relationship	Implementation Science Considerations
Theories, Models, Frameworks Relevant	The D&I TMFs relevant for the assesment instrument based on constructs assessed	Relationship	Implementation Science Considerations
Implementation Outcomes	The relevance of the assessment instrument to various implementation outcomes	Multi Select Acceptability Adaptation Adoption Appropriateness Effectiveness Feasibility Fidelity Implementation Implementation Cost Penetration Reach Sustainment See Values	Implementation Science Considerations
Implementation Strategies	The implementation strategy/ies evaluated by the assessment instrument	Multi Select Access new funding Adapt and tailor to context Alter incentive/allowance structures Alter patient/consumer fees Assess for readiness and identify barriers and facilitators Audit and provide feedback Build a coalition Capture and share local knowledge Change infrastructure Change physical structure and equipment Change service sites Conduct educational meetings Conduct educational outreach visits Conduct local consensus discussions Conduct local needs assessment Conduct ongoing training Create a learning collaborative Create or change credentialing and/or licensure standards Develop a formal implementation blueprint Develop academic partnerships Develop educational materials Develop implementation blueprint Develop resource sharing agreements Develop stakeholder inter-relationships Develop stakeholder interrelationships Distribute educational materials Engage consumers Identify and prepare champions Identify early adopters Inform local opinion leaders Make billing easier Make training dynamic Mandate change Model and simulate change Not Found Obtain and use patients/consumers and family feedback Obtain formal commitments Organize clinician implementation team meetings Place innovation on fee for service lists/formularies Prepare patients/consumers to be active participants Promote adaptability Promote network weaving Provide clinical supervision Provide interactive assistance Provide local technical assistance Provide ongoing consultation Purposely reexamine the implementation Recruite, designate, and train for leadership Revise professional roles Shadow other experts Stage implementation scale up Support clinicians Tailor strategies Train and educate stakeholders Use advisory boards and workgroups Use an implementation advisor Use capitated payments Use data experts Use data warehousing techniques Use evaluative and iterative strategies Use mass media Use of evaluative and iterative strategies Use other payment schemes Use train-the-trainer strategies Utilize financial strategies Visit other sites Work with educational institutions See Values	Implementation Science Considerations
Intended Priority Population	Intended priority population from whom data are collected using the assessment instrument	Multi Select Administrator Clinician Community Members/Patients Employer Public Health Practitioner Researcher/Evaluator Teacher/Trainer See Values	Intended Focus
Intended Priority Setting	Intended priority setting in which the assessment instrument is used	Multi Select Clinical Inpatient Clinical Outpatient Community Organization Public Health Agency Residential Care School Workplace See Values	Intended Focus
Phase of Implementation Process	Phase of implementation process when the assessment instrument can be used	Multi Select Implementation Pre-Implementation Sustainment See Values	Implementation Science Considerations
Policy	Assessment instrument is relevant to policy	Multi Select Clinical Practice Healthcare Financing/Reimbursement Public (Laws, Regulations) See Values	Intended Focus
Equity Relevant	Assessment instrument includes at least one equity-relevant component	Multi Select Yes See Values	Intended Focus
Uses Secondary data	Assessment instrument relies on a secondary data source	Multi Select Yes See Values	Pragmatic Characteristics
Time to Administer	The amount of time required to complete the assessment instrument	Open Text	Pragmatic Characteristics
Number of Items	Number of items in the assessment instrument	Open Text	Summary Statistics
Subscale Information	Names of each of the subscales and the number of items for each of the subscales	Open Text	Summary Statistics
Scoring	The assessment instrument produces a composite score	Multi Select No Yes See Values	Psychometric Properties
Norms	Measures of central tendency and distribution for the total score are based on small, medium, large sample size	Multi Select Yes See Values	Psychometric Properties
Responsiveness	The ability of the assessment instrument to detect change over time (i.e., sensitivity to change or intervention effects).	Multi Select Yes See Values	Psychometric Properties
Cost	Cost associated with access to assessment instrument (Some instruments might require login.)	Multi Select Cost Free See Values	Pragmatic Characteristics
Literacy	Readability of the items reported on.	Multi Select Yes See Values	Pragmatic Characteristics
Interpretation	Expertise needed for interpretation of data is reported.	Multi Select No Yes See Values	Pragmatic Characteristics
Training	Expertise needed to use the assessment instrument is reported	Multi Select No Yes See Values	Pragmatic Characteristics
Resources Required to Administer	Resources needed to administer the assessment instrument (FTE for data collector, equipment, etc.)	Multi Select High None/Low See Values	Pragmatic Characteristics
User Guidance	Guides are provided to support administration of assessment instrument/data collection, and/or analysis of data from the assessment instrument, and/or interpretation of data, and/or action/decision on how to use data	Multi Select Guidance for Action/Decision Guidance to Administer Guidance to Analyze Guidance to Interpret See Values	Pragmatic Characteristics
Obtrusiveness	Degree of intrusion the participants will experience because of the data collection when using the assessment instrument (e.g., assessment instruments that rely on use of secondary data or automated data will be less obtrusive)	Multi Select High: Observation and syncronous collection of data Low: Automated collection of data or secondary data Medium: Asyncronous collection of data See Values	Pragmatic Characteristics
Interactivity	Data collection and/or result generation involves interactive components.	Multi Select Adaptive Instrument Generative Outcome See Values	Pragmatic Characteristics
Related Instruments	Indicate if assessment instrument is related to another instrument in the repository.	Relationship	General Characteristics
Validity	The extent to which an instrument measures what it is intended to measure accurately.	Multi Select Concurrent Validity (Definition) Convergent Validity (Definition) Cross-Cultural Validity (Definition) Discriminant Validity (Definition) Known Group Validity (Definition) Predictive Validity (Definition) Unspecified Validity See Values	Psychometric Properties
Reliability	The extent to which results are consistent results over time, across raters, across settings, or across items intended to measure the same thing.	Multi Select Yes See Values	Psychometric Properties
Factor Analysis	A statistical method that uses the correlation between observed variables to identify common factors.	Multi Select Yes See Values	Psychometric Properties

Comments

Organizational readiness to change assessment (ORCA)

Qualitative/Quantitative: The assessment instrument uses quantitative and/or qualitative data

Type of Instrument: The type of the assessment instrument

Number of Items: Number of items in the assessment instrument

Subscale Information: Names of each of the subscales and the number of items for each of the subscales

Language Availability: Language(s) in which the assessment instrument is available

Brief Description: Brief summary description of assessment instrument

Website: Website providing access to and/or describing the assessment instrument

Instrument and/or related documentation: Related files uploaded (instrument if directly available) including descriptions for each

Citing Literature - Development/Original: Reference for publication describing the development of the assessment instrument

Citing Literature - Empirical Use/Application: Reference for publications on the application of the assessment instrument

Version: Number/name of the most recent version of the assessment instrument

Related Instruments: Indicate if assessment instrument is related to another instrument in the repository.

Implementation Science Considerations

Constructs Assessed: Constructs assessed by the assessment instrument (linked to constructs included in the D&I models webtool)

Theories, Models, Frameworks Relevant: The D&I TMFs relevant for the assesment instrument based on constructs assessed

Implementation Outcomes: The relevance of the assessment instrument to various implementation outcomes

Implementation Strategies: The implementation strategy/ies evaluated by the assessment instrument

Phase of Implementation Process: Phase of implementation process when the assessment instrument can be used

Intended Focus

Levels of Data Collection: The level(s) from which the assessment instrument collects data

Intended Priority Population: Intended priority population from whom data are collected using the assessment instrument

Intended Priority Setting: Intended priority setting in which the assessment instrument is used

Policy: Assessment instrument is relevant to policy

Equity Focus:

Psychometric Properties

Scoring: The assessment instrument produces a composite score

Norms: Measures of central tendency and distribution for the total score are based on small, medium, large sample size

Responsiveness: The ability of the assessment instrument to detect change over time (i.e., sensitivity to change or intervention effects).

Validity: The extent to which an instrument measures what it is intended to measure accurately.

Reliability: The extent to which results are consistent results over time, across raters, across settings, or across items intended to measure the same thing.

Factor Analysis: A statistical method that uses the correlation between observed variables to identify common factors.

Pragmatic Properties

Time to Administer: The amount of time required to complete the assessment instrument

Secondary Data:

Cost: Cost associated with access to assessment instrument (Some instruments might require login.)

Literacy: Readability of the items reported on.

Interpretation: Expertise needed for interpretation of data is reported.

Training: Expertise needed to use the assessment instrument is reported

Resources Required to Administer: Resources needed to administer the assessment instrument (FTE for data collector, equipment, etc.)

User Guidance: Guides are provided to support administration of assessment instrument/data collection, and/or analysis of data from the assessment instrument, and/or interpretation of data, and/or action/decision on how to use data

Obtrusiveness: Degree of intrusion the participants will experience because of the data collection when using the assessment instrument (e.g., assessment instruments that rely on use of secondary data or automated data will be less obtrusive)

Interactivity: Data collection and/or result generation involves interactive components.

Assessment Instrument Characteristics

Comments

Qualitative/Quantitative:
The assessment instrument uses quantitative and/or qualitative data

Type of Instrument:
The type of the assessment instrument

Number of Items:
Number of items in the assessment instrument

Subscale Information:
Names of each of the subscales and the number of items for each of the subscales

Language Availability:
Language(s) in which the assessment instrument is available

Brief Description:
Brief summary description of assessment instrument

Website:
Website providing access to and/or describing the assessment instrument

Instrument and/or related documentation:
Related files uploaded (instrument if directly available) including descriptions for each

Citing Literature - Development/Original:
Reference for publication describing the development of the assessment instrument

Citing Literature - Empirical Use/Application:
Reference for publications on the application of the assessment instrument

Version:
Number/name of the most recent version of the assessment instrument

Related Instruments:
Indicate if assessment instrument is related to another instrument in the repository.

Constructs Assessed:
Constructs assessed by the assessment instrument (linked to constructs included in the D&I models webtool)

Theories, Models, Frameworks Relevant:
The D&I TMFs relevant for the assesment instrument based on constructs assessed

Implementation Outcomes:
The relevance of the assessment instrument to various implementation outcomes

Implementation Strategies:
The implementation strategy/ies evaluated by the assessment instrument

Phase of Implementation Process:
Phase of implementation process when the assessment instrument can be used

Levels of Data Collection:
The level(s) from which the assessment instrument collects data

Intended Priority Population:
Intended priority population from whom data are collected using the assessment instrument

Intended Priority Setting:
Intended priority setting in which the assessment instrument is used

Policy:
Assessment instrument is relevant to policy

Scoring:
The assessment instrument produces a composite score

Norms:
Measures of central tendency and distribution for the total score are based on small, medium, large sample size

Responsiveness:
The ability of the assessment instrument to detect change over time (i.e., sensitivity to change or intervention effects).

Validity:
The extent to which an instrument measures what it is intended to measure accurately.

Reliability:
The extent to which results are consistent results over time, across raters, across settings, or across items intended to measure the same thing.

Factor Analysis:
A statistical method that uses the correlation between observed variables to identify common factors.

Time to Administer:
The amount of time required to complete the assessment instrument

Cost:
Cost associated with access to assessment instrument (Some instruments might require login.)

Literacy:
Readability of the items reported on.

Interpretation:
Expertise needed for interpretation of data is reported.

Training:
Expertise needed to use the assessment instrument is reported

Resources Required to Administer:
Resources needed to administer the assessment instrument (FTE for data collector, equipment, etc.)

User Guidance:
Guides are provided to support administration of assessment instrument/data collection, and/or analysis of data from the assessment instrument, and/or interpretation of data, and/or action/decision on how to use data

Obtrusiveness:
Degree of intrusion the participants will experience because of the data collection when using the assessment instrument (e.g., assessment instruments that rely on use of secondary data or automated data will be less obtrusive)

Interactivity:
Data collection and/or result generation involves interactive components.