Psychometric assessment of three newly developed implementation outcome measures.
Bryan J Weiner, Cara C Lewis, Cameo Stanick...
https://pubmed.ncbi.nlm.nih.gov/28851459/Actively Recruiting
Led by Chestnut Health Systems · Updated on 2026-06-18
80
Participants Needed
1
Research Sites
N/A
Total Duration
Researchers are studying ways to improve mental health and child welfare services by developing and testing a web-based decision support tool called Optimizing Responses through Collaborative Assessments ORCA. This tool helps state decision makers choose evidence-based programs EBPs to prevent child maltreatment and improve child and parent mental health, in line with the Family First Prevention Services Act FFPSA. The study focuses on enhancing decision-making quality and implementation of these programs in real-world state settings. Participants will be involved in one of two groups one receiving automated facilitation ORCA-A through the web platform, and the other receiving live facilitation ORCA-L via a facilitator guiding group discussions in real time. The study includes developing the web platform to host the ORCA tool and the automated facilitation, and then testing how these facilitation methods affect decision experiences, processes, and outcomes. The implementation process and fidelity of the adopted programs will also be monitored over time. During the study, participants will complete measures before, immediately after, and up to 12 months following the intervention to assess changes in decision quality, commitment, and perceptions of community health impact. The study also tracks how well evidence-based programs are adopted and implemented through bi-weekly assessments for up to two years. Throughout the study, data will be collected on decision reasoning, goals, consensus, and timing of program adoption to evaluate the effectiveness of the ORCA tool and facilitation methods.
CONDITIONS
K-ORCA: Testing a Decision Support Tool and Group Process for Selecting Interventions
G
Gracelyn Cruden, PhD
K
Kelli Wright
Explore thousands of other clinical trials that might be a better match.
Sign up to get personalized trial recommendations delivered to your inbox.
Already have an account? Log in here
Chestnut Health Systems
Lead Sponsor
National Institute of Mental Health (NIMH)
Collaborating Sponsor
This table compares participation in this trial with other options available for this condition. The information is drawn from published research and the trial’s study details and is provided for educational purposes only.
| Factors | Automated Group Decision Support (ORCA-A) | Live Facilitated Group Decision Support (ORCA-L) |
|---|---|---|
| What it is | Digital, web-based automated facilitation of group decision-making using the ORCA MCDA tool. Prompts guide discussion and support applying decision hygiene strategies in evaluating programs. | Group decision-making with a live facilitator, supporting evidence-based program selection through real-time group model building and decision hygiene using the ORCA tool. |
| Role in the trial | Test arm evaluating whether digital automated facilitation supports high-quality group decisions in selecting evidence-based child welfare interventions. | Active comparator arm, evaluating live facilitation as a method for guiding discussion and group program-selection decisions. |
| Primary use | Helps groups systematically compare, evaluate, and select evidence-based child welfare programs using structured decision frameworks with automated support. | Supports groups in rating, comparing, and reaching consensus on program selection, with interactive live facilitation to apply the decision tool process. |
| How it is given or performed | Automated prompts delivered via an online platform facilitate group discussion and prioritize programs. Sessions can be completed virtually without a live facilitator. | Sessions are led by a live facilitator, either in-person or virtually, using structured scripts to guide group deliberation in real time. |
| Evidence status | ORCA as an automated group decision-support tool has been developed and piloted, but this trial is evaluating its effectiveness compared to live facilitation. | Live facilitation with decision-support tools is a standard method for guiding evidence-based group program selection, shown to improve consensus and adoption in previous implementation studies. |
| Important limitations | Automated facilitation may be limited by team comfort with digital interfaces and absence of a live facilitator to address challenges during sessions. How well automated support can equal or outperform live facilitation is under investigation. | Live facilitation can vary by facilitator skill and group engagement. Requires more time and scheduling resources, which may limit scalability relative to automated digital tools. |
Disclaimer: This comparison is created with the help of artificial intelligence(AI) and may contain errors or missing information. It is not medical advice and does not mean one option is better or safer than another. Clinical trials are still being studied, and joining a trial is your choice. Please consult your healthcare professional before making any decisions.
You may qualify if you...
You will not qualify if you...
Duration - 2 to 4 weeks
Participants are screened for eligibility to participate in the trial.
Duration - Up to 12 months
Participants use the ORCA decision support tool with either automated or live facilitation. They complete surveys before, immediately after, and up to 12 months following the intervention to assess decision quality and program adoption.
Multiple data collection occasions, including baseline and follow-ups
Duration - Up to 24 months
Implementation progress of adopted programs is monitored bi-weekly for up to two years to evaluate decision impact and fidelity of program delivery.
Bi-weekly assessments
Study Type
INTERVENTIONAL
Masking
NONE
Allocation
RANDOMIZED
Model
PARALLEL
Primary Purpose
HEALTH_SERVICES_RESEARCH
Number of Arms
2
Have more questions? Get in touch with our team for quick support
Bryan J Weiner, Cara C Lewis, Cameo Stanick...
https://pubmed.ncbi.nlm.nih.gov/28851459/John G Oetzel, Nina Wallerstein, Bonnie Duran...
https://pubmed.ncbi.nlm.nih.gov/29854784/Gracelyn Cruden, Leah Frerichs, Byron J Powell...
https://pubmed.ncbi.nlm.nih.gov/33040271/Zoe M Alley, Jason E Chapman, Holle Schaper...
https://pubmed.ncbi.nlm.nih.gov/37480144/Chestnut Health Systems
Lead Sponsor
National Institute of Mental Health (NIMH)
Collaborating Sponsor