Actively Recruiting
Evaluation of AI Large Models for Diagnosis and Treatment in Real-World Cases: Multicenter Retrospective Study
Led by First Affiliated Hospital of Fujian Medical University · Updated on 2026-01-30
800
Participants Needed
1
Research Sites
8 weeks
Total Duration
On this page
AI-Summary
What this Trial Is About
Researchers are evaluating the diagnostic and therapeutic abilities of three large language models—ChatGPT, Gemini, and Deepseek—using 800 archived inpatient medical records from urology departments across four tertiary hospitals. The study aims to assess how accurately these models recognize diseases, make preliminary diagnoses, and recommend treatments to explore their usefulness and limitations in supporting real-world clinical decisions. The study uses de-identified medical records that include standardized clinical details such as demographics, history of present illness, past medical history, physical exams, lab and imaging results, discharge diagnoses, and treatment plans. The diagnostic conclusions and treatment plans were removed before inputting the data to simulate a "first-visit physician" scenario. Each model then generated primary and secondary diagnoses, differential diagnosis lists with reasoning, and preliminary treatment suggestions. Participants are not directly involved as this is a retrospective observational study using archived records. Researchers will assess outcome measures like diagnostic accuracy (Top-1 and Top-3), diagnostic completeness, differential diagnosis quality, treatment plan quality, and analysis time over an average of three months through study completion. The study is sponsored by the First Affiliated Hospital of Fujian Medical University and started in January 2026 with completion expected by June 2026.
CONDITIONS
Brief Title
Evaluation of AI Large Models for Diagnosis and Treatment in Real-World Cases: Multicenter Retrospective Study
Who Can Participate
Eligibility Criteria
You may qualify if you...
- The case data is sourced from the four hospitals involved in the study, with complete and authentic diagnosis and treatment records.
- Patients must be 18 years or older, with no gender restrictions.
- Complete medical records including patient’s basic information, present illness history, past medical history, physical examination, and auxiliary examinations (laboratory and imaging tests).
- Clear discharge diagnosis and treatment plan including therapeutic measures and follow-up arrangements.
- Medical records have been archived with objective and accurate information that has not been altered.
- Patient or legal representative has provided informed consent agreeing to use of anonymized medical data for research analysis.
You will not qualify if you...
- Medical records with significant missing information such as key clinical details (present illness history, diagnostic or treatment records).
- Cases where diagnosis or treatment plan is unclear or treatment not fully completed for initial diagnosis.
- Cases where primary diagnosis is not urological.
- Cases with major errors or inconsistencies in records affecting assessment.
- Medical records in special formats or images that are not readable (e.g., handwritten notes, non-standard documentation).
- Patients who have not signed informed consent or refuse use of medical data for research.
AI-Screening
AI-Powered Screening
Complete this quick 3-step screening to check your eligibility
Your Study Journey
Duration - 2 to 4 weeks
Participants are screened for eligibility to participate in the trial.
Duration - Approximately 3 months
Participants' de-identified inpatient medical records are retrospectively collected and assessed by AI large language models to simulate a first-visit physician scenario.
Trial Site Locations
Total: 1 location
1
The First Affiliated Hospital of Fujian Medical University
Fuzhou, China
Actively Recruiting
Research Team
N
Ning Xu
How is the study designed?
Study Type
OBSERVATIONAL
Masking
N/A
Allocation
N/A
Model
N/A
Primary Purpose
N/A
Number of Arms
0
Similar Trials
Frequently Asked Questions
Have more questions? Get in touch with our team for quick support
Not the Right Trial for You?
Explore thousands of other clinical trials that might be a better match.
Sign up to get personalized trial recommendations delivered to your inbox.
Already have an account? Log in here