An International Multicenter Clinical Study on Application of UroMed AI Doctor Based on Large Language Models

Prior to the clinical study, the knowledge base, Q\&A capability, professionalism, and safety of the urology UroMed AI Doctor independently developed by our team will be evaluated. The evaluation method involves using the UroMed AI Doctor for public science Q\&A and answering standard urology examination questions (multiple-choice and case analysis questions). Comparisons will be made with internationally recognized large language models such as DeepSeek, ChatGPT, and Google Gemini. Two senior chief physicians will conduct the evaluation based on a scoring rubric. In the clinical study phase, trial cases will first be recruited at the lead institution, The First Affiliated Hospital of Guangxi Medical University. Enrolled patients will be randomly assigned to either the UroMed AI Doctor-assisted diagnosis and treatment group or the traditional manual diagnosis and treatment group. The scope of UroMed AI Doctor assistance includes providing auxiliary diagnosis and treatment plans based on the admission records of urology inpatients. The traditional manual group will have these tasks completed by one specialist attending physician. The evaluation will be independently conducted by two senior chief specialists using a blinded method. Furthermore, the UroMed AI Doctor and the attending physician will respectively provide preoperative science education to patients within their groups. The post-education anxiety reduction and satisfaction levels of patients in both groups will be compared using survey scales. Subsequently, a multi-center clinical validation was conducted in collaboration with 11 clinical research centers both domestically and internationally, including Guilin People's Hospital, Yulin Red Cross Hospital, Liuzhou Hospital of Traditional Chinese Medicine, Guigang People's Hospital, Nanning Second People's Hospital, Affiliated Hospital of Youjiang Medical University for Nationalities, Beihai People's Hospital, as well as Binh Duong General Hospital, Hue Central Hospital, Viet Duc Hospital, and the University of Medicine and Pharmacy at Ho Chi Minh City in Vietnam.