The Daily Dose: Workflow-Integrated Large Language Model Automation for Clinical Summarization and Trial Identification in Radiation Oncology
Quick Take
The Daily Dose automates clinical summarization and trial identification in radiation oncology, enhancing workflow efficiency.
Key Points
- Mixed-methods evaluation after one month of deployment.
- 94.5% of respondents worked in radiation oncology.
- 83.6% reported using the system daily or weekly.
Article Content
From source RSS / original summaryarXiv:2605. 26346v1 Announce Type: new Abstract: Objective: To describe the design and early clinical evaluation of The Daily Dose (TDD), an LLM-driven, automated clinical summarization and clinical-trial identification system integrated into routine radiation oncology practice. Design: Mixed-methods evaluation using a cross-sectional, anonymous clinician survey administered after 1 month of system deployment.
Exposure: Daily automated delivery of physician-specific email summaries generated using RadOnc-GPT, including patient schedules, concise EHR-derived clinical-status summaries, and automated identification of potentially relevant clinical trials for new or consult visits. Main Outcomes and Measures: Primary outcomes included self-reported usability, satisfaction, perceived usefulness, perceived impact on workflow, time savings, and intention for continued use.
Internal consistency reliability was assessed using Cronbach's $\alpha$. Results: Among 55 respondents, 52 (94. 5\%) worked in radiation oncology, and 38 (69. 1\%) were attending physicians. Most participants (83. 6\%) reported using TDD daily or several times per week. Mean (SD) scores were 3. 89 (1. 04) for usability and satisfaction, 3. 43 (1. 24) for perceived usefulness, and 3. 80 (1. 17) for impact and future use (5-point Likert scale).
Overall satisfaction was positively associated with perceived time savings ($p < . 001$). Participants reported variable time savings, with 27\% estimating $\geq 10$ minutes saved per day. The questionnaire demonstrated excellent internal consistency (overall Cronbach's $\alpha$ = 0. 97).
Reader Mode unavailable (could not extract clean content).
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CL
See more →Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?
The reliability of LLM judges for evaluating deep research agents is critically assessed using the REFLECT benchmark.