Reasoning Before Diagnosis: Physician-Inspired Structured Thinking for ECG Classification
Yang Wu, Xiaoyan Yuan, Hau-San Wong, Xiping Hu
Abstract
Electrocardiogram (ECG) diagnosis in clinical practice relies on structured reasoning over multiple hierarchical aspects, including cardiac rhythm, conduction properties, waveform morphology, and overall diagnostic impression. However, most existing approaches predict labels directly from ECG signals without explicit clinical reasoning, resulting in opaque decisions that lack clinical alignment. To bridge this gap, we propose CardioThink, a physician-inspired multimodal large language model (MLLM) framework that explicitly models the diagnostic reasoning process through human-interpretable intermediate stages (rhythm, conduction, morphology, and impression) to derive final classification results. Furthermore, we introduce Structured Set Policy Optimization (SSPO) to jointly optimize adherence to this structured reasoning format and the accuracy of variable-size diagnostic sets, without requiring manually annotated reasoning traces. Extensive experiments on diverse ECG benchmarks demonstrate the significant superiority of our approach in diagnostic accuracy, while simultaneously providing interpretable clinical reasoning. Notably, reasoning quality evaluations confirm that SSPO substantially enhances the clinical validity of the generated rationales. These findings reveal that moving beyond direct label prediction toward structured reasoning offers a more clinically aligned direction for future ECG modeling.
AI Impact Assessments
(1 model)Scientific Impact Assessment: "Reasoning Before Diagnosis: Physician-Inspired Structured Thinking for ECG Classification"
1. Core Contribution
CardioThink introduces a multimodal large language model (MLLM) framework that explicitly decomposes ECG diagnosis into four structured reasoning stages—rhythm analysis, conduction assessment, waveform morphology, and diagnostic impression—before arriving at a final classification. The key technical novelty lies in Structured Set Policy Optimization (SSPO), a reinforcement learning approach built atop GRPO that jointly optimizes (a) adherence to the structured reasoning format via a structure reward and (b) diagnostic accuracy of variable-size label sets via a Dice-coefficient-based diagnosis reward. Importantly, SSPO operates without requiring manually annotated reasoning traces for intermediate steps, which is a practical advantage given the cost of clinical expert annotation.
The paper also contributes a reasoning-oriented ECG dataset constructed via a model-guided pipeline (using ECG-Chat-13B and Qwen-Plus for reformatting), which provides structured diagnostic reasoning paths across three major ECG datasets (PTB-XL, CPSC2018, CSN).
2. Methodological Rigor
The methodology is generally sound but has several aspects worth scrutinizing:
Architecture: The model architecture (LLaVA-7B backbone with a 1D-ViT ECG encoder and MLP projector) is relatively standard. The novelty lies not in architectural design but in the training paradigm and reward formulation.
SSPO Design: The composite reward function combining structure compliance and Dice-coefficient-based diagnosis accuracy is well-motivated. The structure reward (Eq. 6) is straightforward but effective, as confirmed by the perfect SSV scores post-SSPO. The Dice coefficient for set prediction (Eq. 7) is an appropriate choice for multi-label classification with variable set sizes, naturally penalizing both false positives and false negatives.
Data Construction: The reasoning-oriented dataset is constructed using a semi-automated pipeline involving model-generated outputs refined by another LLM (Qwen-Plus) and manual screening. This raises questions about the quality ceiling—the reasoning traces are synthetic, generated by ECG-Chat-13B, which itself is one of the weaker baselines in Table 1. The paper acknowledges this is for cold-start initialization, with SSPO expected to refine reasoning quality, but the initial quality of the synthetic data likely constrains the reasoning diversity.
Evaluation: The paper evaluates across six tasks on three datasets, which is comprehensive. However, the comparison set is somewhat uneven—pretrained discriminative models (MERL, MELP) are compared under potentially different fine-tuning regimes, and generative models vary significantly in their intended use cases. The reasoning quality evaluation using both GPT-4o and three human experts with inter-rater reliability metrics (Fleiss' κ = 0.617–0.643) is a strength, though the human evaluation covers only 10% of the test set.
Ablation study: The ablations are well-designed, isolating the contributions of structured thinking vs. unstructured thinking, and individual reward components. The data efficiency analysis (Figure 3) provides useful practical insights.
3. Potential Impact
Clinical Applicability: The structured reasoning format closely mirrors how cardiologists actually interpret ECGs, making the outputs significantly more interpretable than black-box predictions. This alignment could facilitate clinician trust and adoption. The explicit decomposition into rhythm/conduction/morphology/impression provides actionable intermediate outputs that clinicians can verify.
Broader Methodological Impact: The SSPO framework—combining format enforcement with task-specific accuracy rewards for set prediction—could generalize beyond ECG to other medical diagnostic tasks requiring structured reasoning (e.g., radiology, pathology). The idea of using RL to optimize structured clinical reasoning without manually annotated reasoning traces is broadly applicable.
Limitations of Impact: The model is built on LLaVA-7B, which has computational requirements that may be prohibitive for real-time clinical deployment. The paper does not discuss inference latency, which is critical for ECG interpretation in acute care settings.
4. Timeliness & Relevance
This work sits at the intersection of two highly active research areas: (1) reasoning in LLMs (chain-of-thought, structured reasoning) and (2) medical AI interpretability. The application of RL-based reasoning optimization (following DeepSeek-R1 and similar approaches) to medical domains is timely. The clinical need for interpretable ECG systems is well-established, and regulatory requirements increasingly demand explainability in medical AI.
The paper addresses a genuine gap: most ECG models either produce opaque predictions or generate unstructured reports that don't feed back into the classification decision. Making reasoning an explicit intermediate step that influences the final prediction is a meaningful conceptual advance.
5. Strengths & Limitations
Key Strengths:
Notable Weaknesses:
Reproducibility: The paper uses publicly available datasets and provides sufficient implementation details. However, the data construction pipeline involves proprietary models (Qwen-Plus, GPT-4o for evaluation), which may limit full reproducibility.
Summary
CardioThink presents a conceptually appealing framework that bridges clinical reasoning practices with modern MLLM capabilities. The SSPO method is a well-designed contribution that addresses practical challenges in training reasoning-augmented models. While the empirical results are strong, questions remain about the quality of synthetic reasoning data, computational practicality, and the degree to which reasoning genuinely drives classification versus serving as a correlated output. Nevertheless, the work opens a promising direction for clinically-aligned medical AI.
Generated May 19, 2026
Comparison History (20)
Paper 2 has higher potential impact due to broader cross-field relevance (cognitive science, developmental psychology, AI/LLM evaluation, Bayesian inference), a principled task formalization (program induction with particle-based Bayesian inference) and strong timeliness in using LLM agents as manipulable “model organisms” to study human-like inference. Its findings generalize beyond a single medical modality and can influence both theories of human learning and methodologies for probing/aligning AI systems. Paper 1 is innovative and clinically useful, but its impact is more domain-specific to ECG interpretation.
While Paper 1 offers significant clinical value by improving interpretable medical AI, Paper 2 has a higher potential for broad scientific impact. AgentFugue addresses a fundamental challenge in general AI: scaling out multi-agent systems for long-horizon tasks without centralized orchestration. By introducing a shared reasoning hub that turns isolated agent trajectories into reusable collective reasoning, its methodology can be generalized across countless domains. The breadth of impact, timeliness in the fast-moving field of LLM agents, and architectural innovation give Paper 2 the edge in overall scientific influence.
Paper 1 (CardioThink) addresses a critical gap in clinical AI by introducing structured physician-inspired reasoning for ECG diagnosis, combining interpretability with accuracy. Its novel SSPO optimization method and clinically aligned multi-stage reasoning framework have broad implications for trustworthy medical AI beyond just ECG. Paper 2 (ConceptAgent) makes a solid contribution to AI safety by exposing limitations of concept erasure in diffusion models, but its impact is more niche—primarily relevant to the adversarial robustness of generative models. Paper 1's potential for real-world clinical deployment and cross-domain applicability in medical AI gives it higher overall impact.
EXG addresses a fundamental challenge in LLM-based agents—systematic learning from experience—with broad applicability across domains (code generation, reasoning, and beyond). Its plug-and-play experience graph framework introduces a principled, general-purpose architecture for self-evolving agents that could influence the entire agent ecosystem. While CardioThink is innovative in ECG diagnosis with structured clinical reasoning, its impact is more domain-specific. EXG's broader applicability, novelty as the first experience graph for self-evolving agents, and timeliness given the rapid growth of agentic AI give it higher potential cross-field impact.
CardioThink addresses a high-impact problem at the intersection of AI and clinical medicine, introducing both a novel framework (physician-inspired structured reasoning for ECG classification) and a new training method (SSPO) that eliminates the need for manual reasoning annotations. Its clinical alignment and interpretability have significant real-world healthcare applications. Paper 2 proposes a useful causal memory selection method for LLM agents, but targets a narrower AI systems problem. Paper 1's broader impact across medical AI, interpretability research, and clinical deployment gives it higher potential scientific impact.
Paper 1 offers profound real-world impact by addressing the critical 'black-box' problem in medical AI. By explicitly modeling physician-like structured reasoning for ECG diagnosis without requiring manual traces, it bridges the gap between raw accuracy and clinical interpretability. While Paper 2 presents valuable fundamental advancements in RL world models, Paper 1's potential to directly improve clinical workflows, patient outcomes, and trust in healthcare AI gives it a higher immediate societal and scientific impact.
Paper 2 tackles high-stakes medical diagnostics where interpretability is crucial. By introducing Structured Set Policy Optimization (SSPO) to optimize clinical reasoning without manual annotations, it offers higher methodological novelty than Paper 1's training-free pipeline. Its potential to align MLLMs with human clinical thinking provides a highly impactful framework for the broader healthcare AI field.
PopuLoRA introduces a novel population-based self-play framework for LLM post-training that addresses a fundamental limitation (self-calibration collapse) in RLVR. Its contribution—weight-space evolution operators for LoRA adapters and co-evolutionary dynamics—is broadly applicable across reasoning domains (code and math), demonstrated with strong empirical results. Paper 2 applies structured reasoning to ECG classification, which is valuable but more domain-specific. PopuLoRA's methodological innovation in training paradigms for LLMs has broader impact potential given the centrality of LLM reasoning improvement to the field.
Paper 2 addresses a critical gap in medical AI by integrating human-interpretable, structured clinical reasoning into ECG diagnosis. Its application to healthcare offers massive, immediate real-world utility, potentially saving lives and improving trust in automated diagnostics. While Paper 1 presents an innovative approach to cognitive mapping and geopolitical theory, Paper 2's methodological rigor, introduction of SSPO without needing manually annotated traces, and profound implications for clinical workflows give it a broader and more significant potential scientific and societal impact.
Paper 1 (CardioThink) introduces a novel paradigm for ECG classification that bridges clinical reasoning and AI, addressing a critical gap in medical AI interpretability. Its physician-inspired structured reasoning framework (SSPO) is methodologically innovative, clinically aligned, and broadly applicable to medical diagnostics. Paper 2 (AGPO) offers a solid incremental improvement to RLVR methods with industrial application, but addresses a narrower technical problem. Paper 1's impact spans both AI and healthcare, with stronger potential for real-world clinical adoption and cross-disciplinary influence.