Reasoning Before Diagnosis: Physician-Inspired Structured Thinking for ECG Classification
Yang Wu, Xiaoyan Yuan, Hau-San Wong, Xiping Hu
Abstract
Electrocardiogram (ECG) diagnosis in clinical practice relies on structured reasoning over multiple hierarchical aspects, including cardiac rhythm, conduction properties, waveform morphology, and overall diagnostic impression. However, most existing approaches predict labels directly from ECG signals without explicit clinical reasoning, resulting in opaque decisions that lack clinical alignment. To bridge this gap, we propose CardioThink, a physician-inspired multimodal large language model (MLLM) framework that explicitly models the diagnostic reasoning process through human-interpretable intermediate stages (rhythm, conduction, morphology, and impression) to derive final classification results. Furthermore, we introduce Structured Set Policy Optimization (SSPO) to jointly optimize adherence to this structured reasoning format and the accuracy of variable-size diagnostic sets, without requiring manually annotated reasoning traces. Extensive experiments on diverse ECG benchmarks demonstrate the significant superiority of our approach in diagnostic accuracy, while simultaneously providing interpretable clinical reasoning. Notably, reasoning quality evaluations confirm that SSPO substantially enhances the clinical validity of the generated rationales. These findings reveal that moving beyond direct label prediction toward structured reasoning offers a more clinically aligned direction for future ECG modeling.
AI Impact Assessments
(1 models)Scientific Impact Assessment: "Reasoning Before Diagnosis: Physician-Inspired Structured Thinking for ECG Classification"
1. Core Contribution
CardioThink introduces a multimodal large language model (MLLM) framework that explicitly decomposes ECG diagnosis into four structured reasoning stages—rhythm analysis, conduction assessment, waveform morphology, and diagnostic impression—before arriving at a final classification. The key technical novelty lies in Structured Set Policy Optimization (SSPO), a reinforcement learning approach built atop GRPO that jointly optimizes (a) adherence to the structured reasoning format via a structure reward and (b) diagnostic accuracy of variable-size label sets via a Dice-coefficient-based diagnosis reward. Importantly, SSPO operates without requiring manually annotated reasoning traces for intermediate steps, which is a practical advantage given the cost of clinical expert annotation.
The paper also contributes a reasoning-oriented ECG dataset constructed via a model-guided pipeline (using ECG-Chat-13B and Qwen-Plus for reformatting), which provides structured diagnostic reasoning paths across three major ECG datasets (PTB-XL, CPSC2018, CSN).
2. Methodological Rigor
The methodology is generally sound but has several aspects worth scrutinizing:
Architecture: The model architecture (LLaVA-7B backbone with a 1D-ViT ECG encoder and MLP projector) is relatively standard. The novelty lies not in architectural design but in the training paradigm and reward formulation.
SSPO Design: The composite reward function combining structure compliance and Dice-coefficient-based diagnosis accuracy is well-motivated. The structure reward (Eq. 6) is straightforward but effective, as confirmed by the perfect SSV scores post-SSPO. The Dice coefficient for set prediction (Eq. 7) is an appropriate choice for multi-label classification with variable set sizes, naturally penalizing both false positives and false negatives.
Data Construction: The reasoning-oriented dataset is constructed using a semi-automated pipeline involving model-generated outputs refined by another LLM (Qwen-Plus) and manual screening. This raises questions about the quality ceiling—the reasoning traces are synthetic, generated by ECG-Chat-13B, which itself is one of the weaker baselines in Table 1. The paper acknowledges this is for cold-start initialization, with SSPO expected to refine reasoning quality, but the initial quality of the synthetic data likely constrains the reasoning diversity.
Evaluation: The paper evaluates across six tasks on three datasets, which is comprehensive. However, the comparison set is somewhat uneven—pretrained discriminative models (MERL, MELP) are compared under potentially different fine-tuning regimes, and generative models vary significantly in their intended use cases. The reasoning quality evaluation using both GPT-4o and three human experts with inter-rater reliability metrics (Fleiss' κ = 0.617–0.643) is a strength, though the human evaluation covers only 10% of the test set.
Ablation study: The ablations are well-designed, isolating the contributions of structured thinking vs. unstructured thinking, and individual reward components. The data efficiency analysis (Figure 3) provides useful practical insights.
3. Potential Impact
Clinical Applicability: The structured reasoning format closely mirrors how cardiologists actually interpret ECGs, making the outputs significantly more interpretable than black-box predictions. This alignment could facilitate clinician trust and adoption. The explicit decomposition into rhythm/conduction/morphology/impression provides actionable intermediate outputs that clinicians can verify.
Broader Methodological Impact: The SSPO framework—combining format enforcement with task-specific accuracy rewards for set prediction—could generalize beyond ECG to other medical diagnostic tasks requiring structured reasoning (e.g., radiology, pathology). The idea of using RL to optimize structured clinical reasoning without manually annotated reasoning traces is broadly applicable.
Limitations of Impact: The model is built on LLaVA-7B, which has computational requirements that may be prohibitive for real-time clinical deployment. The paper does not discuss inference latency, which is critical for ECG interpretation in acute care settings.
4. Timeliness & Relevance
This work sits at the intersection of two highly active research areas: (1) reasoning in LLMs (chain-of-thought, structured reasoning) and (2) medical AI interpretability. The application of RL-based reasoning optimization (following DeepSeek-R1 and similar approaches) to medical domains is timely. The clinical need for interpretable ECG systems is well-established, and regulatory requirements increasingly demand explainability in medical AI.
The paper addresses a genuine gap: most ECG models either produce opaque predictions or generate unstructured reports that don't feed back into the classification decision. Making reasoning an explicit intermediate step that influences the final prediction is a meaningful conceptual advance.
5. Strengths & Limitations
Key Strengths:
Notable Weaknesses:
Reproducibility: The paper uses publicly available datasets and provides sufficient implementation details. However, the data construction pipeline involves proprietary models (Qwen-Plus, GPT-4o for evaluation), which may limit full reproducibility.
Summary
CardioThink presents a conceptually appealing framework that bridges clinical reasoning practices with modern MLLM capabilities. The SSPO method is a well-designed contribution that addresses practical challenges in training reasoning-augmented models. While the empirical results are strong, questions remain about the quality of synthetic reasoning data, computational practicality, and the degree to which reasoning genuinely drives classification versus serving as a correlated output. Nevertheless, the work opens a promising direction for clinically-aligned medical AI.
Generated May 19, 2026
Comparison History (18)
Paper 1 (CardioThink) addresses a critical gap in clinical AI by introducing structured physician-inspired reasoning for ECG diagnosis, combining interpretability with accuracy. Its novel SSPO optimization method and clinically aligned multi-stage reasoning framework have broad implications for trustworthy medical AI beyond just ECG. Paper 2 (ConceptAgent) makes a solid contribution to AI safety by exposing limitations of concept erasure in diffusion models, but its impact is more niche—primarily relevant to the adversarial robustness of generative models. Paper 1's potential for real-world clinical deployment and cross-domain applicability in medical AI gives it higher overall impact.
EXG addresses a fundamental challenge in LLM-based agents—systematic learning from experience—with broad applicability across domains (code generation, reasoning, and beyond). Its plug-and-play experience graph framework introduces a principled, general-purpose architecture for self-evolving agents that could influence the entire agent ecosystem. While CardioThink is innovative in ECG diagnosis with structured clinical reasoning, its impact is more domain-specific. EXG's broader applicability, novelty as the first experience graph for self-evolving agents, and timeliness given the rapid growth of agentic AI give it higher potential cross-field impact.
CardioThink addresses a high-impact problem at the intersection of AI and clinical medicine, introducing both a novel framework (physician-inspired structured reasoning for ECG classification) and a new training method (SSPO) that eliminates the need for manual reasoning annotations. Its clinical alignment and interpretability have significant real-world healthcare applications. Paper 2 proposes a useful causal memory selection method for LLM agents, but targets a narrower AI systems problem. Paper 1's broader impact across medical AI, interpretability research, and clinical deployment gives it higher potential scientific impact.
Paper 1 offers profound real-world impact by addressing the critical 'black-box' problem in medical AI. By explicitly modeling physician-like structured reasoning for ECG diagnosis without requiring manual traces, it bridges the gap between raw accuracy and clinical interpretability. While Paper 2 presents valuable fundamental advancements in RL world models, Paper 1's potential to directly improve clinical workflows, patient outcomes, and trust in healthcare AI gives it a higher immediate societal and scientific impact.
Paper 2 tackles high-stakes medical diagnostics where interpretability is crucial. By introducing Structured Set Policy Optimization (SSPO) to optimize clinical reasoning without manual annotations, it offers higher methodological novelty than Paper 1's training-free pipeline. Its potential to align MLLMs with human clinical thinking provides a highly impactful framework for the broader healthcare AI field.
PopuLoRA introduces a novel population-based self-play framework for LLM post-training that addresses a fundamental limitation (self-calibration collapse) in RLVR. Its contribution—weight-space evolution operators for LoRA adapters and co-evolutionary dynamics—is broadly applicable across reasoning domains (code and math), demonstrated with strong empirical results. Paper 2 applies structured reasoning to ECG classification, which is valuable but more domain-specific. PopuLoRA's methodological innovation in training paradigms for LLMs has broader impact potential given the centrality of LLM reasoning improvement to the field.
Paper 2 addresses a critical gap in medical AI by integrating human-interpretable, structured clinical reasoning into ECG diagnosis. Its application to healthcare offers massive, immediate real-world utility, potentially saving lives and improving trust in automated diagnostics. While Paper 1 presents an innovative approach to cognitive mapping and geopolitical theory, Paper 2's methodological rigor, introduction of SSPO without needing manually annotated traces, and profound implications for clinical workflows give it a broader and more significant potential scientific and societal impact.
Paper 1 (CardioThink) introduces a novel paradigm for ECG classification that bridges clinical reasoning and AI, addressing a critical gap in medical AI interpretability. Its physician-inspired structured reasoning framework (SSPO) is methodologically innovative, clinically aligned, and broadly applicable to medical diagnostics. Paper 2 (AGPO) offers a solid incremental improvement to RLVR methods with industrial application, but addresses a narrower technical problem. Paper 1's impact spans both AI and healthcare, with stronger potential for real-world clinical adoption and cross-disciplinary influence.
Paper 1 has higher potential impact due to strong novelty (identifying and quantifying “memory laundering” as a new safety failure mode in memory-augmented agents), broad applicability across LLM agent deployments, and timely relevance to real-world safety monitoring. It introduces a concrete metric (SPG) and causal-style counterfactual rollouts, supporting methodological rigor and actionable mitigation guidance (intervention placement). Paper 2 is valuable and application-oriented for clinical ECG classification, but its impact is narrower to medical ML and builds on established structured-reasoning/LLM trends, with potentially higher translational barriers.
Paper 2 addresses a fundamental and widely debated theoretical question in AI regarding the dynamics of Supervised Fine-Tuning (SFT) in Large Language Models. By providing a novel interaction-based explanation for SFT's effectiveness, its findings have broad implications across all domains utilizing LLMs, offering practical guidance for early stopping and training. In contrast, while Paper 1 presents a highly valuable, interpretable framework for clinical ECG classification, its impact is largely confined to the specific domain of medical AI and cardiology.
While Paper 1 offers a significant advancement in clinical AI interpretability, Paper 2 addresses a fundamental and pervasive limitation in large language models: the lack of metacognition and autonomous knowledge repair. The automated self-correction pipeline using graph-theoretic enrichment has broad, cross-disciplinary applications, potentially impacting any domain reliant on LLMs by improving reliability and reducing hallucinations. Its foundational nature gives it a wider breadth of impact compared to the domain-specific focus of Paper 1.
Paper 2 addresses a critical barrier in medical AI—opaque decision-making—by introducing an interpretable, physician-inspired reasoning framework and a novel optimization method (SSPO). Its direct implications for clinical practice, patient care, and healthcare AI deployment offer higher tangible scientific and real-world impact compared to Paper 1's meta-analysis of AI benchmarking culture, despite the latter's timeliness.
Paper 1 likely has higher scientific impact due to its clinically grounded novelty (explicit, hierarchical physician-style reasoning for ECGs) and direct real-world applicability in medical decision support, where interpretability and alignment matter. SSPO is methodologically interesting because it optimizes structured rationales and variable-size label sets without annotated reasoning traces, improving practicality. The work is timely given the push for transparent medical AI and could influence both clinical ML and multimodal/LLM reasoning research. Paper 2 is valuable for HMT, but its primary validation is in Overcooked-AI, which may limit immediate cross-domain uptake.
Paper 2 addresses a highly timely challenge in medical AI: explainable, clinically-aligned ECG diagnosis. By introducing a novel MLLM framework and Structured Set Policy Optimization, it offers immediate, high-impact real-world applications in healthcare. In contrast, Paper 1 presents a theoretical thesis proposal on knowledge graph uncertainty, lacking completed empirical validation. Paper 2's extensive experiments and alignment with current trends in interpretable medical AI give it a significantly higher potential for broad scientific and clinical impact.
Paper 1 addresses a fundamental and broadly applicable bottleneck in LLM agent systems—action space representation—which affects the entire rapidly growing field of LLM agents. Its framework (LAR) is model-agnostic, applicable across diverse agent benchmarks, and complementary to other efficiency advances, giving it wide cross-domain impact. Paper 2, while valuable for clinical ECG interpretation, is more domain-specific. The concept of structured reasoning for medical AI is less novel (chain-of-thought reasoning is well-explored), whereas learning compact latent action spaces for LLM agents opens a new research direction with broader implications for scaling autonomous agents.
Paper 1 likely has higher scientific impact due to a novel, clinically grounded framework (structured intermediate reasoning for ECGs) plus a new optimization method (SSPO) that avoids annotated reasoning traces—advancing both interpretability and performance in a high-stakes, widely studied medical domain. Its real-world applicability to scalable ECG diagnosis and potential transfer to other physiological signal tasks broaden impact across healthcare AI. Paper 2 is timely and rigorous (contamination-aware evaluation; neuro-symbolic robustness), but is primarily evaluative within a narrower domain (tax law) and offers less broadly reusable methodological innovation.
Paper 2 has higher potential impact due to its broader, timely contribution: integrating physician-inspired structured reasoning with an MLLM for ECG classification and introducing SSPO to optimize both reasoning-format adherence and set-valued diagnostic accuracy without labeled rationales. This targets major current needs in medical AI—interpretability, clinical alignment, and robust training—likely transferable beyond ECG to other diagnostic tasks. Paper 1 is innovative for multimodal conflict-aware evidential aggregation in sleep staging, but its scope is narrower and the evidential-conflict framing may generalize less broadly than structured reasoning + optimization techniques in clinical foundation-model contexts.
SD-Search introduces a novel, general-purpose technique (on-policy hindsight self-distillation) that addresses a fundamental credit assignment problem in search-augmented reasoning without requiring external teachers or annotations. Its methodological contribution—dense step-level supervision derived from the policy itself—is broadly applicable across reasoning tasks and RL-based training paradigms. Paper 2, while valuable for ECG diagnosis, applies existing concepts (MLLMs, structured reasoning) to a specific medical domain. SD-Search's broader applicability, stronger novelty in its self-distillation mechanism, and relevance to the rapidly growing field of LLM reasoning give it higher potential impact.