Transformer-based Clinical Report Generation from Stroke Electronic Health Records (EHRs): A Comprehensive Review

Main Article Content

Rabia Amin
Ali Raza Aslam

Abstract

Structured Electronic Health Records (EHRs) provide a valuable source for generating clinical narrative reports that are increasingly automated in this rapidly evolving field of medical AI, especially in stroke care where timely documentation is vital. Complex multimodal data comes with stroke patients in the form of lab results, neurological scores (e.g., NIHSS), imaging results, medication histories, and structured diagnostic codes. Converting structured information to coherent clinical narratives like radiology reports or discharge summaries is still a difficult natural language generation (NLG) problem. In recent years, various Transformer-based architectures have emerged, such as encoder–decoder models like T5 and BART, and decoder-only large language models (LLMs) like GPT, LLaMA, and Phi, which have greatly enhanced the generation of medical texts. However, the generation of a stroke-specific EHR-to-report is not widely discussed, as datasets are limited, there is a lack of standardized benchmarks, and there is little clinical validation. This is a systematic review of literature from 2015–2026 related to Transformer-based clinical report generation for stroke patients. Datasets, architectures, evaluation metrics, baseline models, and clinical applications are discussed. We also list some limitations such as risk of hallucination, poor generalization and lack of paired datasets for strokes. Lastly, we suggest future directions such as multimodal learning, retrieval-augmented generation, and clinically-based evaluation frameworks.

Article Details

Amin, R., & Aslam, A. R. (2026). Transformer-based Clinical Report Generation from Stroke Electronic Health Records (EHRs): A Comprehensive Review. Journal of Cardiology and Cardiovascular Medicine, 11(5), 71–81. https://doi.org/10.29328/journal.jccm.1001230
Review Articles

Copyright (c) 2026 Amin R, et al.

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Ali Raza Aslam, University of Superior, Lahore, Pakistan

  • Stroke
  • Electronic health records
  • Clinical report generation
  • Transformer models
  • Large language models
  • Natural language generation
  • Retrieval-augmented generation
  • Clinical factual consistency

Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention Is All You Need. NeurIPS. 2017.

Devlin J, Chang MW, Lee K, Toutanova K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL. 2019.

Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, et al. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. JMLR. 2020;21(140):1–67.

Lewis M, Liu Y, Goyal N, Ghazvininejad M, Mohamed A, Levy O, et al. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation. ACL. 2020.

Johnson AEW, Pollard TJ, Shen L, Li-Wei HL, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3:160035. doi: 10.1038/sdata.2016.35

Johnson AEW, Bulgarelli L, Shen L, Gayles A, Shammout A, Horng S, et al. MIMIC-IV, a freely accessible electronic health record dataset. Sci Data. 2021;8:1–9. Available from: https://dx.doi.org/10.1038/s41597-021-01036-9

Pollard TJ, Johnson AEW, Raffa JD, Celi LA, Mark RG, Badawi O. The eICU Collaborative Research Database, a freely available multi-center database for critical care research. Sci Data. 2018;5:180178. Available from: https://dx.doi.org/10.1038/sdata.2018.178

Zhang T, Kishore V, Wu F, Weinberger KQ, Artzi Y. BERTScore: Evaluating Text Generation with BERT. ICLR. 2020.

Lin CY. ROUGE: A Package for Automatic Evaluation of Summaries. ACL Workshop. 2004.

Papineni K, Roukos S, Ward T, Zhu WJ. BLEU: a Method for Automatic Evaluation of Machine Translation. ACL. 2002.

Alsentzer E, Murphy J, Boag W, Weng WH, Jin D, Naumann T, et al. Publicly Available Clinical BERT Embeddings. arXiv preprint. 2019.

Lee J, Yoon W, Kim S, Kim D, Kim S, So CH, et al. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics. 2020;36(4):1234–1240. Available from: https://dx.doi.org/10.1093/bioinformatics/btz682

Liu CF, Li J, Kim G, et al. Automatic comprehensive ASPECTS reports in clinical acute stroke MRIs. Sci Rep. 2023;13:3784. Available from: https://dx.doi.org/10.1038/s41598-023-30242-6

Liu CF, Zhao Y, Yedavalli V, et al. Automatic comprehensive radiological reports for clinical acute stroke MRIs. Commun Med. 2023;3:95. Available from: https://dx.doi.org/10.1038/s43856-023-00327-4

Rouhizadeh H, et al. The Detectability Paradox: Bilingual Medical Report Generation with Open-Weight Models and the Limits of Human Oversight. J Am Med Inform Assoc. 2026. Available from: https://dx.doi.org/10.1093/jamia/ocag070

Duarte KT, Sidhu AS, Bakshi M, et al. Systematic Review of Large Language Models and NLP in Stroke Care: Applications, Challenges, and Future Directions. Stroke Vasc Interv Neurol. 2026;6(3). Available from: https://dx.doi.org/10.1161/SVIN.125.002261

Lehman E, Johnson A. Clinical-T5: Large Language Models Built Using MIMIC Clinical Text. PhysioNet. 2023. Available from: https://dx.doi.org/10.13026/rj8x-v335

Goldberger AL, Amaral LAN, Glass L, et al. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation. 2000;101(23):e215–e220. Available from: https://dx.doi.org/10.1161/01.CIR.101.23.e215