. Author manuscript; available in PMC: 2013 Jan 1.
Published in final edited form as:Pharmacoepidemiol Drug Saf. 2012 Jan;21(Suppl 1):100–128. doi:
10.1002/pds.2312 Abstract PurposeTo perform a systematic review of the validity of algorithms for identifying cerebrovascular accidents (CVAs) or transient ischemic attacks (TIAs) using administrative and claims data.
MethodsPubMed and Iowa Drug Information Service (IDIS) searches of the English language literature were performed to identify studies published between 1990 and 2010 that evaluated the validity of algorithms for identifying CVAs (ischemic and hemorrhagic strokes, intracranial hemorrhage and subarachnoid hemorrhage) and/or TIAs in administrative data. Two study investigators independently reviewed the abstracts and articles to determine relevant studies according to pre-specified criteria.
ResultsA total of 35 articles met the criteria for evaluation. Of these, 26 articles provided data to evaluate the validity of stroke, 7 reported the validity of TIA, 5 reported the validity of intracranial bleeds (intracerebral hemorrhage and subarachnoid hemorrhage), and 10 studies reported the validity of algorithms to identify the composite endpoints of stroke/TIA or cerebrovascular disease. Positive predictive values (PPVs) varied depending on the specific outcomes and algorithms evaluated. Specific algorithms to evaluate the presence of stroke and intracranial bleeds were found to have high PPVs (80% or greater). Algorithms to evaluate TIAs in adult populations were generally found to have PPVs of 70% or greater.
ConclusionsThe algorithms and definitions to identify CVAs and TIAs using administrative and claims data differ greatly in the published literature. The choice of the algorithm employed should be determined by the stroke subtype of interest.
Keywords: cerebrovascular accident, transient ischemic attack, validation, administrative data
IntroductionAdministrative and claims databases of health plans and government programs (hereafter referred to as “administrative data”), such as Medicare and Medicaid, are often used to conduct epidemiologic and drug safety research. To conduct these studies and perform surveillance activities using these administrative data sources, it is important to determine the validity of the diagnostic information they contain.
A number of studies have been conducted using administrative data to evaluate the association between various medications and the acute manifestations of cerebrovascular disease.1–9 Evaluation of the validity of diagnostic codes for cerebrovascular accident (CVA) and transient ischemic attack (TIA) documented in administrative data is complicated by the differing stroke subtypes based on pathophysiology (e.g., ischemic versus hemorrhagic strokes). Cerebrovascular disease encompasses a diverse set of conditions related to the blood vessels supplying the brain. A stroke or cerebrovascular accident (CVA) is defined by the World Health Organization (WHO) as “rapidly developing clinical signs of focal (or global) disturbance of cerebral function, with symptoms lasting 24 hours or longer or leading to death, with no apparent cause other than of vascular origin.” 10–11 A transient ischemic attack (TIA) is defined by this international organization as a sudden, focal neurologic deficit with symptoms lasting less than 24 hours.10–11
The aim of the present study was to perform a systematic review of studies that have evaluated the validity of diagnosis codes and algorithms developed using administrative health plan data to identify CVAs (ischemic and hemorrhagic strokes, intracerebral hemorrhage and subarachnoid hemorrhage) and TIAs. This project was conducted as part of the U.S. Food and Drug Administration Mini-Sentinel program. The full report can be found at http://mini-sentinel.org/foundational_activities/related_projects/default.aspx.
MethodsThe methods and search strategy for Mini-Sentinel systematic reviews are described in the accompanying manuscript by Carnahan.12 Briefly, PubMed and Iowa Drug Information Service (IDIS) searches of the English language literature were performed to identify studies published between 1990 and 2010 that evaluated the validity of algorithms for identifying CVAs and/or TIAs in administrative data. Search terms related to administrative data are described in detail by Carnahan12 and were included in all Mini-Sentinel systematic review searches. In addition, the following key words were used as PubMed search terms for the CVA/TIA review: (“Brain Ischemia”[Mesh] OR “Basal Ganglia Cerebrovascular Disease”[Mesh]) OR “Carotid Artery Thrombosis”[Mesh]) OR “Intracranial Embolism and Thrombosis”[Mesh]) OR “Intracranial Hemorrhages”[Mesh]) OR “Stroke”[Mesh]) OR “Vasospasm, Intracranial”[Mesh]. The IDIS search included specification of the following terms: 435. or 432. or 433.1 or 434. or 436. (NOTE: 435. ISCHEMIA, CEREBRAL, TRANSIENT, 432. HEMORRHAGE, INTRACRANIAL NEC, 433.1 EMBOLISM/THROMBOSIS, CAROTID, 434. EMBOLISM/THROMBOSIS, CEREB, 436. DISEASE, CEREBROVASCULAR NEC) for the disease and “ischemi*” or “intracranial” or “stroke” in the abstract.
Two study investigators independently reviewed the abstracts to identify potentially relevant articles for retrieval; articles identified as potentially relevant by either investigator were retrieved. The study investigators independently reviewed the articles with a goal of identifying validation of CVAs or TIAs described in the article itself or from the reference section of the article if it included validation studies. Citations from the article’s references were selected for full-text review if they were cited as a source for the algorithm to identify CVAs or TIAs, or were otherwise deemed likely to be relevant. Discrepancies regarding the inclusion of a study for the review report were resolved by consensus following the independent reviews.
Mini-Sentinel investigators were surveyed to request information on any published or unpublished studies that validated an algorithm to identify CVAs or TIAs in administrative data. These studies were similarly reviewed by two study investigators to determine their relevance.
A single investigator abstracted information on the study design and population, algorithm, and validation statistics for each study. The data were confirmed by a second investigator for accuracy. Based upon the specific outcomes reported, we categorized studies by the following CVA/stroke subtypes: acute events including 1) strokes, 2) TIAs, and 3) intracranial bleeds (intracerebral hemorrhage and subarachnoid hemorrhage), and 4) the composite endpoints of stroke/TIA or cerebrovascular disease (including prevalent disease).
Results Identification and selection of articlesOverall, 1,480 abstracts were reviewed; 587 were selected for full-text review. A total of 35 studies were included in the evidence tables (17 from the initial search strategy, 12 through references of articles that underwent full-text review, and 6 provided by Mini-Sentinel investigators and outside reviewers).9,13–46 Of these studies, 26 provided data to evaluate the validity of algorithms to identify stroke, 7 provided data to evaluate the validity of TIAs, 5 provided data to evaluate the validity of intracranial bleeds, and 10 studies provided data to evaluate the composite endpoints of stroke/TIA or cerebrovascular disease. The algorithms for each of these outcomes are reported separately below.
Algorithms and ValidationSee Appendix 1 for definitions of stroke-related codes.
Appendix 1.List and Definitions of ICD or Procedural Codes Included in Algorithms
Type of Code Code Description ICD-9 325 PHLEBITIS AND THROMBOPHLEBITIS OF INTRACRANIAL VENOUS SINUSES ICD-9 342 HEMIPLEGIA ICD-9 342.0 FLACCID HEMIPLEGIA ICD-9 342.00 FLACCID HEMIPLEGIA UNSPECIFIED SIDE ICD-9 342.01 FLACCID HEMIPLEGIA DOMINANT SIDE ICD-9 342.02 FLACCID HEMIPLEGIA NONDOMINANT SIDE ICD-9 342.1 SPASTIC HEMIPLEGIA ICD-9 342.10 SPASTIC HEMIPLEGIA UNSPECIFIED SIDE ICD-9 342.11 SPASTIC HEMIPLEGIA DOMINANT SIDE ICD-9 342.12 SPASTIC HEMIPLEGIA NONDOMINANT SIDE ICD-9 342.80 OTHER SPECIFIED HEMIPLEGIA UNSPECIFIED SIDE ICD-9 342.81 OTHER SPECIFIED HEMIPLEGIA DOMINANT SIDE ICD-9 342.82 OTHER SPECIFIED HEMIPLEGIA NONDOMINANT SIDE ICD-9 342.9 HEMIPLEGIA UNSPECIFIED ICD-9 342.90 UNSPECIFIED HEMIPLEGIA UNSPECIFIED SIDE ICD-9 342.91 UNSPECIFIED HEMIPLEGIA DOMINANT SIDE ICD-9 342.92 UNSPECIFIED HEMIPLEGIA NONDOMINANT SIDE ICD-9 362.3 RETINAL VASCULAR OCCLUSION ICD-9 369.0 PROFOUND BLINDNESS BOTH EYES ICD-9 369.00 BOTH EYES BLIND-WHO DEFINITION ICD-9 369.01 TOTAL IMPAIRMENT-BOTH EYES ICD-9 369.02 ONE EYE-NEAR TOTAL IMPAIRMENT/OTHER EYE-NOT SPECIFIED ICD-9 369.03 ONE EYE-NEAR TOTAL IMPAIRMENT/OTHER EYE-TOTAL IMPAIRMENT ICD-9 369.04 NEAR-TOTAL IMPAIRMENT-BOTH EYES ICD-9 369.05 ONE EYE-PROFOUND IMPAIRMENT/OTHER EYE-NOT SPECIFIED ICD-9 369.07 ONE EYE-PROFOUND IMPAIRMENT/OTHER EYE-NEAR TOTAL IMPAIRMENT ICD-9 369.08 PROFOUND IMPAIRMENT BOTH EYES ICD-9 369.1 MODERATE/SEVERE IMPAIRMENT ONE EYE WITH PROFOUND IMPAIRMENT OTHER EYE ICD-9 369.10 BLINDNESS/LOW VISION ICD-9 369.11 ONE EYE-SEVERE/OTHER EYE-BLIND NOT SPECIFIED ICD-9 369.12 ONE EYE-SEVERE/OTHER EYE-TOTAL IMPAIRMENT ICD-9 369.13 ONE EYE-SEVERE/OTHER EYE-NEAR TOTAL IMPAIRMENT ICD-9 369.14 ONE EYE-SEVERE/OTHER EYE-PROFOUND IMPAIRMENT ICD-9 369.15 ONE EYE-MODERATE/OTHER EYE-BLIND ICD-9 369.16 ONE EYE-MODERATE/OTHER EYE-TOTAL IMPAIRMENT ICD-9 369.17 ONE EYE-MODERATE/OTHER EYE-NEAR TOTAL IMPAIRMENT ICD-9 369.18 ONE EYE-MODERATE/OTHER EYE-PROFOUND IMPAIRMENT ICD-9 369.2 MODERATE/SEVERE IMPAIRMENT-BOTH EYES ICD-9 369.20 LOW VISION, TWO EYES NOT SPECIFIED ICD-9 369.21 ONE EYE-SEVERE/OTHER EYE-NOT SPECIFIED ICD-9 369.22 SEVERE IMPAIRMENT-BOTH EYES ICD-9 369.23 ONE EYE-MODERATE/OTHER EYE-NOT SPECIFIED ICD-9 369.24 ONE EYE-MODERATE/OTHER EYE-SEVERE IMPAIRMENT ICD-9 369.25 MODERATE IMPAIRMENT-BOTH EYES ICD-9 369.3 BLINDNESS NOT SPECIFIED, BOTH EYES ICD-9 369.4 LEGAL BLINDNESS-USA DEFINITION ICD-9 369.6 PROFOUND IMPAIRMENT-ONE EYE ICD-9 369.60 BLINDNESS, ONE EYE ICD-9 369.61 ONE EYE-TOTAL IMPAIRMENT/OTHER EYE-UNKNOWN ICD-9 369.62 ONE EYE-TOTAL IMPAIRMENT/OTHER EYE-NEAR NORMAL ICD-9 369.63 ONE EYE-TOTAL IMPAIRMENT/OTHER EYE-NORMAL ICD-9 369.64 ONE EYE-NEAR TOTAL IMPAIRMENT/OTHER EYE-NOT SPECIFIED ICD-9 369.65 NEAR-TOTAL IMPAIRMENT/OTHER EYE-NEAR-NORMAL ICD-9 369.66 NEAR-TOTAL IMPAIRMENT/OTHER EYE NORMAL ICD-9 369.67 ONE EYE-PROFOUND IMPAIRMENT/OTHER EYE-UNKNOWN ICD-9 369.68 PROFOUND IMPAIRMENT/OTHER EYE-NEAR NORMAL ICD-9 369.69 PROFOUND IMPAIRMENT/OTHER EYE-NORMAL ICD-9 369.7 MODERATE/SEVERE IMPAIRMENT, ONE EYE ICD-9 369.70 LOW VISION, ONE EYE ICD-9 369.71 ONE EYE-SEVERE/OTHER EYE-UNKNOWN ICD-9 369.72 ONE EYE-SEVERE/OTHER EYE-NEAR NORMAL ICD-9 369.74 ONE EYE-MODERATE/OTHER EYE-UNKNOWN ICD-9 369.75 ONE EYE-MODERATE/OTHER EYE-NEAR NORMAL ICD-9 369.76 ONE EYE-MODERATE/OTHER EYE NORMAL ICD-9 369.8 VISUAL LOSS, ONE EYE NOT SPECIFIED ICD-9 369.9 VISUAL LOSS NOT SPECIFIED ICD-9 430 SUBARACHNOID HEMORRHAGE ICD-9 431 INTRACEREBRAL HEMORRHAGE ICD-9 432 INTRACRANIAL HEMORRHAGE, OTHER AND UNSPECIFIED ICD-9 432.0 NONTRAUMATIC EXTRADURAL HEMORRHAGE ICD-9 432.1 SUBDURAL HEMORRHAGE ICD-9 432.9 INTRACRANIAL HEMORRHAGE NOT SPECIFIED ICD-9 433 PRECEREBRAL OCCLUSION ICD-9 433.0 BASILAR ARTERY OCCLUSION ICD-9 433.00 OCCLUSION BASILAR ARTERY WITHOUT MENTION OF INFARCTION ICD-9 433.01 OCCLUSION BASILAR ARTERY WITH INFARCTION ICD-9 433.1 CAROTID ARTERY OCCLUSION ICD-9 433.10 OCCLUSION CAROTID ARTERY WITHOUT MENTION OF INFARCTION ICD-9 433.11 OCCLUSION CAROTID ARTERY WITH INFARCTION ICD-9 433.2 VERTEBRAL ARTERY OCCLUSION ICD-9 433.20 OCCLUSION VERTEBRAL ARTERY WITHOUT MENTION OF INFARCTION ICD-9 433.21 OCCLUSION VERTEBRAL ARTERY WITH INFARCTION ICD-9 433.3 MULTIPLE AND BILATERAL PRECEREBRAL OCCLUSION ICD-9 433.30 OCCLUSION MULTIPLE AND BILATERAL ARTERY WITHOUT MENTION OF INFARCTION ICD-9 433.31 OCCLUSION MULTIPLE AND BILATERAL ARTERY WITH INFARCTION ICD-9 433.8 PRECEREBAL OCCLUSION, OTHER SPECIFIED ICD-9 433.80 OCCLUSION SPECIFID ARTERY WITHOUT MENTION OF INFARCTION ICD-9 433.81 OCCLUSION SPECIFIED ARTERY WITH INFARCTION ICD-9 433.9 PRECEREBRAL OCCLUSION UNSPECIFIED ICD-9 433.90 OCCLUSION ARTERY UNSPECIFIED WITHOUT MENTION OF INFARCTION ICD-9 433.91 OCCLUSION ARTERY UNSPECIFIED WITH INFARCTION ICD-9 434 CEREBRAL ARTERY OCCLUSION ICD-9 434.0 CEREBRAL THROMBOSIS ICD-9 434.00 CEREBRAL THROMBOSIS WITHOUT MENTION OF INFARCTION ICD-9 434.01 CEREBRALL THROMBOSIS WITH INFARCTION ICD-9 434.1 CEREBRAL EMBOLISM ICD-9 434.10 CEREBRAL EMBOLISM WITHOUT MENTION OF INFARCTION ICD-9 434.11 CEREBRAL EMBOLISM WITH INFARCTION ICD-9 434.9 CEREBRAL ARTERY OCCLUSION UNSPECIFIED ICD-9 434.90 CEREBRAL ARTERY OCCLUSION UNSPECIFIED WITHOUT MENTION OF INFARCTION ICD-9 434.91 CEREBRAL ARTERY OCCLUSION UNSPECIFIED WITH INFARCTION ICD-9 435 TRANSIENT CEREBRAL ISCHEMIA ICD-9 435.0 BASILAR ARTERY SYNDROME ICD-9 435.1 VERTEBRAL ARTERY SYNDROME ICD-9 435.2 SUBCLAVIAN STEAL SYNDROME ICD-9 435.3 VERTEBROBASILAR ARTERY SYNDROME ICD-9 435.8 TRANSIENT CEREBRAL ISCHEMIA OTHER SPECIFIED ICD-9 435.9 TRANSIENT CEREBRAL ISCHEMIA UNSPECIFIED ICD-9 436 ACUTE CEREBROVASCULAR DISEASE ICD-9 437 OTHER CEREBROVASCULAR DISEASE ICD-9 437.0 CEREBRAL ATHEROSCLEROSIS ICD-9 437.1 ACUTE CEREBROVASCULAR INSUFFICIENCY NOT SPECIFIED ICD-9 437.2 HYPERTENSIVE ENCEPHALOPATHY ICD-9 437.3 NONRUPTURED CEREBRAL ANEURYM ICD-9 437.4 CEREBRAL ARTERITIS ICD-9 437.5 MOYAMOYA DISEASE ICD-9 437.6 NONPYOGENIC THROMBOSIS SINUS ICD-9 437.7 TRANSIENT GLOBAL AMNESIA ICD-9 437.8 CEREBROVASCULAR DISEASE OTHER ICD-9 437.9 CEREBROVASC DISEASE UNSPECIFIED ICD-9 438 LATE EFFECTS CEREBROVASCULAR DISEASE ICD-9 438.0 LATE EFFECTS CEREBROVASCULAR DISEASE-COGNITIVE DEFICITS ICD-9 438.10 LATE EFFECTS CEREBROVASCULAR DISEASE - SPEECH/LANGUAGE DEFICITS UNSPECIFIED ICD-9 438.11 LATE EFFECTS CEREBROVASCULAR DISEASE - APHASIA ICD-9 438.12 LATE EFFECTS CEREBROVASCULAR DISEASE-DYSPHASIA ICD-9 438.19 LATE EFFECTS CEREBROVASCULAR DISEASE-SPEECH/LANGUAGE DEFICITS OTHER ICD-9 438.20 LATE EFFECTS CEREBROVASCULAR DISEASE-HEMIPLEGIA UNSPECIFIED SIDE ICD-9 438.21 LATE EFFECTS CEREBROVASCULAR DISEASE-HEMIPLEGIA DOMINANT SIDE ICD-9 438.22 LATE EFFECTS CEREBROVASCULAR DISEASE-HEMIPLEGIA NONDOMINANT SIDE ICD-9 438.30 LATE EFFECTS CEREBROVASCULAR DISEASE-MONOPLEGIA UPPER LIMB UNSPECIFIED ICD-9 438.31 LATE EFFECTS CEREBROVASCULAR DISEASE-MONOPLEGIA UPPER LIMB DOMINANT SIDE ICD-9 438.32 LATE EFFECTS CEREBROVASCULAR DISEASE-MONOPLEGIA UPPER LIMB NONDOMINANT SIDE ICD-9 438.40 LATE EFFECTS CEREBROVASCULAR DISEASE-MONOPLEGIA LOWER LIMB UNSPECIFIED ICD-9 438.41 LATE EFFECTS CEREBROVASCULAR DISEASE-MONOPLEGIA LOWER LIMB DOMINANT SIDE ICD-9 438.42 LATE EFFECTS CEREBROVASCULAR DISEASE-MONOPLEGIA LOWER LIMB NONDOMINANT SIDE ICD-9 438.50 LATE EFFECTS CEREBROVASCULAR DISEASE-OTHER PARALYTIC SYNDROME UNSPECIFIED SIDE ICD-9 438.51 LATE EFFECTS CEREBROVASCULAR DISEASE-OTHER PARALYTIC SYNDROME DOMINANT SIDE ICD-9 438.52 LATE EFFECTS CEREBROVASCULAR DISEASE-OTHER PARALYTIC SYNDROME NONDOMINANT SIDE ICD-9 438.53 LATE EFFECTS CEREBROVASCULAR DISEASE-OTHER PARALYTIC SYNDROME-BILATERAL ICD-9 438.81 LATE EFFECTS CEREBROVASCULAR DISEASE-APRAXIA ICD-9 438.82 LATE EFFECTS CEREBROVASCULAR DISEASE-DYSPHAGIA ICD-9 438.89 LATE EFFECTS CEREBROVASCULAR DISEASE-OTHER ICD-9 438.9 LATE EFFECTS CEREBROVASCULAR DISEASE-UNSPECIFIED ICD-9 671.5 OTHER THROMBOSIS COMPLICATING PREGNANCY ICD-9 674.0 CEREBROVASCULAR DISEASE IN PUERPERIUM ICD-9 747.81 CEREBROVASCULAR ANOMALY ICD-9 767 BIRTH TRAUMA ICD-9 767.0 CEREBRAL HEMHORRAGE AT BIRTH ICD-9 780.0 COMA AND STUPOR ICD-9 780.4 DIZZINESS AND GIDDINESS ICD-9 800.2 CLOSED SKULL VAULT FRACTURE/HEMORRHAGE ICD-9 800.3 CLOSED SKULL VAULT FRACTURE/HEMORRHAGE OTHER ICD-9 800.7 OPEN SKULL VAULT FRACTURE/HEMORRHAGE ICD-9 800.8 OPEN SKULL VAULT FRACTURE/HEMORRHAGE OTHER ICD-9 801.2 CLOSED SKULL BASE FRACTRE/HEMORRHAGE ICD-9 801.3 CLOSED SKULL BASE FRACTURE/HEMORRHAGE OTHER ICD-9 801.7 OPEN SKULL BASE FACTURE/HEMORRHAGE ICD-9 801.8 OPEN SKULL BASE FRACTURE-/HEMORRHAGE ICD-9 803.2 CLOSED SKULL FRACTURE OTHER/HEMORRHAGE ICD-9 803.3 CLOSED SKULL FRACTURE OTHER/HEMORRHAGE OTHER ICD-9 803.7 OPEN SKULL FRACTURE OTHER/HEMORRHAGE ICD-9 803.8 OPEN SKULL FRACTURE OTHER/HEMORRHAGE OTHER ICD-9 804.2 CLOSED SKULL/OTHER FRACTURE/HEMORRHAGE ICD-9 804.3 CLOSED SKULL OTHER FRACTURE/HEMORRHAGE OTHER ICD-9 804.7 OPEN SKULL/OTHER FRACTURE-HEMORRHAGE ICD-9 804.8 OPEN SKULL OTHER FRACTURE/HEMORRHAGE OTHER ICD-9 852 SUBARACHNOID, SUBDURAL, EXTRADURAL HEMORRHAGE FOLLOW INJURY ICD-9 852.0 TRAUMATIC SUBARACHNOID HEMORRHAGE ICD-9 852.00 TRAUMATIC SUBARACHNOID HEMORRHAGE ICD-9 852.01 SUBARACHNOID HEMORRHAGE-NO COMA ICD-9 852.02 SUBARACHNOID HEMORRHAGE-BRIEF COMA ICD-9 852.03 SUBARACHNOID HEMORRHAGE-MODERATE COMA ICD-9 852.04 SUBARACHNOID HEMORRHAGE-PROLONGED COMA ICD-9 852.05 SUBARACHNOID HEMORRHAGE-DEEP COMA ICD-9 852.06 SUBARACHNOID HEMORRHAGE-COMA UNSPECIFIED ICD-9 852.09 SUBARACHNOID HEMORRHAGE-CONCUSSION ICD-9 852.1 SUBARACHNOID HEMORRHAGE WITH OPEN WOUND ICD-9 852.10 SUBARACHNOID HEMORRHAGE WITH OPEN WOUND ICD-9 852.11 OPEN SUBARACHNOID HEMORRHAGE-NO COMA ICD-9 852.16 OPEN SUBARACHNOID HEMORRHAGE-COMA UNSPECIFIED ICD-9 852.2 TRAUMATIC SUBDURAL HEMORRHAGE ICD-9 852.20 TRAUMATIC SUBDURAL HEMORRHAGE ICD-9 852.21 SUBDURAL HEMORRHAGE WITHOUT COMA ICD-9 852.22 SUBDURAL HEMORRHAGE-BRIEF COMA ICD-9 852.23 SUBDURAL HEMORRHAGE-MODERATE COMA ICD-9 852.24 SUBDURAL HEMORRHAGE-PROLONGED COMA ICD-9 852.25 SUBDURAL HEMORRHAGE-DEEP COMA ICD-9 852.26 SUBDURAL HEMORRHAGE-COMA UNSPECIFIED ICD-9 852.29 SUBDURAL HEMORRHAGE-CONCUSSION ICD-9 852.3 SUBDURAL HEMORRHAGE WITH OPEN WOUND ICD-9 852.30 SUBDURAL HEMORRHAGE WITH OPEN WOUND ICD-9 852.31 OPEN SUBDURAL HEMORRHAGE WITHOUT COMA ICD-9 852.4 TRAUMATIC EXTRADURAL HEMORRHAGE ICD-9 852.40 TRAUMATIC EXTRADURAL HEMORRHAGE ICD-9 852.41 EXTRADURAL HEMORRHAGE WITHOUT COMA ICD-9 852.42 EXTRADUR HEMORRHAGE-BRIEF COMA ICD-9 852.43 EXTRADURAL HEMORRHAGE-MODERATE COMA ICD-9 852.44 EXTRADURAL HEMORRHAGE-PROLONGED COMA ICD-9 852.45 EXTRADURAL HEMORRHAGE-DEEP COMA ICD-9 852.46 EXTRADURAL HEMORRHAGE-COMA UNSPECIFIED ICD-9 852.50 EXTRADURAL HEMORRHAGE WITH OPEN WOUND ICD-9 852.52 EXTRADUR HEMORRHAGE-BRIEF COMA ICD-9 852.56 EXTRADURAL HEMORRHAGE-COMA UNSPECIFIED ICD-9 852.59 EXTRADURAL HEMORRHAGE-CONCUSSION ICD-9 853 OTHER TRAUMATIC BRAIN HEMORRHAGE ICD-9 853.0 TRAUMATIC BRAIN HEMORRHAGE OTHER ICD-9 853.00 TRAUMATIC BRAIN HEMORRHAGE OTHER ICD-9 853.01 BRAIN HEMORRHAGE OTHER WITHOUT COMA ICD-9 853.02 BRAIN HEMORRHAGE OTHER-BRIEF COMA ICD-9 853.03 BRAIN HEMORRHAGE OTHER-MODERATE COMA ICD-9 853.04 BRAIN HEMORRHAGE OTHER-PROLONGED COMA ICD-9 853.05 BRAIN HEMORRHAGE OTHER-DEEP COMA ICD-9 853.06 BRAIN HEMORRHAGE OTHER-COMA UNSPECIFIED ICD-9 853.09 BRAIN HEMORRHAGE OTHER-CONCUSSION ICD-9 853.1 BRAIN HEMORRHAGE OTHER WITH OPEN WOUND ICD-9 853.10 BRAIN HEMORRHAGE WITH OPEN WOUND ICD-9 853.11 BRAIN HEMORRHAGE OPEN WOUND WITHOUT COMA ICD-9 853.12 BRAIN HEMORRHAGE OPEN WOUND-BRIEF COMA ICD-9 853.14 BRAIN HEMORRHAGE OPEN WOUNF-PROLONGED COMA ICD-9 853.15 BRAIN HEMORRHAGE OPEN WOUND-DEEP COMA ICD-9 853.19 BRAIN HEMORRHAGE OPEN WOUND-CONCUSSION ICD-9 997.00 NERVOUS SYSTEM COMPLICATION UNSPECIFIED ICD-9 997.01 SURGICAL COMPLICATION CENTRAL NERVOUS SYSTEM ICD-9 997.02 IATROGENIC CEREBROVASCULAR INFARCTION/HEMORRHAGE ICD-9 997.09 SURGICAL COMPLICATION NERVOUS SYSTM OTHER ICD-9 V57 REHABILITATION PROCEDURE ICD-9 V57.0 BREATHING EXERCISES ICD-9 V57.1 PHYSICAL THERAPY OTHER ICD-9 V57.2 OCCUPATIONAL/VOCATIONAL THERAPY ICD-9 V57.21 ENCOUNTER OCCUPATIONAL THERAPY ICD-9 V57.22 ENCOUNTER VOCATIONAL THERAPY ICD-9 V57.3 SPEECH THERAPY ICD-9 V57.4 ORTHOPTIC TRAINING ICD-9 V57.8 OTHER REHABILITATION PROCEDURE ICD-9 V57.81 ORTHOTIC TRAINING ICD-9 V57.89 REHABILITATION PROCEDURE OTHER ICD-9 V57.9 REHABILITATION PROCEDURE UNSPECIFIED ICD-9 procedure 38.12 ENDARTERECTOMY ICD-9 procedure 38.42 RESECTION VESSEL WITH REPLACEMENT-HEAD AND NECK ICD-10 G45 TRANSIENT ISCHEMIC ATTACK/RELATED SYNDROMES ICD-10 G45.0 VERTEBRO-BASILAR ARTERY SYNDROME ICD-10 G45.1 CAROTID ARTERY SYNDROME (HEMISPHERIC) ICD-10 G45.2 MULTIPLE/BILATERAL PRECEREBRAL ARTERY SYNDROME ICD-10 G45.3 AMAUROSIS FUGAX ICD-10 G45.4 TRANSIENT GLOBAL AMNESIA ICD-10 G45.8 OTHER TRANSIENT ISCHEMIC ATTACK/RELATED SYNDROMES ICD-10 G45.9 TRANSIENT CEREBRAL ISCHEMIC ATTACK, UNSPECIFIED ICD-10 G46 VASCULAR SYNDROME BRAIN IN CEREBROVASCULAR DISEASES ICD-10 G46.0 MIDDLE CEREBRAL ARTERY SYNDROME ICD-10 G46.1 ANTERIOR CEREBRAL ARTERY SYNDROME ICD-10 G46.2 POSTERIOR CEREBRAL ARTERY SYNDROME ICD-10 G46.3 BRAIN STEM STROKE SYNDROME ICD-10 G46.4 CEREBELLAR STROKE SYNDROME ICD-10 G46.5 PURE MOTOR LACUNAR SYNDROME ICD-10 G46.6 PURE SENSORY LACUNAR SYNDROME ICD-10 G46.7 OTHER LACUNAR SYNDROMES ICD-10 G46.8 OTH VASCULAR SYND BRAIN IN CEREBROVASCULAR DISEASES ICD-10 H34.0 TRANSIENT RETINAL ARTERY OCCLUSION ICD-10 H34.1 CENTRAL RETINAL ARTERY OCCLUSION ICD-10 I60 SUBARACHNOID HEMORRHAGE ICD-10 I60.0 SUBARACHNOID HEMORRHAGE CAROTID SIPHON AND BIFURCATION ICD-10 I60.1 SUBARACHNOID HEMORRHAGE MIDDLE CEREBRAL ARTERY ICD-10 I60.2 SUBARACHNOID HEMORRHAGE ANTERIOR COMMUNICATING ARTERY ICD-10 I60.3 SUBARACHNOID HEMORRHAGE POSTERIOR COMMUNICATING ARTERY ICD-10 I60.4 SUBARACHNOID HEMORRHAGE FROM BASILAR ARTERY ICD-10 I60.5 SUBARACHNOID HEMORRHAGE FROM VERTEBRAL ARTERY ICD-10 I60.6 SUBARACHNOID HEMORRHAGE FROM OTHER INTRACRANIAL ARTERIES ICD-10 I60.7 SUBARACHNOID HEMORRHAGE FROM INTRACRANIAL ARTERY ICD-10 I60.8 OTHER SUBARACHNOID HEMORRHAGE ICD-10 I60.9 SUBARACHNOID HEMORRHAGE, UNSPECIFIED ICD-10 I61 INTRACEREBRAL HEMORRHAGE ICD-10 I61.0 INTRACEREBRAL HEMORRHAGE IN HEMISPHERE, SUBCORTICAL ICD-10 I61.1 INTRACEREBRAL HEMORRHAGE IN HEMISPHERE, CORTICAL ICD-10 I61.2 INTRACEREBRAL HEMORRHAGE IN HEMISPHERE, UNSPECIFIED ICD-10 I61.3 INTRACEREBRAL HEMORRHAGE IN BRAIN STEM ICD-10 I61.4 INTRACEREBRAL HEMORRHAGE IN CEREBELLUM ICD-10 I61.5 INTRACEREBRAL HEMORRHAGE, INTRAVENTRICULAR ICD-10 I61.6 INTRACEREBRAL HEMORRHAGE, MULTIPLE LOCALISED ICD-10 I61.8 OTHER INTRACEREBRAL HEMORRHAGE ICD-10 I61.9 INTRACEREBRAL HEMORRHAGE, UNSPECIFIED ICD-10 I62 OTHER NONTRAUMATIC INTRACRANIAL HEMORRHAGE ICD-10 I62.0 SUBDURAL HEMORRHAGE (ACUTE) (NONTRAUMATIC) ICD-10 I62.1 NONTRAUMATIC EXTRADURAL HEMORRHAGE ICD-10 I62.9 INTRACRANIAL HEMORRHAGE (NONTRAUMATIC), UNSPECIFIED ICD-10 I63 CEREBRAL INFARCTION ICD-10 I63.0 CEREBRAL INFARCTION DUE TO THROMBOSIS OF PRECEREBRAL ARTERIES ICD-10 I63.1 CEREBRAL INFARCTION DUE TO EMBOLISM OF PRECEREBRAL ARTERIES ICD-10 I63.2 CEREBRAL INFARCTION DUE TO UNSPECIFIED OCCLUSION OF PRECEBRAL ARTERIES ICD-10 I63.3 CEREBRAL INFARCTION DUE TO THROMBOSIS OF CEREBRAL ARTERIES ICD-10 I63.4 CEREBRAL INFARCTION DUE TO EMBOLISM OF CEREBRAL ARTERIES ICD-10 I63.5 CEREBRAL INFARCTION DUE TO UNSPECIFIED OCCLUSION OF CEREBRAL ARTERIES ICD-10 I63.6 CEREBRAL INFARCTION DUE TO CEREBRAL VENOUS THROMBOSIS ICD-10 I63.8 OTHER CEREBRAL INFARCTION ICD-10 I63.9 CEREBRAL INFARCTION, UNSPECIFIED ICD-10 I64 STROKE, NOT SPECIFIED AS HEMORRHAGE OR INFARCTION ICD-10 I65 OCCLUSION/STENOSIS PRECEREBRAL ARTERIES, NOT RESULTING IN INFARCTION ICD-10 I65.0 OCCLUSION AND STENOSIS OF VERTEBRAL ARTERY ICD-10 I65.1 OCCLUSION AND STENOSIS OF BASILAR ARTERY ICD-10 I65.2 OCCLUSION AND STENOSIS OF CAROTID ARTERY ICD-10 I65.3 OCCLUSION AND STENOSIS OF MULTIPLE AND BILATERAL PRECEBRAL ARTERIES ICD-10 I65.8 OCCLUSION AND STENOSIS OF OTHER PRECEREBRAL ARTERY ICD-10 I65.9 OCCLUSION AND STENOSIS OF UNSPECIFIED PRECEREBRAL ARTERY ICD-10 I66 OCCLUSION/STENOSIS OF CEREBRAL ARTERIES, NOT RESULTING IN INFARCTION ICD-10 I66.0 OCCLUSION AND STENOSIS OF MIDDLE CEREBRAL ARTERY ICD-10 I66.1 OCCLUSION AND STENOSIS OF ANTERIOR CEREBRAL ARTERY ICD-10 I66.2 OCCLUSION AND STENOSIS OF POSTERIOR CEREBRAL ARTERY ICD-10 I66.3 OCCLUSION AND STENOSIS OF CEREBELLAR ARTERIES ICD-10 I66.4 OCCLUSION AND STENOSIS OF MULTIPLE AND BILATERAL ICD-10 I66.8 OCCLUSION AND STENOSIS OF OTHER CEREBRAL ARTERY ICD-10 I66.9 OCCLUSION AND STENOSIS OF UNSPECIFIED CEREBRAL ARTERY ICD-10 I67 OTHER CEREBROVASCULAR DISEASES ICD-10 I67.0 DISSECTION OF CEREBRAL ARTERIES, NONRUPTURED ICD-10 I67.1 CEREBRAL ANEURYSM, NONRUPTURED ICD-10 I67.2 CEREBRAL ATHEROSCLEROSIS ICD-10 I67.3 PROGRESSIVE VASCULAR LEUKOENCEPHALOPATHY ICD-10 I67.4 HYPERTENSIVE ENCEPHALOPATHY ICD-10 I67.5 MOYAMOYA DISEASE ICD-10 I67.6 NONPYOGENIC THROMBOSIS OF INTRACRANIAL VENOUS SYSTEM ICD-10 I67.7 CEREBRAL ARTERITIS, NOT ELSEWHERE CLASSIFIED ICD-10 I67.8 OTHER SPECIFIED CEREBROVASCULAR DISEASES ICD-10 I67.9 CEREBROVASCULAR DISEASE, UNSPECIFIED ICD-10 I68 CEREBROVASCULAR DISORDERS IN DISEASES CLASSIFIED ELSEWHERE ICD-10 I68.0 CEREBRAL AMYLOID ANGIOPATHY ICD-10 I68.1 CEREBRAL ARTERITIS IN INFECTIOUS AND PARASITIC DISEASE ICD-10 I68.2 CEREBRAL ARTERITIS IN OTHER DISEASES CLASSIFIED ELSEWHERE ICD-10 I68.8 OTHER CEREBROVASCULAR DISORDERS IN DISEASES CLASSIFIED ELSEWHERE ICD-10 I69 SEQUELAE OF CEREBROVASCULAR DISEASE ICD-10 I69.0 SEQUELAE OF SUBARACHNOID HEMORRHAGE ICD-10 I69.1 SEQUELAE OF INTRACEREBRAL HEMORRHAGE ICD-10 I69.2 SEQUELAE OF OTH NONTRAUMATIC INTRACRANIAL HEMORRHAGE ICD-10 I69.3 SEQUELAE OF CEREBRAL INFARCTION ICD-10 I69.4 SEQUELAE OF STROKE, NOT SPECIFIED AS HEMORRHAGE ICD-10 I69.8 SEQUELAE OF OTHER AND UNSPECIFIED CEREBROVASCULAR DISEASES Stroke (ischemic, hemorrhagic and unspecified) Validation AlgorithmsIn general, studies that evaluated the validity of 3-, 4-, or 5-digit ICD-9 codes in the range 430.x to 438.x reported the highest PPVs for codes 430.x, 431.x, 434.x, and 436.x. For most studies evaluating codes 430.x, 431.x, or 434.x separately, the reported PPVs were 80% or higher (Table 1). For most studies evaluating code 436.x, the PPVs were 70% or higher. While most studies reported low PPVs for code 433.x, one study that evaluated hospital discharge codes 433.x1 separately from 433.x0 reported a much higher PPV for codes 433.x1 (71% compared with 13%).38 The fifth digit specification of 0 indicates that the diagnosis of occlusion and stenosis of precerebral arteries occurred without mention of cerebral infarction.
Table 1.Positive Predictive Values of Algorithms to Identify Cerebrovascular Accident (CVA)/Stroke
Citation Study Population and Time Period Description of Outcome Studied Algorithm Validation/Adjudication Procedure and Operational Definition Agrawal, et al.46 Kaiser Permanente of Northern California members aged 0 to 19 years, 1993 to 2003 stroke inpatient and outpatient ICD-9 codes 430, 431, 433.xx, 434.xx, 435.xx, 436, 437.x, 438.x, plus cerebral palsy (CP)-related codes: 342.x, 343.x, 344.xx Medical record review was conducted (N=1307).WHO criteria,
Minnesota Stroke Survey (MSS) criteria
neuroimaging.
The majority of studies also reported PPVs for algorithms using a combination of codes, with PPVs of 85% and higher reported for several studies. Iribarren et al.26 evaluated an algorithm including inpatient ICD-8 code 431 and ICD-9 codes 431 and 432 to identify intracerebral hemorrhagic stroke and reported a PPV of 91%. Williams et al.44 evaluated an algorithm that included primary position ICD-9 codes 434 and 436 to identify cases of acute ischemic stroke and reported a PPV of 98%. Using all hospital discharge codes (principal and secondary) 433.x1, 434 (excluding 434.x0) and 436, Tirschwell et al.43 reported a PPV of 90% for ischemic stroke. Kokotailo et al.29 evaluated an algorithm using hospitalization and emergency department most responsible diagnosis ICD-9 codes 433.x1, 434.x1, 436, and 362.8 and reported a PPV of 85% for ischemic stroke. To identify acute ischemic stroke, intracerebral hemorrhage (ICH), and subarachnoid hemorrhage (SAH), Roumie et al.40 used ICD-9 codes 430, 431, 433.x1, 434 (excluding 434.x0) and 436, and reported a PPV of 97% using primary discharge diagnosis codes. Using an algorithm including codes 430, 431, 432, 434, and 436 in the discharge abstract, Ives et al.45 reported a PPV of 90% for incident stroke.
Kokotailo et al.29 directly compared the validation of ICD-9 and ICD-10 codes for evidence of acute ischemic stroke in medical charts. This study found the PPV of ICD-10 codes H34.1, I63.x, and I64.x to be the same as the PPV of ICD-9 codes 433.x1, 434.x1, 436, and 362.8 (85%).
Validation Criteria and MethodAll studies included in this review validated administrative coding data through abstraction of medical charts. Criteria for the confirmation of stroke varied widely. Few studies stated that specific standard criteria were used to confirm cases (e.g., WHO definitions).10,11 However, the stated definitions/criteria for confirmation of stroke often included elements of such standard criteria. For example, the WHO criteria defines stroke as a new neurologic deficit of presumed vascular origin lasting at least 24 hours or until death, if death occurred within 24 hours.10,11 This definition excludes TIA, which is defined as focal neurologic symptoms lasting less than 24 hours; the definition also excludes cases of obvious nonstroke cause such as symptoms caused by trauma and tumors. While only the studies by Benesch et al.14 and Lakshminarayan et al.30 specifically stated that the WHO definitions were used, other studies39,40 listed the basic elements of the WHO criteria as necessary to confirm a case of acute stroke.
Age of study populationMany studies included only adults; no information was provided on the proportion of validated cases by age group. Three studies evaluated stroke among children.22,23,46 Golomb et al.22 evaluated inpatient and outpatient ICD-9 codes 342, 433, 434, 435, 436, 437, 438, and 767, and reported higher PPVs than those reported in studies among adult populations for a number of codes. However, Agrawal et al.46 et al. also evaluated inpatient and outpatient ICD-9 codes and generally reported lower PPVs than those reported in studies among adult populations. In another study, Golomb et al.23 evaluated ICD-9 codes 325 to identify the presence of cerebral sinovenous thrombosis in children and reported a PPV of 93%.
Patient sexNo studies provided information on the proportion of validated cases of stroke in men as compared with women. One study reported the validity of ICD-9-codes 430, 431, 432.0 to 432.1, 432.9, 434, and 436 among women enrolled in the Women’s Health Initiative.24 The overall PPV of 81% and the PPVs for specific ICD-9 codes were within the range of other studies using similar codes.
Time period of data collectionThe reported validation statistics did not vary substantially in earlier study periods (i.e., prior to 2000) compared to later study periods (e.g., 2000 and later). One study evaluated the PPVs of hospital discharge codes 431, 432, 434, 436, and 437 to identify acute stroke during 5 calendar years: 1980, 1985, 1990, 1995, and 2000.30 Using WHO criteria, the overall PPV was lowest in 1980 (55%). However, there was no consistent trend over time, as the PPV reported for the most recent year evaluated (2000) was the second lowest found (PPV=60%).
Principal vs. secondary discharge diagnosisStudies that compared algorithms using the primary discharge diagnosis to those using diagnoses in any position (primary and secondary diagnoses) found slightly higher PPVs for algorithms using the primary discharge diagnosis only (generally < 10% higher). However, one study by Roumie et al.40 reported that the PPV for the primary discharge diagnosis of stroke was 97% compared to 32% for a secondary diagnosis. The overall PPV for the algorithm using both primary and secondary diagnoses was 89% compared to 97% using only the primary discharge diagnosis.
Hospitalization diagnosis vs. outpatient encounterFew studies evaluated algorithms using both hospitalization and outpatient encounter data to identify cases of acute stroke.18,22,29,36,46 The few studies that included outpatient data had PPVs at both the higher and lower range of values observed in studies evaluating the validity of algorithms to identify stroke. In a study that evaluated pediatric strokes, Agrawal46 reported data that allowed a comparison of PPVs for inpatient versus outpatient codes, and generally reported substantially lower PPVs for outpatient codes; however, the confidence intervals for the PPVs often overlapped, given the small number of cases identified for specific codes. Thus, given the different algorithms and study populations used in the studies examined, it is difficult to adequately assess the impact of including outpatient encounter data.
TIAs Validation AlgorithmsIn 3 of the 6 studies evaluating ICD-9 codes 435.x in hospitalizations or hospitalizations/emergency department encounters for the identification of TIA (Table 2), the PPVs were 70% or higher.14,24,29 Ives et al45 reported a much lower PPV of 28%; cases were confirmed by an events committee rather than by standardized clinical criteria which may be a potential explanation for the lower percentage of cases validated. Newton et al.36 also reported a low PPV of 33%; however, this study included both inpatient and outpatient encounters and only evaluated 33 potential cases of TIA among a select population (patients diagnosed with diabetes). One study also assessed the validity of other codes (ICD-9 codes 433, 434, and 436) and found much lower PPVs than those reported for ICD-9 code 435.x (PPVs of 9% or lower for both primary and secondary diagnoses and 14% or lower for primary diagnoses).14 The PPV for ICD-9 code 435.9 reported by Holick et al.9 (28%) was also low.
Table 2.Positive Predictive Values of Algorithms to Identify Transient Ischemic Attack (TIA)
Citation Study Population and Time Period Description of Outcome Studied Algorithm Validation/Adjudication Procedure, Operational Definition, and Validation Statistics Agrawal, et al.46 Kaiser Permanente of Northern California members aged 0 to 19 years, 1993 to 2003 TIA inpatient and outpatient ICD-9 code 435.xx Medical record review was conducted.One study directly compared the validation of ICD-9 and ICD-10 codes for evidence of TIA in medical charts.29 The PPV of the ICD-10 codes (G45.x) was found to be higher than the PPV of ICD-9 code 435.x (97% vs. 70%).
Validation Criteria and MethodAll 7 studies evaluating TIAs validated administrative coding data through the abstraction of data from medical charts. Criteria for confirmation of a TIA varied widely. Documentation of a written diagnosis was adequate to confirm a TIA in some studies.9,36 One study used the WHO definition for TIA.14
Age of study populationSix studies included only adult populations. No information was provided on the proportion of validated cases of TIA by age group. One study evaluated TIA among children and reported a PPV of 67% for inpatient codes and 52% for outpatient codes.46
Patient sexNo studies provided information on the proportion of validated cases of TIA according to patient sex. One study reported the validity of ICD-9-code 435.x among women enrolled in the Women’s Health Initiative.24 The PPV of 72% was similar to those reported in 2 other studies that did not restrict the population to patients with specific conditions or sex.14,29
Time period of data collectionThe reported validation statistics did not vary substantially in earlier study periods (i.e., prior to 2000) compared to more recent periods (e.g., 2000 and later).
Principal vs. secondary discharge diagnosisBenesch et al.14 reported a PPV of 89% for patients with a primary discharge diagnosis of ICD-9 435.x and a PPV of 77% for patients with this code as either a primary or secondary discharge diagnosis. Heckbert et al.24 evaluated ICD-9 code 435.x using discharge diagnoses in any position and reported a PPV of 72%. Ives et al.45 evaluated ICD-9 code 435 in the discharge abstract, and reported a much lower PPV of 28%. Kokotailo et al.29 reported a PPV of 70% for patients with a most responsible (primary position) diagnosis of ICD-9 435.x recorded in a hospitalization or emergency department visit.
Hospitalization diagnosis vs. outpatient encounterFour studies evaluated algorithms based exclusively on hospitalizations for TIA.9,14,24,45 One study evaluating TIA in an adult population36 used both inpatient and outpatient encounters to identify patients with TIA, and reported a much lower PPV than most other studies (PPV=33%); however, this study only evaluated 33 potential cases of TIA. Another study evaluated TIA in a pediatric population and reported a PPV of 67% for inpatient codes and 52% for outpatient codes.46
Intracranial bleeds (intracerebral hemorrhage and subarachnoid hemorrhage) Validation AlgorithmsThe PPVs reported in studies evaluating intracranial bleeds using inpatient codes were 77% or higher (Table 3). The lowest PPV was reported by Birman-Deych et al.;15 this study evaluated an algorithm that used the largest number of codes (codes 430 to 432) plus a number of codes related to fracture of the skull with hemorrhage (e.g., codes 800.2, 800.3, 800.7). For studies that evaluated inpatient codes for SAH (ICD-9 codes 430.x) and ICH (ICD-9 codes 431.x) separately, the PPVs were similar for the two conditions, ranging from 82% to 98% for SAH and from 79% to 97% for ICH.
Table 3.Positive Predictive Values of Algorithms to Identify Intracranial Bleed (ICH) and Subarachnoid Hemorrhage (SAH)
Citation Study Population and Time Period Description of Outcome Studied Algorithm Validation/Adjudication Procedure, Operational Definition, and Validation Statistics Agrawal, et al.46 Kaiser Permanente of Northern California members aged 0 to 19 years, 1993 to 2003 hospitalizations and outpatient encounters (SAH and ICH) inpatient and outpatient ICD-9 codes 430, 431 Medical record review was conducted.One study directly compared the validation of ICD-9 and ICD-10 codes for evidence of intracranial bleeds in the medical charts.29 This study found the PPVs of the ICD-10 codes to be similar to those for ICD-9 codes (98% and 97% for ICH, and 91% and 98% for SAH, using ICD-10 and ICD-9 codes, respectively).
Validation Criteria and MethodAll 5 studies included in the review validated administrative coding data through abstraction of medical charts. Criteria for confirmation of intracranial bleeds varied. Two studies specifically stated that the criteria included documentation of direct visualization of blood by a physician or imaging consistent with bleeding.13,46
Age of study populationNo studies provided data on the proportion of validated cases of intracranial bleeds by age group. Agrawal et al.46 et al. evaluated inpatient and outpatient ICD-9 codes in a pediatric population and reported lower PPVs than those reported in most studies in adult populations.
Patient sexNo studies provided information on the proportion of validated cases of intracranial bleeds by patient sex.
Time period of data collectionThe reported validation statistics did not vary substantially in earlier study periods (i.e., prior to 2000) compared to later study periods (e.g., 2000 and later).
Principal vs. secondary diagnosisThe 2 studies that evaluated algorithms based upon the principal or most responsible diagnosis (primary position) reported high PPVs for ICH and SAH (89% or higher).29,43 Tirschwell et al.43 reported a PPV of 89% for patients with a primary discharge code for ICH and a PPV of 80% for patients with a primary or secondary discharge diagnosis; similarly, the investigators reported a PPV of 94% for patients with a primary discharge code for SAH and a PPV of 86% for patients with a primary or secondary discharge diagnosis. Kokotailo et al.29 reported PPVs that ranged from 91% to 98% using algorithms that identified hospitalizations and emergency department visits with a most responsible diagnosis for ICH or SAH, using ICD-9 and ICD-10 codes. However, in a study that used inpatient codes in any position, Arnason et al. also reported a high PPV for intracranial bleeds (PPV=94%).13
Hospitalization diagnosis vs. outpatient encountersOne study29 using both hospitalizations and emergency department visits reported comparable PPVs to those studies using hospitalizations only.13,15,43 Agrawal et al.46 et al. evaluated inpatient and outpatient ICD-9 codes in a pediatric population. The reported PPV for ICH was substantially higher for inpatient compared to outpatient codes (79% and 49% respectively), while the reported PPV for SAH was higher for outpatient codes compared to inpatient codes (100% and 82% respectively); however, the confidence intervals for the PPV estimates overlapped.
Composite Endpoints, Stroke/TIA or Cerebrovascular DiseaseTable 4 describes 10 publications that used ICD-9 or ICD-10 codes to identify patients with the composite endpoints of stroke/TIA or cerebrovascular disease. These studies included a variety of disease classifications (prevalent and acute), algorithms, and criteria for validation. Since the outcomes evaluated varied widely, and in some studies the definition or subtype of stroke was unclear, these algorithms may be less useful for studies evaluating drug or device safety. These studies are summarized more fully in the final report (http://mini-sentinel.org/foundational_activities/related_projects/default.aspx).
Table 4.Positive Predictive Values of Algorithms to Identify Composite Endpoints (Stroke/Transient Ischemic Attack and Cerebrovascular Disease)
Citation Study Population and Time Period Description of Outcome Studied Algorithm Validation/Adjudication Procedure, Operational Definition, and Validation Statistics Stroke/TIA Arnason, et al.13 patients discharged from a university-associated teaching hospital in Ottawa, Canada, 1999 to 2000 hospitalizations (stroke/TIA) inpatient ICD-9-CM codes 433 to 436 Medical record review was conducted (N=179 cases of potential stroke/TIA).Table 5 shows the median and range (minimum and maximum) of PPV estimates reported in studies evaluating individual ICD-9 and ICD-10 codes in adult populations, according to the outcome evaluated (acute stroke event [ischemic and hemorrhagic], ischemic stroke, TIA, ICH, and SAH). While most studies evaluating acute stroke did not specify that confirmation was based upon agreement with the specific diagnostic code recorded (e.g., most studies determined the presence or absence of any stroke event rather than specifying that confirmed cases with discharge ICD-9 code 433.x were diagnosed with occlusion of precerebral arteries), studies that specifically evaluated ischemic stroke reported PPVs for codes 434 and 436 in the range observed for studies evaluating all acute stroke events (approximately 90% and 80% respectively for studies using the principal diagnosis code). As reported above, the PPVs for codes 430 and 431, to identify intracranial bleeds and SAH respectively, were generally > 80%, and the PPV for code 435 to identify TIAs was generally > 70%.
Table 5.Positive Predictive Values (PPVs) of International Classification of Diseases (ICD) Codes to Identify Cerebrovascular Accident and Transient Ischemic Attacks (TIAs) in Adult Populations*
ICD-9/ICD-10 code Number of studies reporting PPV estimate Median PPV estimate Range of PPV estimates (minimum, maximum) Number of studies reporting PPV estimate Median PPV estimate Range of PPV estimates (minimum, maximum) Studies Evaluating Acute Stroke Events Using Principal or Most Responsible Diagnosis Only Using All Discharge Diagnoses 430 3 87 33, 100 4 84 74, 100 431 3 88 80, 100 4 86 83, 93 432 3 21 17, 29 4 20 0, 32 432.9 0 1 60 433 3 17 9, 46 4 15 6, 15 433.x0 1 13 0 433.x1 1 71 0 434 3 90 84, 92 4 85 77, 85 434.x0 1 33 0 434.x1 1 72 0 434.0 1 85 1 82 434.1 1 80 1 58 435 4 17 3, 29 4 14 9, 26 436 4 80 48, 89 5 81 70, 86 437 3 50 45, 69 3 22 2, 31 438 2 20 8, 33 3 1 0, 7 Studies Evaluating Ischemic Stroke Events Using Principal or Most Responsible Diagnosis Only Using All Discharge Diagnoses 433 1 4 1 14 434 2 87 82, 92 1 77 434.11 1 85 0 434.91 1 82 0 435 0 1 12 436 1 79 1 68 437 0 1 2 438 0 1 0 Studies Evaluating TIA Using Principal or Most Responsible Diagnosis Only Using All Discharge Diagnoses 433 1 14 1 9 434 1 6 1 5 435 2 79 70, 89 3 72 28, 77 435.9 0 1 28 436 1 6 1 3 G45.X 1 97 0 Studies Evaluating Intracranial Bleed (ICH) and Subarachnoid Hemorrhage (SAH) Using Principal or Most Responsible Diagnosis Only Using All Discharge Diagnoses 430 2 96 94, 98 1 86 431 2 93 89, 97 1 80 I60 1 91 0 I61 1 98 0 DiscussionAdministrative databases are a useful source of information to identify clinical conditions and diagnoses relevant for drug and medical device safety research and surveillance activities. The ability to perform such activities in a timely and efficient manner is highly advantageous.
A number of different outcomes and definitions for CVAs and its major subtypes have been reported in studies using administrative data. In addition, the criteria for validation of outcomes varied greatly among the studies reviewed. Few studies reported that criteria for validation included confirmation based upon brain imaging data (i.e., computed tomography [CT], magnetic resonance imaging [MRI]), evidence that would enhance the validity of the stroke diagnosis. In addition, among studies reporting the PPV estimates for individual ICD-9 codes, most studies did not specify that confirmation was based upon agreement with the specific diagnostic code recorded (i.e., most studies determined the presence or absence of any stroke event rather than specific stroke subtype). In addition, most studies evaluating ICD-9 codes 433.x and 434.x did not exclude ICD-9 codes with the fifth digit specification of 0, which indicates that the diagnosis occurred without mention of cerebral infarction.
Our report focused on studies evaluating acute events (stroke, TIA, and intracranial bleeds) rather than prevalent cerebrovascular disease. PPVs varied considerably depending on the specific outcomes (stroke subtypes) and algorithms evaluated. Specific algorithms to evaluate the presence of stroke and intracranial bleeds were found to have high PPVs (80% or greater). Algorithms to evaluate TIAs were generally found to have PPVs of 70% or greater.
The clinical usefulness of the algorithms presented in this report are best understood in light of the definitions of each of the various clinical entities, their pathophysiology, and the health outcome of interest relevant to a specific post-marketing surveillance study. For example, the pathologic basis for a stroke may relate to either ischemic or hemorrhagic disturbances of the cerebral circulation.47 While ischemic strokes can be either thrombotic or embolic due to underlying atherosclerosis or blood clots, hemorrhagic strokes are mainly due to hypertensive disease, coagulation disorders, or vascular malformations. Lacunar cerebral infarctions are small deep infarcts in the territory of small penetrating arteries, due to a local disease of these vessels, mainly related to chronic hypertension. Subarachnoid hemorrhages are mainly due to the rupture of aneurysms.47 Thus, if a medication or device is postulated to increase the risk of hemorrhagic disturbances of the cerebral circulation, the specific algorithm chosen should include codes demonstrated to have high validity for identification of acute hemorrhagic events (as described below), rather than including codes for all stroke subtypes (e.g. codes identifying ischemic stroke, TIAs).
For acute stroke, studies reported the highest PPVs for inpatient ICD-9 codes 430.x, 431.x, 434.x, and 436.x. To evaluate acute ischemic stroke, algorithms that included ICD-9 codes 433.x1, 434 (excluding 434.x0), and 436, performed well (85% or higher). Use of codes in the principal position generally increased the PPVs slightly.
For TIAs, ICD-9 codes 435.x in hospitalization or emergency encounter data generally demonstrated an adequate PPV (70% or higher in adult populations). The two studies using codes in the principal position both reported PPVs of 70% or higher.
While few studies evaluated intracranial bleeds, algorithms including hospitalization or emergency department visit codes 430.x and 431.x performed well for the identification of SAH and ICH in adult populations, with PPVs ranging from 80% to 98%. While only one study evaluated an algorithm using inpatient ICD-9 codes 430.x to 432.x for the identification of intracranial bleeds, the reported PPV was high (94%).
Our classifications (stroke, TIA, stroke/TIA, ICH, SAH, and cerebrovascular disease) were based on how the study authors identified their outcomes of interest. The authors of these papers used a variety of approaches. For example, some authors set out to identify patients with all types of cerebrovascular events including intracranial bleeds, while others chose to focus on ischemic strokes excluding bleeds. These varying approaches likely influenced PPVs and will impact how useful these algorithms will be in future investigations. Included in the report are algorithms that focused solely on ischemic strokes as well as those focused on bleeds (ICH and SAH). This level of detail may be helpful in categorizing subtypes of stroke based on pathophysiology, although some limitations remain. For instance, no investigators to date have attempted to differentiate ischemic strokes due to thrombotic versus embolic causes using administrative data. Some authors chose to focus solely on TIAs. Given the “transient” nature of TIAs in that there are no lasting physical deficits or radiographic findings, it is not surprising that the PPVs were lower than in studies focused on stroke. Lastly, several authors used composite measures whereby a patient could have more than one condition. Some algorithms identified patients with composite endpoints (either stroke or TIA) or more broadly with cerebrovascular disease. In some studies it was unclear what specific conditions were included in the definition of the outcome of interest and this may substantially limit the usefulness of these algorithms.
Gaps in the current literature include a lack of information on potential differences in the validity of algorithms according to patient age and sex. In addition, the validity of algorithms to further differentiate ischemic strokes due to thrombosis versus emboli should be evaluated. Overall, comparison of the different algorithms using standard criteria, potentially incorporating brain imaging data, would be most useful. Lastly, few validation studies have been conducted on ICD-10 codes or in men and women of different race/ethnicities.
ConclusionLarge population-based administrative databases that include diagnosis data provide efficient sources of information to identify cases of acute CVAs and TIAs. A number of different algorithms for various stroke subtypes have been reported in the literature. The appropriateness and choice of the specific algorithm for drug and device safety research should not be made arbitrarily, but should have a sound pathophysiologic rationale, specifically, one that is appropriate for stroke subtype of interest.
Take home messages.The definitions, criteria for validation, and algorithms used to identify cerebrovascular accidents (CVAs) and transient ischemic attacks (TIAs) from administrative and claims data differ greatly in the published literature.
Specific algorithms to evaluate the presence of stroke and intracranial bleeds were found to have high positive predictive values (80% or greater).
Algorithms to evaluate TIA were generally found to have PPVs of 70% or greater.
This work was supported by the Food and Drug Administration (FDA) through Department of Health and Human Services (HHS) Contract Number HHSF223200910006I. Dr. Saczynski was supported in part by funding from the National Institute on Aging (K01 AG33643) and the National Heart Lung and Blood Institute (U01 HL105268). Dr. Cutrona was supported in part by Award Number KL2RR031981 from the National Center for Research Resources (NCRR). Dr. Harrold was funded by K23AR053856 from the National Institute of Arthritis and Musculoskeletal and Skin Diseases.
The views expressed in this document do not necessarily reflect the official policies of the Department of Health and Human Services, nor does mention of trade names, commercial practices, or organizations imply endorsement by the U.S. government.
The content is solely the responsibility of the authors and does not necessarily represent the official views of the NCRR or the National Institutes of Health.
FootnotesAuthors have no conflicts of interest to report.
ReferencesRetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.3