Objectives: To compare the diagnostic accuracy of visual inspection and spectrophotometry for identifying the presence of bilirubin in the cerebrospinal fluid (CSF).
Methods: Clinicians and students assessed CSF specimens with seven degrees of extinction between 0.00 and 0.09 at 450–460 nm as “yellow,” “doubtful,” or “colourless” after random presentation under standard conditions. The assessments were compared with spectrophotometry, with 0.05 being taken as the cut off level for the presence of bilirubin. Results were compared between the two groups and explored by means of receiver operating characteristic (ROC) curves.
Results: All 51 clinicians and 50 of 51 students scored the tubes with extinction of 0.06 or higher as “yellow” or “doubtful.” Tubes without any bilirubin were scored as “yellow” by three of the students only. The ROC curves confirmed that the diagnostic properties of the visual inspection versus spectrophotometry were slightly better for the clinicians than for the students.
Conclusions: If CSF is considered colourless, the extinction of bilirubin is too low to be compatible with a diagnosis of recent subarachnoid haemorrhage. If CSF is not considered colourless, spectrophotometry should be carried out to determine the level of extinction of bilirubin.
- AUC, area under the curve
- ROC, receiver operating characteristic
- SAH, subarachnoid haemorrhage
- subarachnoid haemorrhage
- cerebrospinal fluid
Statistics from Altmetric.com
In the great majority of patients with subarachnoid haemorrhage (SAH), the presence of extravasated blood can be confirmed on early computed tomography (CT) of the brain. But if CT is normal in patients suspected of SAH, lumbar puncture is indicated to examine the cerebrospinal fluid (CSF) for blood pigments.1 These pigments (oxyhaemoglobin and bilirubin) are formed by lysis of erythrocytes. Bilirubin gives the CSF a yellow colour (xanthochromia) which can be found from six to 12 hours after SAH until two weeks after the haemorrhage.2 In the laboratory, CSF is spun down immediately after puncture for visual inspection of the supernatant. Next, spectrophotometry is recommended, because it is a less subjective and supposedly more sensitive method for detecting blood pigments than visual inspection.3 The extinction of the supernatant is determined at wavelengths of 415 nm (oxyhaemoglobin) and 450–460 nm (bilirubin).
Visual inspection and spectrophotometry were compared in the 1970s in a few small studies which suggested that visual inspection alone is not reliable.4–6 Despite the lack of evidence on the diagnostic properties of visual inspection for detecting bilirubin in CSF, more than half the clinical laboratories in the USA base their results on visual inspection alone.7 In the United Kingdom, the use of spectrophotometry appears to be limited as well.8
Our aim in this study was to compare visual inspection with spectrophotometry in a series of CSF samples with different extinctions of bilirubin. We included the influence of clinical experience as a variable in this experiment.
Human CSF was used and bilirubin was added in different concentrations. A series of seven tubes with extinctions of 0.00, 0.01, 0.02, 0.04, 0.06, 0.07, and 0.09 at 450–460 nm was prepared with a Beckman DU 650 spectrophotometer (Beckman Coulter, Netherlands). Specimens were stored at 4°C, and wrapped in aluminium foil for protection against the influence of ultraviolet light. Clinicians from the departments of neurology and neurosurgery, and medical students assessed the colour of each tube in the series as “yellow,” “colourless,” or “doubtful.” Assessment was in random order and under standard conditions with bright light, a background of a white paper or white coat, and with a similar tube filled with tap water as reference.
Judgements were classified as “correct” and “not correct” for each extinction, with spectrophotometry as the gold standard: the extinction above 0.05 was used as cut off for the presence of bilirubin. The extinction values in the test tubes were chosen accordingly. We had two pairs of analyses—a first with three categories analysed separately: “colourless,” “yellow,” and “doubtful”; and a second with two categories: “colourless” versus “doubtful” or “yellow”, because in practice spectrophotometry will be done in case of doubt about the presence of a yellow colour of CSF. We calculated proportions with corresponding 95% confidence intervals (CI) and sensitivity and specificity for clinicians and students who assessed the colour differently from the gold standard. Results were compared between the two groups by means of receiver operating characteristic (ROC) curves. The area under the ROC curve (AUC) can be interpreted as a measure of the diagnostic value of the test.9
The assessments of 51 clinicians and 51 students are presented in table 1. In the analysis of the three categories taken separately, at least 88% of clinicians and students scored any tube with extinction above the cut off point of 0.05 as yellow. None of the clinicians and only one student assessed a tube with an extinction above 0.05 as colourless (95% CI for clinicians 0 to 2.4% and for students 0 to 3.6%). Tubes without any trace of bilirubin were assessed as “yellow” by three of 51 students. When the categories “colourless” versus “yellow” and “doubtful” combined were analysed, for all samples together the sensitivity (spectrophotometry above 0.05 used as true positive) was 100% in the clinicians and 99% in the students. The specificity above 0.05 was consistently lower in the clinicians than in the students. One student (2%) rated a tube without a trace of bilirubin as doubtful.
The ROC curves (fig 1) showed that the AUC was slightly larger for clinicians than for students. The figure also showed that the ROC curves were very informative, with a high sensitivity above the cut off point 0.05 extinction for bilirubin, and a high specificity below.
The clinicians attained 100% sensitivity in visually detecting the yellow colour of CSF from in vivo specimens when the extinction was above 0.05, the cut off value for “positive” spectrophotometry in our laboratory, including the assessments in which they were doubtful. In practical terms, our findings imply that on the basis of visual inspection alone, no patient with a subarachnoid haemorrhage would have been sent home. Only one patient (2%) would have been sent home by the students because of false negative visual inspection of the CSF. If the colour on visual inspection is yellow or doubtful, spectrophotometry is recommended to determine the level of extinction before vascular imaging is undertaken. CT or magnetic resonance angiography cannot replace examination of CSF, because on a few occasions this will confuse the issue by showing an incidental unruptured aneurysm. The good but imperfect sensitivity for students implies that visual inspection of CSF by an inexperienced person should be checked by an experienced person. That clinicians less often rated the CSF colourless than students may be explained by increased awareness of the serious consequences of missing the diagnosis.
Other studies showed that visual inspection was inferior to spectrophotometry in patients with verified (subarachnoid) bleeding.4–6,10 Although we have no straightforward explanations for the difference with our results, the following factors may play a role: different techniques and cut off levels in other studies4–6; the inclusion of patients with concomitant haematoma, possibly with methaemoglobin in the CSF, which is not always visible by inspection5,6,11; and CSF samples from a mixed group of patients.10
In our laboratory, the cut off point for a positive extinction at 0.05 for bilirubin at wavelength 450–460 nm is somewhat higher than “the extinction exceeding 0.023 at wavelength 415 nm (oxyhaemoglobin) and/or a peak in the absorption curve in the 450–460 nm range (bilirubin)” in the original definition of spectrophotometry.2 That definition has been sharply criticised,3 because even oxyhaemoglobin alone—for instance in case of a traumatic tap—can give rise to absorption peaks as high as 0.035. Recently, new guidelines focused on the quantification of bilirubin.12,13 We have tried to validate the extinctions of the tubes and their corresponding spectrophotometric scans with the new method and reference value,3 but results were inconclusive, probably because of the semi-artificial CSF with more downsloping curves. The results showed also that visual inspection is less reliable if a cut off point of a positive extinction is lower than 0.05.
Our results should be seen against the background of the small but important additional value of CSF investigations after negative CT in patients with sudden headache. If a patient with a ruptured aneurysm is investigated within 12 hours, CT of the brain shows blood in the basal cisterns in at least 97%.14 After two or three weeks, magnetic resonance imaging shows blood in up to 100%, but in these studies CSF investigations (without specifications) were used as the gold standard.15,16
We do not recommend a change in the guidelines for methods of examining the CSF. Spectrophotometry is the preferred method for detecting blood pigments in CSF in cases of suspected SAH.1 However, if meticulous inspection of the CSF under standard conditions shows that it is crystal clear and colourless, the chance of SAH is negligible. If an experienced clinician judges the colour of CSF to be yellow or doubtful, spectrophotometry is necessary to determine the level of extinction. All institutions relying on clinical visual inspection should monitor the reliability of visual and spectrophotometric interpretations and should emphasise the standard conditions in which the visual inspection of CSF has to be undertaken (in bright light, background of white paper or a white coat, comparison with a tube of tap water).
We thank all clinicians and medical students for their cooperation in the study. We thank Mrs A Peterusma for preparing the samples and quality control.
Competing interests: none declared
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.