© 1998 Oxford University Press
research-article |
Intra- and inter-rater agreement in the assessment of occupational exposure to metals
aDepartment of Biostatistics and Research Epidemiology, Department of Neurology, Henry Ford Health Sciences Center Detroit, MI, USA
bDivision of Movement Disorders and William T Gossett Parkinson's Disease Center, Department of Neurology, Henry Ford Health Sciences Center Detroit, MI, USA
Reprint requests to: Benjamin A Rybicki, Henry Ford Health Sciences Center, Biostatistics and Research Epidemiology, 1 Ford Place. 3E, Detroit, MI 48202-3450, USA
BACKGROUND: Among the methods of retrospective occupational exposure assessment, expert review is considered the most accurate. Although expert review provides a more objective measure of exposure, depending on the exposure of interest it may still result in a significant degree of misclassification.
METHODS: To evaluate the reliability in occupational metal exposure assessment by expert review, we analysed job history data from a case-control study of a neurological disease. First, one industrial hygienist (IH) did an initial exposure assessment of the metals copper, iron and lead, blinded to case-control status, for 608 subjects who had 3033 total jobs. We then compared exposure assessments from the original review with a second blinded review of 60 job histories (306 jobs) by the same IH (intra-rater) and of 64 job histories (361 jobs) by a different IH (inter-rater).
RESULTS: The per cent agreements for the intra-IH comparisons were 89.6 for copper, 87.9 for iron and 94.6 for lead, whereas the inter-N per cent agreements were 86.4 for copper, 81.1 for iron and 76.2 for lead. Based on the assumption that reliability is related to validity, we calculated an estimate of misclassification of metal exposure by one LIT. Our exposure misclassification estimates show a sizable attenuation of the odds ratio, with the expected bias similar for copper and iron when using either intra- or inter-reliability results to estimate misclassification.
CONCLUSIONS: Our results suggest that variation in the expert assessment of metal exposure is due mainly to the difficulties involved in transforming an occupational history into an estimate of exposure.
Keywords copper, lead, iron, kappa, bias, misclassification, reliability
Accepted 8 August 1997
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  E. A. Seel, D. D. Zaebst, M. J. Hein, J. Liu, S. J. Nowlin, and P. Chen Inter-Rater Agreement for a Retrospective Exposure Assessment of Asbestos, Chromium, Nickel and Welding Fumes in a Study of Lung Cancer and Ionizing Radiation Ann. Hyg., October 1, 2007; 51(7): 601 - 610. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. Steinsvag, M. Bratveit, B. E Moen, and H. Kromhout Inter-rater agreement in the assessment of exposure to carcinogens in the offshore petroleum industry Occup. Environ. Med., September 1, 2007; 64(9): 582 - 588. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. J. Nichols, G. L. Mitchell, and K. K. Nichols An Assessment of Self-Reported Disease Classification in Epidemiological Studies of Dry Eye Invest. Ophthalmol. Vis. Sci., October 1, 2004; 45(10): 3453 - 3457. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C Pilorget, E Imbernon, M Goldberg, S Bonenfant, Y Spyckerelle, B Fournier, J Steinmetz, and A Schmaus Evaluation of the quality of coding of job episodes collected by self questionnaires among French retired men for use in a job-exposure matrix Occup. Environ. Med., June 1, 2003; 60(6): 438 - 443. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
I. BURSTYN and H. KROMHOUT Who Qualifies to be an Expert? Ann. Hyg., January 1, 2003; 47(1): 89 - 89. [Full Text] [PDF]
|
|
|
|
|
|
M Vrijheid, H Dolk, B Armstrong, G Boschi, A Busby, T Jorgensen, and P Pointer Hazard potential ranking of hazardous waste landfill sites and risk of congenital anomalies Occup. Environ. Med., November 1, 2002; 59(11): 768 - 776. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K Teschke, A F Olshan, J L Daniels, A J De Roos, C G Parks, M Schulz, T L Vaughan, and H Kromhout Occupational exposure assessment in case-control studies: opportunities for improvement Occup. Environ. Med., September 1, 2002; 59(9): 575 - 594. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
I Burstyn, P Boffetta, G A Burr, A Cenni, U Knecht, G Sciarra, and H Kromhout Validity of empirical models of exposure in asphalt paving Occup. Environ. Med., September 1, 2002; 59(9): 620 - 624. [Abstract] [Full Text] [PDF]
|
|