International Journal of Epidemiology 2002;31:88-95
© International Epidemiological Association 2002
Special Theme: Systematic Reviews and Meta-Analysis |
Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy
a Department of Public Health and Epidemiology, University of Birmingham, UK.
b NHS Centre for Reviews and Dissemination, University of York, UK.
c Academic Department of Obstetrics & Gynaecology, University of Birmingham, UK.
d Wessex Institute for Health Research and Development, University of Southampton, UK.
e Department of Epidemiology and Public Health, University of Leicester, UK.
Dr Fujian Song, Department of Public Health and Epidemiology, University of Birmingham, Edgbaston, Birmingham B15 2TT, UK. E-mail: f.song{at}bham.ac.uk
Abstract
Background Despite the great possibility of publication bias in studies of diagnostic test research, empirical studies about publication bias have mainly focused on studies of treatment effect.
Methods A sample of 28 meta-analyses of diagnostic accuracy was selected from the Database of Abstracts of Reviews of Effectiveness (DARE). Methods used to deal with publication and related biases in these meta-analyses were examined. Asymmetry of funnel plot of estimated test accuracy against corresponding precision for each meta-analysis was assessed by three statistical methods: rank correlation method, regression analysis, and Trim and Fill method.
Results In reviews of diagnostic accuracy, there was a general lack of consideration of appropriate literature searching to minimize publication bias, and the impact of possible publication bias has not been systematically assessed. The results of the three different statistical methods consistently showed that in a large proportion of the 28 meta-analyses evaluated, the smaller studies were associated with a greater diagnostic accuracy. Exploratory analyses found that the fewer the literature databases searched, the greater the funnel plot asymmetry in meta-analyses. Funnel plot asymmetry tended to be greater in meta-analyses that included smaller number of primary studies. Our data revealed no consistent relationship between funnel plot asymmetry and language restriction in reviews.
Conclusions Further research is required to explain why smaller studies tended to report greater test accuracy in a large proportion of meta-analyses of diagnostic tests. In systematic reviews of diagnostic studies, literature search should be sufficiently comprehensive and possible impact of publication bias should be assessed.
Keywords Meta-analysis, diagnostic accuracy, publication bias, funnel plot
Accepted 1 August 2001
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  T. Shimada, Y. Noguchi, J. L. Jackson, J. Miyashita, Y. Hayashino, T. Kamiya, S. Yamazaki, T. Matsumura, and S. Fukuhara Systematic Review and Metaanalysis: Urinary Antigen Tests for Legionellosis Chest, December 1, 2009; 136(6): 1576 - 1585. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. Met, S. Bipat, D. A. Legemate, J. A. Reekers, and M. J. W. Koelemay Diagnostic Performance of Computed Tomography Angiography in Peripheral Arterial Disease: A Systematic Review and Meta-analysis JAMA, January 28, 2009; 301(4): 415 - 424. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. Bax, N. Ikeda, N. Fukui, Y. Yaju, H. Tsuruta, and K. G. M. Moons More Than Numbers: The Power of Graphs in Meta-Analysis Am. J. Epidemiol., January 15, 2009; 169(2): 249 - 255. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. M.G. Leeflang, J. J. Deeks, C. Gatsonis, P. M.M. Bossuyt, and on behalf of the Cochrane Diagnostic Test Accuracy Systematic Reviews of Diagnostic Test Accuracy Ann Intern Med, December 16, 2008; 149(12): 889 - 897. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. J. Rice Evidence-Based Practice in Psychiatric and Mental Health Nursing: Qualitative Meta-Synthesis Journal of the American Psychiatric Nurses Association, October 1, 2008; 14(5): 382 - 385. [PDF]
|
|
|
|
 |
|
 A. Conde-Agudelo MD MPH and M. Lindheimer MD Use of Doppler ultrasonography to predict pre-eclampsia Can. Med. Assoc. J., July 1, 2008; 179(1): 53 - 53. [Full Text] [PDF]
|
|
|
|
 |
|
 A. Martin, S. Panaiotov, F. Portaels, S. Hoffner, J. C. Palomino, and K. Angeby The nitrate reductase assay for the rapid detection of isoniazid and rifampicin resistance in Mycobacterium tuberculosis: a systematic review and meta-analysis J. Antimicrob. Chemother., July 1, 2008; 62(1): 56 - 64. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. J. Selman, C. Mann MD, J. Zamora PhD, T.-L. Appleyard MBBS, and K. Khan MSc Diagnostic accuracy of tests for lymph node status in primary cervical cancer: a systematic review and meta-analysis Can. Med. Assoc. J., March 25, 2008; 178(7): 855 - 862. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. Pewsner, P. Juni, M. Egger, M. Battaglia, J. Sundstrom, and L. M Bachmann Accuracy of electrocardiography in diagnosis of left ventricular hypertrophy in arterial hypertension: systematic review BMJ, October 6, 2007; 335(7622): 711 - 711. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. M Handler, R. L Altman, S. Perera, J. T Hanlon, S. A Studenski, J. E Bost, M. I Saul, and D. B Fridsma A Systematic Review of the Performance Characteristics of Clinical Event Monitor Signals Used to Detect Adverse Drug Events in the Hospital Setting JAMIA, July 1, 2007; 14(4): 451 - 458. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. R. Lynch, M. R.A. Cunningham, W. J. Warme, D. C. Schaad, F. M. Wolf, and S. S. Leopold Commercially Funded and United States-Based Research Is More Likely to Be Published; Good-Quality Studies with Negative Outcomes Are Not J. Bone Joint Surg. Am., May 1, 2007; 89(5): 1010 - 1018. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Latour-Perez, F. J. Coves-Orts, C. Abad-Terrado, V. Abraira, and J. Zamora Accuracy of B-type natriuretic peptide levels in the diagnosis of left ventricular dysfunction and heart failure: A systematic review Eur J Heart Fail, June 1, 2006; 8(4): 390 - 399. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Lee, L. T. Y. Fan, T. Gin, M. K. Karmakar, and W. D. Ngan Kee A systematic review (meta-analysis) of the accuracy of the mallampati tests to predict the difficult airway. Anesth. Analg., June 1, 2006; 102(6): 1867 - 1878. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. Honest, S. Sharma, and K. S. Khan Rapid Tests for Group B Streptococcus Colonization in Laboring Women: A Systematic Review Pediatrics, April 1, 2006; 117(4): 1055 - 1066. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Delgado-Rodriguez Systematic reviews of meta-analyses: applications and limitations J Epidemiol Community Health, February 1, 2006; 60(2): 90 - 92. [Full Text] [PDF]
|
|
|
|
|
|
S. Palma and M. Delgado-Rodriguez Assessment of publication bias in meta-analyses of cardiovascular diseases J Epidemiol Community Health, October 1, 2005; 59(10): 864 - 869. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Porter and N. Haslam Predisplacement and Postdisplacement Factors Associated With Mental Health of Refugees and Internally Displaced Persons: A Meta-analysis JAMA, August 3, 2005; 294(5): 602 - 612. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Goodacre, F.C. Sampson, A.J. Sutton, S. Mason, and F. Morris Variation in the diagnostic performance of D-dimer for suspected deep vein thrombosis QJM, July 1, 2005; 98(7): 513 - 527. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. Stengel, K. Bauwens, G. Rademacher, S. Mutze, and A. Ekkernkamp Association between Compliance with Methodological Standards of Diagnostic Research and Reported Test Accuracy: Meta-Analysis of Focused Assessment of US for Trauma Radiology, July 1, 2005; 236(1): 102 - 111. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. R. Avansino, B. Goldman, R. S. Sawin, and D. R. Flum Primary Operative Versus Nonoperative Therapy for Pediatric Empyema: A Meta-analysis Pediatrics, June 1, 2005; 115(6): 1652 - 1659. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
F. B. Karassa, M. I. Matsagas, W. A. Schmidt, and J. P.A. Ioannidis Meta-Analysis: Test Performance of Ultrasonography for Giant-Cell Arteritis Ann Intern Med, March 1, 2005; 142(5): 359 - 369. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. J.W. Koelemay, P. J. Nederkoorn, J. B. Reitsma, and C. B. Majoie Systematic Review of Computed Tomographic Angiography for Assessment of Carotid Artery Disease Stroke, October 1, 2004; 35(10): 2306 - 2312. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. B. Piccoli, F. Bermond, E. Mezza, M. Burdese, F. Fop, G. Mangiarotti, A. Pacitti, S. Maffei, G. Martina, A. Jeantet, et al. Vascular access survival and morbidity on daily dialysis: a comparative analysis of home and limited care haemodialysis Nephrol. Dial. Transplant., August 1, 2004; 19(8): 2084 - 2094. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Romagnuolo, M. Bardou, E. Rahme, L. Joseph, C. Reinhold, and A. N. Barkun Magnetic Resonance Cholangiopancreatography: A Meta-Analysis of Test Performance in Suspected Biliary Disease Ann Intern Med, October 7, 2003; 139(7): 547 - 557. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Honest, L. M Bachmann, J. K Gupta, J. Kleijnen, and K. S Khan Accuracy of cervicovaginal fetal fibronectin test in predicting risk of spontaneous preterm birth: systematic review BMJ, August 10, 2002; 325(7359): 301 - 301. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Egger, S. Ebrahim, and G. D. Smith Where now for meta-analysis? Int. J. Epidemiol., February 1, 2002; 31(1): 1 - 5. [Full Text] [PDF]
|
|