International Journal of Epidemiology, Volume 33, Number 3, pp. 441-442
IJE vol.33 no.3 © International Epidemiological Association 2004; all rights reserved.
Editor's Choice |
Classics in epidemiology: should they get it right?
One of the best ways to learn epidemiology is through reading the classic texts. Excellent anthologies of such classics have been published, and Snow on cholera, Goldberger on pellagra, Doll and Hill on smoking and lung cancer, Morris on exercise and coronary heart disease, and Keys and Stamler on cholesterol and heart disease are tremendous models for how to get things right. In the International Journal of Epidemiology we have reprinted several early (and often under-appreciated) papers in which novel empirical or methodological advances, that now would be considered central to epidemiological thinking and methodology, were advanced.114
There is a natural tendency to apply asymmetrical criteria to papers that reached what, with hindsight, were correct or incorrect conclusions. In the former case we look for the exemplary design, analysis and interpretation, and in the latter case for the flaws that should have been detected at the time. There is, however, at least as much to be learnt from studies that have reached what now appear to be the wrong conclusion as those that got it right. In many cases these will have been carried out to the highest contemporary standards, and yet somewhere along the line the authors were misled. In this issue of the IJE we reprint a highly cited and influential meta-analysis and systematic review of observational studies on hormone replacement therapy (HRT) and coronary heart disease risk, first published in 1991.15 This paper is a model of clarity, yet with the findings of randomized controlled trials (RCT) of HRT the conclusion it reachedthat the apparent protective effect of HRT was unlikely to be explained by confounding factorsappears wrong. A series of commentaries1621 debate why this situation arose. While the commentators are not unanimous in their opinions it is, at the very least, clear that observational epidemiology may be more fallible than some have suggested. Other examples of apparently convincing findings from observational studies failing to be confirmed though RCTs exist with respect to associations between several dietary factors, in particular anti-oxidant vitamins, and disease.22 However, in only a small minority of cases can the findings of observational epidemiological studies be compared to those from randomized trials. Surely assuming that the various factors that mitigated against a correct interpretation of the effect of HRT or anti-oxidants on disease do not apply in these cases is not a sensible way to proceed?
One appropriate response to demonstrations of such problems in observational epidemiology is through improved methodology, and several papers in this issue of the IJE address such issues.2326 An important clue as to whether the findings of individual-level associations in observational epidemiological studies are likely to be causal can come from time-trend or ecological data. For example it has been suggested that cannabis use has a major influence on the risk of schizophrenia, yet large increases in cannabis use in a population that are not accompanied by any increase in schizophrenia suggest that such associations are non-causal.27 Similarly in this issue of the IJE Foliaki et al. test the proposition that antibiotic use early in life may increase the subsequent risk of asthma, as observed in several observational studies.28 They demonstrate that, ecologically, there is no robust association between antibiotic use and the prevalence of asthma or other such allergic diseases, which throws some doubt on the causal nature of the previously observed associations. In the case of changes in practices considered to be related to human immunodeficiency virus (HIV) risk, ecological data reported in this issue of the IJE support an important causal role, as trends in HIV infection in Ugandawhere extensive interventions have been put in placeare considerably more favourable than in other sub-Saran African countries, including the closely geographically proximal districts of Kenya.29
Journal editors spend much of their time writing rejection letters to authors who have submitted papers. A consideration of the classic papers that got things right but failed to have much impact at the time, perhaps because they appeared in lower impact journals, following rejection from more prestigious journals, emphasizes this. Authors are, understandably, often severely displeased, and the letters we sometimes receive in response to our rejection letters generally do not make pleasant reading. In lieu of sharing any real letters from authors whose papers have been rejected we reprint Fleur Adcock's exemplary response to a rejection slip.30 We look forward to receiving similar reactions from disappointed authors in future.
References
1 Schairer E, Schöniger E. Lung cancer and tobacco consumption. Int J Epidemiol 2001;30:2427.
2 Leitch I. Growth and health. Int J Epidemiol 2001;30:21216.
3 Rose G. Sick individuals and sick populations. Int J Epidemiol 2001;30:42732.
4 Kermack WO, McKendrick AG, McKinlay PL. Death-rates in Great Britain and Sweden. Some general regularities and their significance. Int J Epidemiol 2001;30:67883.
5 Messrs. Poisson, Dulong, Larrey, and Double. Statistical research on conditions caused by calculi by Doctor Civiale. Int J Epidemiol 2001;30:124649.
6 Susser M, Stein Z. Civilization and peptic ulcer. Int J Epidemiol 2002;31:1317.
7 Forsdahl A. Observations throwing light on the high mortality in the county of Finnmark: Is the high mortality today a late effect of very poor living conditions in childhood and adolescence? Int J Epidemiol 2002;31:30208.
8 Rodgers GB. Income and inequality as determinants of mortality: an international cross-section analysis. Int J Epidemiol 2002;31:53338.
9 Sutherland. EXTRACTS from Appendix (A) to the Report of the General Board of Health on the Epidemic Cholera of 1848 & 1849. Int J Epidemiol 2002;31:90007.
10 Kark SL. The social pathology of syphilis in Africans. Int J Epidemiol 2003;32:18186.[CrossRef][ISI][Medline]
11 Snow J. On the adulteration of bread as a cause of rickets. Int J Epidemiol 2003;32:33637.
12 Berkson J. Tests of significance considered as evidence. Int J Epidemiol 2003;32:68791.
13 Katan MB. Apolipoprotein E isoforms, serum cholesterol, and cancer. Int J Epidemiol 2004;33:9.
14 Report of the Patulin Clinical Trials Committee, Medical Research Council: Clinical trial of patulin in the common cold. Int J Epidemiol 2004;33:24346.
15 Stampfer MJ, Colditz GA. Estrogen replacement therapy and coronary heart disease: a quantitative assessment of the epidemiologic evidence. Int J Epidemiol 2004;33:44553.
16 Stampfer M. Commentary: Hormones and heart disease: do trials and observational studies address different questions? Int J Epidemiol 2004;33:45455.
17 Vandenbroucke JP. Commentary: The HRT story: vindication of old epidemiological theory. Int J Epidemiol 2004;33:456457.
18 Barrett-Connor E. Commentary: Observation versus interventionwhat's different? Int J Epidemiol 2004;33:45759.
19 Kuller LH. Commentary: Hazards of studying women: the oestrogen oestrogen/progesterone dilemma. Int J Epidemiol 2004;33:45960.
20 Petitti D. Commentary: Hormone replacement therapy and coronary heart disease: four lessons. Int J Epidemiol 2004;33:46163.
21 Lawlor D. Davey Smith G. Ebrahim S. The hormone replacementcoronary heart disease conundrum: is this the death of observational epidemiology? Int J Epidemiol 2004;33:46467.
22 Davey Smith G, Ebrahim S. Mendelian randomization: can genetic epidemiology contribute to understanding environmental determinants of disease? Int J Epidemiol 2003;32:122.
23 Pereira MA, Weggemans RM, Jacobs DR Jr et al. Within-person variation in serum lipids: implications for clinical trials. Int J Epidemiol 2004;33:53441.
24 Clark S, Youngman LD, Chukwurah B et al. Effect of temperature and light on the stability of fat-soluble vitamins in whole blood over several days: implications for epidemiological studies. Int J Epidemiol 2004;33:51825.
25 Leung MW, Yen IH, Minkler M. Community based participatory research: a promising approach for increasing epidemiology's relevance in the 21st century. Int J Epidemiol 2004;33:499506.
26 Cologne JB, Sharp GB, Neriishi K, Verkasalo PK, Land CE, Nakachi K. Improving the efficiency of nested case-control studies of interaction by selecting controls using counter matching on exposure. Int J Epidemiol 2004;33:48592.
27 Degenhardt L, Hall W, Lynskey N. Testing hypotheses about the relationship between cannabis use and psychosis. Drug Alcohol Depend 2003;71:3748.[CrossRef][ISI][Medline]
28 Foliaki S, Kildegaard Nielsen S, Björkstén B, von Mutius E, Cheng S, Pearce N, ISAAC Phase I Study Group. Antibiotic sales and the prevalence of symptoms of asthma, rhinitis, and eczema: The International Study of Asthma and Allergies in Childhood (ISAAC). Int J Epidemiol 2004;33:56873.
29 Moore DM, Hogg RS. Trends in antenatal human immuno-deficiency virus prevalence in Western Kenya and Eastern Uganda: evidence of differences in health policies? Int J Epidemiol 2004;33:55460.
30 Adcock F. Future Work. Int J Epidemiol 2004;33:468.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
M.-N. Vercambre, A. Fournier, M.-C. Boutron-Ruault, F. Clavel-Chapelon, V. Ringa, and C. Berr Differential Dietary Nutrient Intake according to Hormone Replacement Therapy Use: An Underestimated Confounding Factor in Epidemiologic Studies? Am. J. Epidemiol., December 15, 2007; 166(12): 1451 - 1460. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. C Reeves Parachute approach to evidence based medicine: as obvious as ABC. BMJ, October 14, 2006; 333(7572): 807 - 807. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||

