Skip Navigation


IJE Advance Access originally published online on March 31, 2005
International Journal of Epidemiology 2005 34(3):680-687; doi:10.1093/ije/dyi060
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
34/3/680    most recent
dyi060v2
dyi060v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (21)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Jurek, A. M
Right arrow Articles by Church, T. R
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Jurek, A. M
Right arrow Articles by Church, T. R
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

Published by Oxford University Press on behalf of the International Epidemiological Association © The Author 2005; all rights reserved.

Methodology

Proper interpretation of non-differential misclassification effects: expectations vs observations

Anne M Jurek1,3,*, Sander Greenland2, George Maldonado1 and Timothy R Church1

1 Division of Environmental Health Sciences, School of Public Health, University of Minnesota, Minneapolis, MN 55455–0392, USA
2 Department of Epidemiology and Department of Statistics, University of California, Los Angeles, CA, USA

* Corresponding author. Community Health Department, Utah Valley State College, Orem, UT 84058, USA. E-mail:jurekan{at}uvsc.edu


    Abstract
 Top
 Abstract
 An overview of previous...
 Simulation study
 Results
 Discussion
 References
 
Background Many investigators write as if non-differential exposure misclassification inevitably leads to a reduction in the strength of an estimated exposure–disease association. Unfortunately, non-differentiality alone is insufficient to guarantee bias towards the null. Furthermore, because bias refers to the average estimate across study repetitions rather than the result of a single study, bias towards the null is insufficient to guarantee that an observed estimate will be an underestimate. Thus, as noted before, exposure misclassification can spuriously increase the observed strength of an association even when the misclassification process is non-differential and the bias it produced is towards the null.

Methods We present additional results on this topic, including a simulation study of how often an observed relative risk is an overestimate of the true relative risk when the bias is towards the null.

Results The frequency of overestimation depends on many factors: the value of the true relative risk, exposure prevalence, baseline (unexposed) risk, misclassification rates, and other factors that influence bias and random error.

Conclusions Non-differentiality of exposure misclassification does not justify claims that the observed estimate must be an underestimate; further conditions must hold to get bias towards the null, and even when they do hold the observed estimate may by chance be an overestimate.


Keywords Bias, epidemiological methods, misclassification, non-differential, relative risk

Accepted 14 February 2005

Under certain conditions, non-differential exposure misclassification reduces test power and biases study estimators towards the null value.1–6 There are several versions of this non-differential misclassification rule. One often-cited version is that non-differential misclassification of a binary exposure that is independent of other errors will bias the relative-risk estimator towards the null value of 1, i.e. towards no association. It seems underappreciated that such rules are often inapplicable. As discussed previously,7–12 additional conditions beyond non-differentiality are required to guarantee that bias is towards the null. Less well known, and perhaps surprising to some, is that bias towards the null does not always lead to an underestimate of the relative risk.13–17 The rules refer to expected values of estimators—which is to say, the average result of applying a formula (estimator) to repeated samples—not to the value estimated from a specific study. Thus, it is incorrect to claim (as authors often do) that the estimate from a study must be an underestimate because the bias is towards the null.

In this paper we briefly review these issues and then present a simulation study of the relation of observed estimates to expected and true values when bias is towards the null. The simulation is intended to illustrate how often it will be wrong to claim that an observed study result must be an underestimate when the conditions for bias towards the null are satisfied.


    An overview of previous results
 Top
 Abstract
 An overview of previous...
 Simulation study
 Results
 Discussion
 References
 
Non-differential misclassification rules refer to the expected (average) value of relative-risk estimates over hypothetical study repetitions (more precisely, the large-sample geometric mean of the relative-risk estimator in an infinite sequence of repetitions that vary only randomly from one another). The ratio of this expected estimate to the true relative risk is often used as a measure of statistical bias in relative-risk estimates.13,14,16,17 This ratio measure for bias refers only to the average error across hypothetical repetitions. In contrast, the ratio of the observed relative-risk estimate to the true relative risk measures not only bias, but also random variation.

The rule about bias towards the null is based on the classification process being non-differential.16 The process refers to the behaviour of the classification procedure over hypothetical study repetitions (i.e. the probability of misclassification). Even though misclassification may be non-differential on average, due to random variation the misclassification rates in a single study (realization) will most likely be differential. Furthermore, due to random sampling variation the correctly classified estimate may be an overestimate of the true value, and the ensuing misclassification may not counterbalance this overestimation, even if the misclassification pulls the estimate towards the null. Therefore, a non-differential misclassification process does not always lead to an underestimate of relative risk. Thus, an observed estimate can be towards the null, greater than the true, or less than the null, even when the classification process obeys conditions sufficient to produce bias towards the null.

As mentioned above, non-differentiality by itself is not sufficient to guarantee that the bias is towards the null. Non-differential misclassification rules require further conditions to ensure that the bias is towards the null. First, published rules assume that the misclassification probabilities are exactly non-differential;12 small violations of this assumption can produce substantial bias away from the null. Second, the exposure misclassification errors are assumed to be independent of errors in other variables in the analysis.10,11,18,19 Third, further conditions are required to guarantee bias towards the null when the exposure is polytomous (>2 levels).6,7 Fourth, the rules assume absence of interactions with other sources of systematic error, such as selection bias and confounding.

In practice it is difficult to guarantee that all these conditions are satisfied, and common practices often lead to violations of the assumptions. For example, if an exposure is continuous or polytomous with non-differential error, but it is categorized or collapsed to fewer categories in the analysis, differential misclassification can easily result.8,9 And, if exposure is one of several measures derived from more basic data, such as one of several nutrient measures derived from a diet history, the errors in the exposure will be correlated with the errors in the other measures, thus violating one of the key assumptions needed to ensure bias towards the null when the other measures are included in the analysis.18

Misinterpretation of the non-differential misclassification rule dates back to 1958 at least, when Lilienfeld and Graham20 incorrectly applied the rule to a hypothetical study result on circumcision status and cervical cancer. Although they believed differential misclassification was present in their study, they described the effect non-differential exposure misclassification could have had on one hypothetical study result, not expected study results. They stated that, were non-differential exposure misclassification present, it would have masked the true association in a study between circumcision status and cervical cancer. However, they had no way of being sure this was so.

Sorahan and Gilthorpe15 performed simulations that show how the observed relative-risk estimate can exceed the correctly classified and true relative risk, even when all the conditions for bias towards the null are satisfied (including non-differential exposure misclassification). Thomas13 also used simulations to demonstrate how the observed odds ratio can be greater than the correctly classified odds ratio. In a response to Thomas,13 Weinberg et al.14 suggested additional simulations of interest. Along with these suggested simulations, we present simulations to illustrate how often an observed relative risk overestimates the true value.


    Simulation study
 Top
 Abstract
 An overview of previous...
 Simulation study
 Results
 Discussion
 References
 
We examine the basic case of a binary exposure variable when the outcome is a correctly classified binary variable in a cohort study, using the risk ratio (incidence-proportion ratio, IPR) as the relative-risk measure. The software package used was @Risk (version 4.5).21 The following are details of our simulation methods.

Specify simulation parameter values for simulation experiments
For each simulation experiment, the true IPR (IPRT) was set to a value of 1, 1.5, 2, or 4. The incidence proportion (IP) in the unexposed subjects (IP0) was set to 0.01 or 0.1. The classification probabilities (Sj) were the same for cases and non-cases, so the classification process was non-differential. Sensitivity (S1, the probability of correctly classifying an exposed individual) and specificity (S0, the probability of correctly classifying an unexposed individual) were examined in combinations of 1.0, 0.8, or 0.6. The true number of exposed and unexposed individuals was set to 5000 each in the first set of simulations and 1000 and 9000 in the second set, corresponding to proportions exposed of PE = 0.5 and PE = 0.1. This produced a total of 144 different simulation experiments (one for each combination of the four IPRT values, two PE values, two IP0 values, and the three S1 and three S0 values).

Randomly generate one dataset
For a given set of simulation experiment parameters, in each simulation trial a dataset was generated (i.e. sampled) based on the usual assumption that random error follows a binomial distribution.19 Therefore, the randomly generated number of exposed cases N11 was defined as a binomial (10 000PE, IP0IPRT) random variate, where IP0IPRT is the incidence proportion in the exposed individuals. Similarly, the randomly generated number of unexposed cases N10 was defined as a binomial (10 000(1 – PE), IP0) random variate, where IP0 is the incidence proportion in the unexposed individuals. The resulting 2 x 2 table of counts are denoted Nij, where the subscript i is 1 for cases, 0 for non-cases and the subscript j is 1 for exposed, 0 for unexposed.

Calculate the estimate without misclassification
On each simulation trial, we used the ratios of the randomly generated numbers of cases to the fixed number of individuals in each exposure group to calculate what the IPR estimate for that trial would have been were there no exposure misclassification,


{dyi060in1}

where the subscript C denotes correctly classified and the subscript + denotes summation over the subscript i (cases + non-cases).

Add non-differential exposure misclassification
We created a second, misclassified dataset by adding non-differential exposure misclassification to the first dataset. The probabilities of misclassification (false-negative and false-positive rates) were 1 – S1 and 1 – S0. Binomial (Nij, 1 – Sj) random variates were used to calculate the number of false-negative (Fnij, incorrectly classified as unexposed) and false-positive (Fpij, incorrectly classified as exposed) individuals where the subscript i is 1 for cases, 0 for non-cases, and the subscript j is 1 for exposed, 0 for unexposed. The exposed and unexposed cell counts after misclassification are thus:

The denominators for the misclassified incidence proportions are the total numbers of individuals in each classified-exposure category, i.e. the sums of M+1 and M+0 of the number of cases and non-cases in each classified-exposure category j, where the subscript + denotes summation over the subscript i (cases + non-cases).

Calculate the misclassified estimate
An IPR estimate with individuals misclassified on exposure status, ({dyi060in2}), was calculated on each iteration from the misclassified counts in the second dataset,


{dyi060in8}

Analyse simulation data
Comparisons were made among the true value (IPRT), correctly classified estimates ({dyi060in9}), and misclassified estimates ({dyi060in2}) on each simulation trial. The frequency of four conditions ({dyi060in10}, {dyi060in5}, {dyi060in11}, and {dyi060in3}) were all computed for each different combination of IPRT, PE, IP0, and Sj values. For each simulation experiment (which consisted of 10 000 simulation trials), the geometric means of {dyi060in9} and {dyi060in2}, i.e. the antilogs of the average values of {dyi060in12} and {dyi060in7}, were calculated. The distributions of {dyi060in9} and {dyi060in2} were graphed.

The selected number of 10 000 simulation trials for each simulation experiment ensured that the widths of the 95% confidence interval for the percentages and geometric means shown in Tables 1 and 2 are <2%, e.g. a percentage shown as ‘50%’ in the tables has 95% confidence limits within 49 and 51%.


View this table:
[in this window]
[in a new window]
 
Table 1 Characteristics of {dyi060in2} by IPRT, incidence proportion in unexposed subjects, sensitivity and specificity where exposure prevalence = 0.5

 

View this table:
[in this window]
[in a new window]
 
Table 2 Characteristics of {dyi060in2} by IPRT, incidence proportion in unexposed subjects, sensitivity and specificity where exposure prevalence = 0.1

 

    Results
 Top
 Abstract
 An overview of previous...
 Simulation study
 Results
 Discussion
 References
 
Our simulation results are shown in Figures 1 and 2 and Tables 1 and 2. We plotted the number of times each IPR estimate occurred during the 10 000 simulation trials. Each graph shows distributions of {dyi060in2} for three different exposure classification scenarios. For all experiments, the simulated expected value of {dyi060in9} was always within a few hundredths of the true value. We omit results for IPRT = 1 in Tables 1 and 2 because in that case the null is true; hence there can be no bias towards the null, and both estimates always fall above (or below) the true null value ~50% of the time.



View larger version (26K):
[in this window]
[in a new window]
 
Figure 1 Distribution of {dyi060in2}, by IPRT, incidence proportion in unexposed subjects, sensitivity and specificity where exposure prevalence = 0.5. {dyi060in2}, misclassified incidence-proportion ratio; IPRT, true incidence-proportion ratio; Se, sensitivity; Sp, specificity; 10 000 simulation trials. Total number of exposed subjects = 5000, total number of unexposed subjects = 5000

 


View larger version (25K):
[in this window]
[in a new window]
 
Figure 2 Distribution of {dyi060in2}, by IPRT, incidence proportion in unexposed subjects, sensitivity and specificity where exposure prevalence = 0.1. {dyi060in2}, misclassified incidence-proportion ratio; IPRT, true incidence-proportion ratio; Se, sensitivity; Sp, specificity; 10 000 simulation trials. Total number of exposed subjects = 1000, total number of unexposed subjects = 9000

 
As expected, bias was towards the null in all the situations we examined. That is, the expected value of {dyi060in2} was always between the null value of 1 and IPRT for our simulation results (Tables 1 and 2). The magnitude of bias depended on sensitivity, specificity, exposure prevalence, and the true value. When the true IPRs were above 1, for a balanced population structure (i.e. PE = 0.5) the exposure probability was above 0.5 among cases and hence the magnitude of bias was more influenced by sensitivity than specificity. However, when the exposure was uncommon (i.e. PE = 0.1), the bias was more influenced by specificity.

Nonetheless, even though bias was towards the null and the process of exposure classification was non-differential, estimates could often be greater than the true value ({dyi060in5}) (Figures 1 and 2, Tables 1 and 2). For example, when PE = 0.5, IP0 = 0.01, IPRT = 1.5, and S1 and S0 = 0.80, {dyi060in5} in 19% of the simulation trials (Table 1). The proportion of times {dyi060in5} is indicated in Figures 1 and 2 as the area under the curves to the right of IPRT. This proportion varied as a function of the true value, exposure prevalence, incidence proportion in the unexposed subjects, and sensitivity and specificity. It increased as the IPRT decreased, PE increased, IP0 decreased, and S1 and S0 increased (Figures 1 and 2), situations in which the downward bias could easily be counterbalanced by upward random error. Larger sensitivity values had a greater influence on the proportion of times {dyi060in2} was greater than IPRT for exposure prevalence PE = 0.5, while specificity influenced this proportion more when exposure prevalence was 0.1.

Estimates were sometimes less than the null ({dyi060in3}). For example, when PE = 0.5, IP0 = 0.01, IPRT = 1.5, and S1 and S0 = 0.8, {dyi060in3} in 9% of the simulation trials (Table 1). The proportion of times {dyi060in3} is indicated in Figures 1 and 2 as the area under the curves to the left of the null value. This proportion varied as a function of IPRT, PE, IP0, and S1 and S0. It increased as the true value, exposure prevalence, incidence proportion in the unexposed subjects, and sensitivity and specificity all decreased (Figures 1 and 2), situations in which the downward random error could easily combine with downward bias to produce large downward total error.

Under some conditions, the misclassified estimates may lie almost entirely between the null and true value ({dyi060in11}), as illustrated by Figures 1 and 2. For example, when PE = 0.1, IPRT = 2, IP0 = 0.1, and S1 and S0 = 0.80, all misclassified IPR estimates were between 1 and 2, that is the entire simulated distribution is between the null and true value (Figure 2). Thus, in some of the simulations, non-differential exposure misclassification did consistently lead to underestimation of the true value. This became more and more true as the true value increased, the baseline risk became larger, the exposure prevalence increased, and the misclassification probabilities became larger (Tables 1 and 2, Figures 1 and 2), situations in which the bias on the log scale would be nearer 50% and the random error would be small. This would also become more true as the sample size increased, for then the random error would decrease and bias would be the main determinant of the results.


    Discussion
 Top
 Abstract
 An overview of previous...
 Simulation study
 Results
 Discussion
 References
 
Because our simulation experiments satisfied the conditions for the non-differential misclassification rule, they all resulted in bias towards the null. With no misclassification (i.e. sensitivity and specificity = 1), a correctly classified estimate would exceed the true value in roughly half of the repetitions. When bias towards the null is added, it does become less probable that the estimate will exceed the true value, as long as any resulting increase in standard error does not exceed the bias. But it does not in general guarantee that the observed estimate will be an underestimate; in particular, non-differential exposure misclassification does not always result in an observed relative-risk estimate between the null and true value, even when it produces bias towards the null. Random error alone can cause an observed relative-risk estimate to be less than one or greater than the true value.

In summary, the belief that non-differential exposure misclassification always produces an underestimate of the true value is incorrect. One reason for this incorrect belief is a failure to understand that bias is not the only, or even necessarily, the main, source of error in an estimate. Bias is not the ratio of the observed estimate from one study to the true value, because the observed estimate also incorporates random errors. The latter errors diminish with sample size but remain substantial in most epidemiological studies, as revealed by the width of the confidence interval.

Another reason for the incorrect belief is the failure to recognize that non-differentiality is insufficient to guarantee the bias is towards the null; other conditions must be satisfied, especially independence of errors.10,11,18,19 Furthermore, even small departures from non-differentiality can produce bias away from the null.12 Finally, even when bias due to exposure misclassification is towards the null, other biases (such as confounding, selection bias, and mismeasurement of covariates) can cause the total bias to be away from the null. The combined effect from all biases must be considered when interpreting study results.22–25

When biases are a serious concern (the usual case in epidemiology) and the study results are of potential policy importance, we recommend using quantitative methods for evaluating the effect of not only exposure misclassification but also other systematic errors.19,22–30 Methods such as sensitivity analysis, uncertainty analysis, and bias modelling provide a means to account for systematic error in ways that do not depend on traditional and often faulty qualitative heuristics. These methods can be extended and given empirical grounding by the addition of ‘validation’ or reproducibility data to the analysis,31,32 although very large amounts of such data may be needed to provide effective corrections,33 and use of incorrect non-differentiality assumptions in the ensuing analyses may worsen bias.34,35 When such methods are not used, we recommend that results be presented in a very cautious and descriptive manner, rather than promoted by unfounded judgments that biases are small or errors are in a known direction. We believe a very descriptive approach to presenting results is often commendable, and need not detract from the scientific value of a research report.36

Simulation results such as ours are sensitive to the conditions chosen for the simulation. In practice one cannot show that a single epidemiological study has the conditions identical to those assumed in a simulation experiment. Thus, it may not be possible to generalize the details of our simulation results to many practical situations. They do not, for example, show how relaxing the strict non-differentiality or independence conditions would affect the behaviour of estimates. Nonetheless, they do show that even if the conditions are perfectly satisfied, the results may be an overestimate, with the probability of overestimation depending on the size of bias and the distribution of random errors. This point is important because any study is but one replication, and hence the results reflect random error as well as bias. Thus, unless the confidence intervals from the study are very narrow (suggesting random error is small), researchers should not infer that their results are an underestimate, even if they can persuasively argue that the net bias from all sources (not just exposure misclassification) is towards the null; the most that can be said is that the results are more likely an underestimate than an overestimate.

Disclaimer
Although the research described in the article has been funded in part by the US Environmental Protection Agency's STAR programme through grant (U-91615801-0), it has not been subject to any EPA review and therefore does not necessarily reflect the views of the Agency, and no official endorsement should be inferred.


    Acknowledgments
 
This research has been supported by a grant from the US Environmental Protection Agency's Science to Achieve Results (STAR) programme.


    Notes
 
3 Present address. Community Health Department, Utah Valley State College, Orem, UT 84058, USA. Back


    References
 Top
 Abstract
 An overview of previous...
 Simulation study
 Results
 Discussion
 References
 
1 Bross I. Misclassification in 2 x 2 tables. Biometrics 1954; 10:478–86.[CrossRef][ISI]

2 Newell DJ. Errors in the interpretation of errors in epidemiology. Am J Public Health 1962; 52:1925–28.[Free Full Text]

3 Keys A, Kihlberg JK. Effect of misclassification on estimated relative prevalence of a characteristic: I. Two populations infallibly distinguished. II. Errors in two variables. Am J Public Health 1963; 53:1656–65.

4 Gullen WH, Bearman JE, Johnson EA. Effects of misclassification in epidemiologic studies. Public Health Rep 1968; 83:914–18.[ISI][Medline]

5 Goldberg JD. The effects of misclassification on the bias in the difference between two proportions and the relative odds in the fourfold table. J Am Stat Assoc 1975; 70:561–67.[CrossRef][ISI]

6 Weinberg CR, Umbach DM, Greenland S. When will nondifferential misclassification of an exposure preserve the direction of a trend? Am J Epidemiol 1994; 140:565–71.[Abstract/Free Full Text]

7 Dosemeci M, Wacholder S, Lubin JH. Does nondifferential misclassification of exposure always bias a true effect toward the null value? Am J Epidemiol 1990; 132:746–48.[Abstract/Free Full Text]

8 Wacholder S, Dosemeci M, Lubin JH. Blind assignment of exposure does not always prevent differential misclassification. Am J Epidemiol 1991; 134:433–37.[Abstract/Free Full Text]

9 Flegal KM, Keyl PM, Nieto FJ. Differential misclassification arising from nondifferential errors in exposure measurement. Am J Epidemiol 1991; 134:1233–44.[Abstract/Free Full Text]

10 Kristensen P. Bias from nondifferential but dependent misclassification of exposure and outcome. Epidemiology 1992; 3:210–15.[ISI][Medline]

11 Chavance M, Dellatolas G, Lellouch J. Correlated nondifferential misclassifications of disease and exposure: application to a cross-sectional study of the relation between handedness and immune disorders. Int J Epidemiol 1992; 21:537–46.[Abstract/Free Full Text]

12 Maldonado G, Greenland S, Phillips C. Approximately nondifferential exposure misclassification does not ensure bias toward the null [Abstract]. Am J Epidemiol 2000; 151:S39.

13 Thomas DC. Re: ‘When will nondifferential misclassification of an exposure preserve the direction of a trend?’ Am J Epidemiol 1995; 142:782–83.[Free Full Text]

14 Weinberg CR, Umbach DM, Greenland S. Weinberg et al. reply [Letter]. Am J Epidemiol 1995; 142:784.[Free Full Text]

15 Sorahan T, Gilthorpe MS. Non-differential misclassification of exposure always leads to an underestimate of risk: an incorrect conclusion. Occup Environ Med 1994; 51:839–40.[ISI][Medline]

16 Wacholder S, Hartge P, Lubin JH, Dosemeci M. Non-differential misclassification and bias towards the null: a clarification. Occup Environ Med 1995; 52:557–58.[ISI][Medline]

17 Sorahan T, Gilthorpe MS. Sorahan and Gilthorpe reply [Letter]. Occup Environ Med 1995; 52:558.[ISI]

18 Lash TL, Fink AK. Re: ‘Neighborhood environment and loss of physical function in older adults: evidence from the Alameda County study’. Am J Epidemiol 2003; 157:472–73.[Free Full Text]

19 Rothman KJ, Greenland S. Modern Epidemiology. 2nd edn. Philadelphia, PA: Lippincott-Raven, 1998.

20 Lilienfeld AM, Graham S. Validity of determining circumcision status by questionnaire as related to epidemiological studies of cancer of the cervix. J Natl Cancer Inst 1958; 21:713–20.[ISI][Medline]

21 Guide to using @Risk. Newfield, NY: Palisade Corporation, 2002.

22 Lash TL, Fink AK. Semi-Automated sensitivity analysis to assess systematic errors in observational data. Epidemiology 2003; 14:451–58.[ISI][Medline]

23 Phillips CV. Quantifying and reporting uncertainty from systematic errors. Epidemiology 2003; 14:459–66.[ISI][Medline]

24 Greenland S. Multiple bias modeling for analysis of epidemiologic data (with discussion). J R Stat Soc A 2005; 168:267–308.[CrossRef]

25 Phillips CV, Maldonado G. Using Monte Carlo methods to quantify the multiple sources of error in studies [Abstract]. Am J Epidemiol 1999; 149:S17.

26 Eddy DM, Hasselblad V, Shachter R. Meta-Analysis by the Confidence Profile Method. Boston: Academic Press Inc., 1992.

27 Morgan MG, Henrion M. Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis. New York: Cambridge University Press, 1990.

28 Vose D. Risk Analysis: A Quantitative Guide. 2nd edn. New York: John Wiley & Sons, 2000.

29 Greenland S. The impact of prior distributions for uncontrolled confounding and response bias. J Am Stat Assoc 2003; 98:47–54.[CrossRef][ISI]

30 Steenland K, Greenland S. Monte Carlo sensitivity analysis and Bayesian analysis of smoking as an unmeasured confounder in a study of silica and lung cancer. Am J Epidemiol 2004; 160:384–92.[Abstract/Free Full Text]

31 Carroll RJ, Ruppert D, Stefanski L. Measurement Error in Nonlinear Models. New York: Chapman and Hall, 1995.

32 Espeland M, Hui SL. A general approach to analyzing epidemiologic data that contain misclassification errors. Biometrics 1987; 43:1001–12.[CrossRef][ISI][Medline]

33 Greenland S. Statistical uncertainty due to misclassification: implications for validation substudies. J Clin Epidemiol 1988; 41:1167–76.[CrossRef][ISI][Medline]

34 Wacholder S, Armstrong B, Hartge P. Validation studies using an alloyed gold standard. Am J Epidemiol 1993; 137:1251–58.[Abstract/Free Full Text]

35 Lagarde F, Alfredsson L. Re: ‘Validation studies using an alloyed gold standard.’ Am J Epidemiol 1996; 143:1175–76.[Free Full Text]

36 Greenland S, Gago-Domiguez M, Castellao JE. The value of risk-factor (‘black-box’) epidemiology (with discussion). Epidemiology 2004; 15:519–35.[CrossRef][ISI][Medline]


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
BMJHome page
I. Tzoulaki, I. J Brown, Q. Chan, L. Van Horn, H. Ueshima, L. Zhao, J. Stamler, P. Elliott, and for the International Collaborative Research Group
Relation of iron and red meat intake to blood pressure: cross sectional epidemiological study
BMJ, July 15, 2008; 337(jul15_1): a258 - a258.
[Abstract] [Full Text] [PDF]


Home page
Int J EpidemiolHome page
D. McGeoghegan, K. Binks, M. Gillies, S. Jones, and S. Whaley
The non-cancer mortality experience of male workers at British Nuclear Fuels plc, 1946-2005
Int. J. Epidemiol., June 1, 2008; 37(3): 506 - 518.
[Abstract] [Full Text] [PDF]


Home page
Int J EpidemiolHome page
A. M Jurek, S. Greenland, and G. Maldonado
Brief Report: How far from non-differential does exposure or disease misclassification have to be to bias measures of association away from the null?
Int. J. Epidemiol., April 1, 2008; 37(2): 382 - 385.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
Z. Fewell, G. Davey Smith, and J. A. C. Sterne
The Impact of Residual and Unmeasured Confounding in Epidemiologic Studies: A Simulation Study
Am. J. Epidemiol., September 15, 2007; 166(6): 646 - 655.
[Abstract] [Full Text] [PDF]


Home page
Cancer Res.Home page
X. Jiang, J.-M. Yuan, P. L. Skipper, S. R. Tannenbaum, and M. C. Yu
Environmental Tobacco Smoke and Bladder Cancer Risk in Never Smokers of Los Angeles County
Cancer Res., August 1, 2007; 67(15): 7540 - 7545.
[Abstract] [Full Text] [PDF]


Home page
Am. J. PsychiatryHome page
K. Posner, M. A. Oquendo, M. Gould, B. Stanley, and M. Davies
Columbia Classification Algorithm of Suicide Assessment (C-CASA): Classification of Suicidal Events in the FDA's Pediatric Suicidal Risk Analysis of Antidepressants
Am J Psychiatry, July 1, 2007; 164(7): 1035 - 1043.
[Abstract] [Full Text] [PDF]


Home page
PediatricsHome page
V. Ehrenstein, L. Pedersen, V. Holsteen, H. Larsen, K. J. Rothman, and H. T. Sorensen
Postterm Delivery and Risk for Epilepsy in Childhood
Pediatrics, March 1, 2007; 119(3): e554 - e561.
[Abstract] [Full Text] [PDF]


Home page
ANN OCCUP HYGHome page
B. CHARBOTEL, J. FEVOTTE, M. HOURS, J.-L. MARTIN, and A. BERGERET
Case-Control Study on Renal Cell Cancer and Occupational Exposure to Trichloroethylene. Part II: Epidemiological Aspects
Ann. Hyg., November 1, 2006; 50(8): 777 - 787.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
S. Greenland and P. Gustafson
Accounting for Independent Nondifferential Misclassification Does Not Increase Certainty that an Observed Association Is in the Correct Direction
Am. J. Epidemiol., July 1, 2006; 164(1): 63 - 68.
[Abstract] [Full Text] [PDF]


Home page
CarcinogenesisHome page
J. Shen, M. B. Terry, M. D. Gammon, M. M. Gaudet, S. L. Teitelbaum, S. M. Eng, S. K. Sagiv, A. I. Neugut, and R. M. Santella
MGMT genotype modulates the associations between cigarette smoking, dietary antioxidants and breast cancer risk
Carcinogenesis, December 1, 2005; 26(12): 2131 - 2137.
[Abstract] [Full Text] [PDF]


Home page
Int J EpidemiolHome page
M. P Fox, T. L Lash, and S. Greenland
A method to automate probabilistic sensitivity analyses of misclassified binary variables
Int. J. Epidemiol., December 1, 2005; 34(6): 1370 - 1376.
[Abstract] [Full Text] [PDF]


Home page
Int J EpidemiolHome page
G. D. Smith
Infection, medical care and inequalities
Int. J. Epidemiol., June 1, 2005; 34(3): 507 - 508.
[Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
34/3/680    most recent
dyi060v2
dyi060v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (21)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Jurek, A. M
Right arrow Articles by Church, T. R
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Jurek, A. M
Right arrow Articles by Church, T. R
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?