This article has Open Peer Review reports available.
Equivalency of risk for a modified health endpoint: a case from recreational water epidemiology studies
© Wymer et al.; licensee BioMed Central Ltd. 2013
Received: 13 November 2012
Accepted: 30 April 2013
Published: 10 May 2013
The United States Environmental Protection Agency (USEPA) and its predecessors have conducted three distinct series of epidemiological studies beginning in 1948 on the relationship between bathing water quality and swimmers’ illnesses. Keeping pace with advances in microbial technologies, these studies differed in their respective microbial indicators of water quality. Another difference, however, has been their specific health endpoints. The latest round of studies, the National Epidemiological Assessment of Recreational (NEEAR) Water studies initiated in 2002, used a case definition, termed “NEEAR GI illness” (NGI), for gastrointestinal illness corresponding closely to classifications employed by contemporary researchers, and to that proposed by the World Health Organization. NGI differed from the previous definition of “highly credible gastrointestinal illness” (HCGI) upon which the USEPA’s 1986 bathing water criteria had been based, primarily by excluding fever as a prerequisite.
Incidence of NGI from the NEEAR studies was compared to that of HCGI from earlier studies. Markov chain Monte Carlo method was used to estimate the respective beta binomial probability densities for NGI and HCGI establish credible intervals for the risk ratio of NGI to HCGI.
The ratio of NGI risk to that of HCGI is estimated to be 4.5 with a credible interval 3.2 to 7.7.
A risk level of 8 HCGI illnesses per 1000 swimmers, as in the 1986 freshwater criteria, would correspond to 36 NGI illnesses per 1000 swimmers. Given a microbial DNA-based (qPCR) water quality vs. risk relationship developed from the NEEAR studies, 36 NGI per 1000 corresponds to a geometric mean of 475 qPCR cell-equivalents per 100 ml.
The interest in setting water quality standards for bathing beach waters extends back to the early part of the 20th century. The microbiological quality of recreational waters was first discussed in the United States as early as 1922 by the American Public Health Association’s Committee on Bathing Beaches . The Committee Report in 1924  concluded that there was not enough evidence to develop bathing water standards for natural waters. In June, 1933 the Joint Committee on Bathing Places was formed and in their first report noted that because of the great lack of epidemiological information no bacterial standards were adopted . The reluctance to propose bacterial standards for outdoor bathing places extended from 1936 to1957 [4–6]. Even as late as 1957 the Committee stated that very little reliable data were available to implicate bathing places in the spread of disease .
Gastrointestinal illness case definitions: US studies
US PHS McCabe 
EPA-1986 Cabelli 
Highly Credible Gastrointestinal Illness
w/fever or disabling
NEEAR Wade et al. 
3 episodes in 24 h.
Disabling or with nausea
Disabling or with stomachache
Less than four years later the newly formed US Environmental Protection Agency (US EPA) began another series of epidemiological studies that were designed to improve on some of the shortcomings of the US PHS studies. A major improvement involved the use of a new case definition which included combinations of symptoms (see Table 1), thus providing a more reliable health endpoint termed “highly credible gastrointestinal illness” (HCGI). These studies also included new methods for measuring water quality. Membrane filter methods for Escherichia coli and enterococci were introduced as new measures of water quality for bathing beach waters [9–11]. Data from the US EPA studies were used in 1986 to develop new water quality criteria for marine and freshwater beaches. The epidemiological studies showed that in marine waters the density of enterococci had the strongest relationship to GI illness in swimmers, while in fresh waters both E. coli and enterococci densities showed a strong relationship to swimming-associated GI illness. Rather than developing criteria based on a new acceptable risk level, the 1968 criteria were translated to new criteria by setting a simple algebraic proportion equation, where the proportion of the unknown criteria to the average density of the new indicator is equal to the proportion of the fecal coliform criteria (200 fecal coliform per 100 ml) to the average density of the fecal coliforms . The resulting criteria values were related to health risk values using the regression equations for health on water quality for both marine and fresh recreational waters.
A more contemporary case definition for gastroenteritis was used. The new health endpoint for GI illness did not include fever as a necessary requirement (Table 1). One reason for the change in illness definition was to allow consideration of viral illness (such as norovirus) which may not produce high fever in combination with GI symptoms. This case definition is more similar to that suggested by a group of international experts who proposed that a uniform international definition should include vomiting or diarrhea constituting greater than or equal to three soft stools in a 24 hour period without a requirement of fever , as well as by the World Health Organization . The revised definition is also similar to definitions used in other epidemiology studies of GI illness in relation to waterborne exposures in North America [15–17]. This case definition is labeled NEEAR gastrointestinal illness (NGI) to distinguish it from the case definition used in the earlier EPA studies. In addition, the first series of studies had different follow up period over which illness was assessed (8–10 days for the 1986 studies, and 10–12 days for the NEEAR studies).
The data were analyzed using a different approach than that used in 1986. Water quality measures were grouped by day, rather than by summer trial as in the early EPA studies. Furthermore, the current analysis used regression modeling techniques which allowed consideration and control for individual characteristics such as age, sex and other demographic characteristics.
Water quality was measured using a quantitative polymerase chain reaction method . The analyte for this method is the DNA obtained from enterococci in a 100 mL water sample. Target DNA from live and dead enterococci cells is measured by qPCR, unlike culture methods, which only measure viable and culturable cells. The molecular indicator is less influenced by environmental stresses and its degradation characteristics in water are more similar to that of viral and protozoan pathogens, both of which have been shown to persist in water environments longer than the currently used fecal indicator bacteria [19, 20].
In 1986, criteria were developed based on data from beach waters that met a fecal coliform standard . Coliforms, and thus fecal coliforms, have been shown to have widely different die-off rates in marine and freshwater. The T90 (time for 90% of the coliforms to die) for fresh water was about 26 hours, whereas the T90 in marine waters was about 2.5 hours . This difference was thought to influence the fecal coliform-illness relationship in marine waters where higher swimming-associated illness rates were observed than those among freshwater swimmers at comparable coliform levels. Similar swimming-associated GI illness rate differences were observed between marine and freshwater swimmers in Europe and the UK , where fecal coliforms also were used to measure water quality. Since 1986 the US EPA has recommended the use of enterococci as a measure of water quality for both marine and fresh bathing beach waters. Enterococci show much slower die-off rates in marine waters than coliform indicator bacteria [23, 24].
Effect of case definition on gastrointestinal illness rate
Non-swimmer illness rate per 1000
3 episodes in 24 hours
van Asperen 
w/fever or disabling
3 episodes in 24 hours
The Beaches Environmental Assessment and Coastal Health (BEACH) Act of 2000  mandated that studies be conducted and new recreational water criteria developed based on these studies that are “as protective as” that which existed in the 1986 criteria. Thus, swimming-related risk of illness relative to the baseline level for new criteria should be the same as, or better than, it was when the 1986 criteria were established, keeping mindful of the fact that the mean baseline illness rate may change over time even for a fixed case definition of illness. It is, then, our objective to develop an approach to translate the recreational water tolerable illness rate for pre-1986 HCGI to an equivalent illness rate for the contemporary NGI definition that takes into account all factors that may affect the difference, including temporal effects, and use this equivalence to convert the new equivalent illness rate to an Enterococcus qPCR guideline value based on the NEEAR data. In addition, we present a regression model utilizing all NEEAR study data to estimate NGI illness risk and to provide a basis for interpreting the results of the translation. Much of the information in this paper has appeared online as an appendix to the USEPA 2012 recreational water criteria . Here we present technical details, including an estimation of the respective distributions of historical HCGI and contemporary NGI background illness rates and related statistical analyses along with expanded discussion of these results.
We use the baseline GI illness rates (rates among non-swimmers) in the USEPA and NEEAR studies to investigate the relationship between the HCGI and NGI case definitions and any potential changes in the disease burden. Illnesses among swimmers are not considered because the relationship between HCGI and NGI symptom rates among swimmers may be influenced by systematic disparity in their exposure to contaminated bathing water. Differences in reported HCGI and NGI illnesses among non-swimmers in these respective studies will be influenced by differences not only in case definition, but also in the length of follow up period, temporal effects, and even changes in health awareness over the approximately 30 years that intervene these two sets of studies. The latter effects are confounded with case definition, but it is the overall combined effect that is relevant in determining an illness rate for the current NGI definition that is equivalent to that of the former HCGI definition. The non-swimmer illness rates of the two populations will give the best estimate of any inherent changes in the background illness rates that may have occurred between studies conducted in the mid to late 1970’s which form the basis for the 1986 Criteria and the studies conducted during the years 2002–2009, and provide an unbiased estimate of the effect of changing the case definition for gastroenteritis.
Non-swimmer illness rates are seen to vary beach-by-beach both in the old studies using HCGI and the NEEAR study using NGI as the case definition. These geographic differences between the respective studies are accounted for in the form of random spatial/temporal effects in our model of HCGI case definition on NGI case definition. As commonly done for data consisting of binomial realizations from several independent subpopulations, where each subpopulation may be associated with a different probability of “success,” a beta-binomial model is used (see, for example, ). Background illness rates among the various beaches are assumed to follow a beta distribution, which has the desirable properties of being bounded between zero and one, and can assume a range of shapes capable of describing a variety of distributions of illness rates. Within a beach the number of illnesses observed among non-swimmers is assumed to be described by the binomial with probability of illness unique to that beach. Parameters for the beta distribution are estimated separately for HCGI and NGI using the VGAM package (version.8-1; T.W.Yee, University of Auckland, New Zealand), an add-on for the R computer software for Windows (version 2.8.1; R Development Core Team, 2009). Because of the relatively small number of individual beaches used in these studies, Bayesian confidence intervals (“credible intervals”) for the mean probabilities of HCGI and NGI [=α/(α + β) from the beta-binomial parameters] and risk ratio of NGI to HCGI were evaluated via Markov Chain Monte Carlo (MCMC) estimation using WinBUGS version 1.4.3 . MCMC uses simulation techniques to sample the distribution of possible values for these probabilities based on the observed data .
Once the equivalence between NGI and HCGI has been established based on non-swimmer data from the NEEAR and 1986 studies, respectively, we can translate the tolerable HCGI risk of the 1986 criteria to an equivalent NGI health risk. Tolerable risk was defined in the 1986 criteria in terms of the swimming-associated illness (SAI) rate per 1000 swimmers (8 HCGI illnesses for freshwater and 19 for marine waters) .
Key to translating the tolerable illness level from the 1986 criteria to an equivalent illness risk level for data from the NEEAR study is the relative risk (RR) expression. Relative risk is defined as the ratio of the illness rate in exposed individuals to the illness rate in non-exposed individuals. The RR, then, is related to the increase in risk in an exposed population. In our case, the relationship is given by RR = (NS + SAI)/NS, where NS is the non-exposed illness rate (represented by non-swimmers). That is, the tolerable RR is given by the total tolerated swimmers’ risk, which is the sum of the non-exposed illness risk (NS) plus SAI, divided by the non-exposed risk, NS. The approach is to make the relative risk of NGI as defined in the NEEAR studies equivalent to the relative risk of HCGI in the 1986 EPA studies.
The translation algorithm for converting the 1986 criteria illness rate to an equivalent illness rate from the NEEAR data may be described as a two step process.
After the 1986 tolerable illness risk level has been translated to a new illness risk level that is compatible with the NEEAR study data there is a second step in the process. That step is to convert the new tolerable illness risk level to an Enterococci qPCR CCE (Calibrator Cell Equivalent) guideline value based on the relationship between the GI swimming-associated illness rate and the water quality as measured with a real-time qPCR method.
This model (Figure 1) provides a framework for converting a translated tolerable illness risk level to an Enterococcus qPCR CCE guideline value.
Results and discussion
The overall non-swimmer illness rates were 14 HCGI illnesses per thousand from the earlier EPA studies and 63 NGI illnesses per thousand from the NEEAR study (note that this includes waders with non-swimmers since the two groups are not statistically different in terms of baseline risk). This indicates a ratio of 4.5 contemporary NGI illnesses to historical, pre-1986 HCGI illnesses among the respective non-swimmer populations.
One expects baseline rates of illness to vary among the beach-going, but non-swimming population from one location to the next. This variation may be influenced by numerous factors, including illness among the general population at large, non-swimming related exposure at the beach (eating, drinking, beach-goer density, etc.), types of environs from which beach-goers are drawn (urban, rural, suburban, industrial, commercial, etc.). Figure 2 indicates that the incidence of contemporary NGI is more variable than that of HCGI observed pre-1989, but this is largely, if not entirely, due simply to the fact that the definition of NGI is broader and thus has a higher incidence. Based on the distributions shown in Figure 2, 90% of the time actual background incidence rates of HCGI among non-swimmers would have varied beach-by-beach between 10 and 20 cases per thousand, compared to 40 to 90 cases per thousand for NGI, roughly the same two-to-one range, within limits of precision, for either illness. This at least offers a degree of confirmation that the variability of background illnesses beach-to-beach among non-swimmers is typical, either as observed prior to 1986 with respect to the HCGI case definition or more recently with NGI.
giving, log 10(ENTqPCR) = 2.668, or ENTqPCR = 466.
Proceeding from the scenario of a common tolerable risk level for both marine and freshwater environments, then, our example of a qPCR criterion will follow from a tolerable risk of 36 swimming-related cases of NGI per 1000 swimmers. This was shown above to be equivalent to 8 HCGI cases per 1000 swimmers, as specified in the 1986 freshwater criteria. Setting the swimming-related risk of NGI in the provisional model to 36 per thousand would imply an Enterococcus qPCR CCE geometric mean criterion of 466 cell equivalents per 100 mL for both freshwater and marine beaches.
The translation algorithm presented here is a straightforward approach for linking data reported in 1986 to data collected in the NEEAR study during epidemiological studies conducted between 2002 and 2009. This risk based approach used relative risk levels from the early and more recent EPA studies which had dissimilar case definitions to describe gastrointestinal illness in the two non-swimming populations to link the different illness frequencies to a common relative risk that was described by a simple translation factor. The development of new health data using a new case study definition, a new method for describing water quality and a more contemporary approach to analyzing epidemiological data in the NEEAR study presents a significant challenge to reconciling the new approach to the approach that was used over 25 years ago, which differed in the use of these three elements. The advantage of the current approach is that it can be used with any database that presents a relationship between swimming associated illness and water quality as measured with any valid indicator that might serve as a guideline. Given such a relationship, an acceptable risk level that is already in place or one that has been selected by consensus can be used to translate a prior risk level to one that is appropriate for the relationship in question and to convert that risk level to an indicator guideline value
A change in case definition in the US EPA epidemiological studies conducted in the 1970–80 and 2002–09 years resulted in an increase in the non-swimming illness rate by a factor of 4.5.
Equivalent risk levels for the illness rates associated with the different case definitions were developed through the application of a consistent relative risk of 1.57.
The new tolerable illness risk level can be used with the regression model that describes the relationship between swimming-associated gastrointestinal illness and water quality measured with a molecular indicator to determine the Enterococcus qPCR density related to an illness rate of 36 per 1000 swimmers or any other tolerable risk level.
The authors would like to acknowledge Dr. Rebecca Calderon (deceased) for her inspiration, dedication and vision. We also thank our NEEAR study colleagues: Michael Beach, Kevin Oshima, Elizabeth Sams, Richard Haugland, Kristen Brenner, and Shawn Siefring. Additional funding was not required for the present study.
- American Public Health Association (APHA): Report of the Committee on Bathing Places. Am J Public Health. 1922, 12: 121-123. 10.2105/AJPH.12.2.121.View ArticleGoogle Scholar
- American Public Health Association (APHA): Report of the Committee on Bathing Places. Am J Public Health. 1924, 14: 597-602. 10.2105/AJPH.14.7.597.View ArticleGoogle Scholar
- American Public Health Association (APHA): Swimming Pools and Bathing Places. Am J Public Health. 1933, 23: 40-49.Google Scholar
- American Public Health Association (APHA): Bathing Places. Am J Public Health. 1936, 26: 209-219.Google Scholar
- American Public Health Association (APHA): Look Forward in the Bathing Place Sanitation Field. Am J Public Health. 1940, 30: 50-51.View ArticleGoogle Scholar
- American Public Health Association (APHA): Recommended Practice for Design, Equipment and Operation of Swimming Pools and Other Public Bathing Places. 1957, Washington D.C: Joint Committee on Bathing PlacesGoogle Scholar
- Stevenson AH: Studies of Bathing Water Quality and Health. Am J Public Health. 1953, 43: 529-538. 10.2105/AJPH.43.5_Pt_1.529.View ArticleGoogle Scholar
- National Technical Advisory Committee: Federal Water Pollution Control Administration. 1968, Washington, DC: Dept. of the Interior, Water Quality CriteriaGoogle Scholar
- McCabe LJ: Bathing Water Quality and Health, III Coastal Water, A Study of Bathing Water Quality in Long Island Sound at Westchester County, N.Y. and its Relation to Health of Bathers. 1950, Cincinnati, Ohio: US Public Health Service, Division of Water Supply and Pollution ControlGoogle Scholar
- Cabelli VJ: Health Effects Criteria for Marine Waters. 1983, Research Triangle Park, NC: US Environmental Protection. Agency, EPA-600/1-80-031Google Scholar
- Dufour AP: Health for Effects Criteria Fresh Recreational Waters. 1984, Research Triangle Park, NC: U.S. Environmental Protection Agency, EPA-600/1-84-004Google Scholar
- Dufour AP: Bacterial Indicators of Recreational Water Quality. C J Public Health. 1984, 75: 49-56.Google Scholar
- Majowicz SE, Hall G, Scallan E, Adak GK, Gauci C, Jones TF, O’Brien SO, Henao O, Sockett PN: A common symptom-based case definition for gastroenteritis. Epidemiol Infect. 2008, 136: 886-894.View ArticlePubMedGoogle Scholar
- World Health Organization: WHO Initiative to Estimate the Global Burden of Foodborne Diseases. 2007, Geneva, Switzerland, http://www.who.int/foodsafety/publications/foodborne_disease/burden_nov07/en,Google Scholar
- Payment P, Richardson L, Siemiatycki J, Dewar R, Edwardes M, Franco E: A randomized trial to evaluate the risk of gastrointestinal disease due to consumption of drinking water meeting current microbiological standards. A J Public Health. 1991, 81: 703-8. 10.2105/AJPH.81.6.703.View ArticleGoogle Scholar
- Payment P, Siemiatycki J, Richardson L, Gilles R, Franco E, Prevost M: A prospective epidemiological study of gastrointestinal health effects due to the consumption of drinking water. Int J Environ Heal R. 1997, 7: 5-31. 10.1080/09603129773977.View ArticleGoogle Scholar
- Colford JM, Wade T, Sandhu S, Wright C, Lee S, Shaw S, Fox K, Burns S, Benker A, Brookhart M, van der Laan M: A randomized, controlled trial of in-home drinking water intervention to reduce gastrointestinal illness. Am J Epidemiol. 2005, 161: 472-82. 10.1093/aje/kwi067.View ArticlePubMedGoogle Scholar
- Haugland RA, Siefring SC, Wymer LJ, Brenner KP, Dufour AP: Comparison of Enterococcus Measurements in Freshwater at Two Recreational Beaches by Quantitative Polymerase Chain Reaction and Membrane Filter Culture Analysis. Water Res. 2005, 39: 559-568. 10.1016/j.watres.2004.11.011.View ArticlePubMedGoogle Scholar
- Bae S, Wuertz S: Rapid decay of host-specific Bacteroidales cells in seawater as measured by quantitative PCR with propidium monoaszide. Water Res. 2009, 43: 4850-4859. 10.1016/j.watres.2009.06.053.View ArticlePubMedGoogle Scholar
- Enriquez CE, Hurst CJ, Gerba CP: Survival of enteric adenoviruses 40 and 41 in tap, sea and waste water. Water Res. 1995, 29 (11): 2548-2553. 10.1016/0043-1354(95)00070-2.View ArticleGoogle Scholar
- US Environmental Protection Agency (USEPA): Quality criteria for water. 1976, Washington, DCGoogle Scholar
- Kay D: Assessment of Human Health Effects Caused by Bathing. 2009, The Epibathe Project: University of Wales AberystwythGoogle Scholar
- Anderson KL, Whitlock JE, Harwood VJ: Persistence and differential survival of fecal indicator bacteria in subtropical waters and sediments. Appl Environ Microb. 2005, 71 (6): 3041-3048. 10.1128/AEM.71.6.3041-3048.2005.View ArticleGoogle Scholar
- Lessard EJ, Sieburth JM: Survival of natural sewage populations of enteric bacteria in diffusion and batch chambers in the marine environment. Appl Environ Microb. 1983, 45 (3): 0950-959.Google Scholar
- Wiedenmann A, Kruger P, Dietz K, Lopez-Pila JM, Szewzyk R, Botzenhart K: A randomized controlled trial assessing infectious disease risks from bathing in fresh recreational waters in relation to the concentration of Escherichia coli, intestinal enterococci, Clostridium perfringens and somatic coliphages. Environ Health Persp. 2006, 114: 228-236. 10.1289/ehp.8115.View ArticleGoogle Scholar
- van Asperen IA, Medema G, Borgdorff MW, Sprenger MJW, Havelaar AH: Risk of gastroenteritis among triathletes in relation to faecal pollution of fresh waters. Int J Epidemiol. 1998, 27: 309-315. 10.1093/ije/27.2.309.View ArticlePubMedGoogle Scholar
- Kay D, Fleisher JM, Salmon RL, Jones F, Wyer MD, Godfree AF, Zelenauch-Jacquotte Z, Shore R: Predicting likelihood of gastroenteritis from sea bathing; results from randomised exposure. Lancet. 1994, 344: 905-09. 10.1016/S0140-6736(94)92267-5.View ArticlePubMedGoogle Scholar
- “Beaches Environmental Assessment and Coastal Health.” Title 33 U.S.Code, Sec. 1251, 870-877. 2000Google Scholar
- Recreational Water Quality Criteria: see Appendix A: Translation of 1986 Criteria Risk to Equivalent Risk Levels for Use with New Health Data Developed Using Rapid Methods for Measuring Water Quality). (last accessed 3/24/2013. http://water.epa.gov/scitech/swguidance/standards/criteria/health/recreation/index.cfm,
- McCulloch CE, Searle SR: Generalized, Linear, and Mixed Models. 2001, NY: John Wiley & SonsGoogle Scholar
- Lunn DJ, Thomas A, Best N, Spiegelhalter D: WinBUGS -- a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput. 2000, 10: 325-337. 10.1023/A:1008929526011. http://www.mrc-bsu.cam.ac.uk/bugs/,View ArticleGoogle Scholar
- Ntzoufras I: Bayesian Modeling Using WinBUGS. 2009, Hoboken, NJ: John Wiley & SonsView ArticleGoogle Scholar
- Environmental Protection Agency US: Ambient water quality criteria for bacteria −1986, EPA 440/5–86–001. 1986, Office of Water, Washington, DC: US Environmental Protection AgencyGoogle Scholar
- Wade TJ, Brenner KP SE, Haugland R, Chern E, Beach M, Wymer L, Rankin CC, Love D, Li Q, Noble R, Dufour AP: Rapidly measured indicators of recreational water quality and swimming-associated illness at marine beaches: a prospective cohort study. Environ Health. 2010, 9: 66-10.1186/1476-069X-9-66. http://www.ehjournal.net/content/9/1/66,View ArticlePubMedPubMed CentralGoogle Scholar
- Wade TJ, Calderon RL, Brenner KP, Sams E, Beach M, Haugland R, Wymer L, Dufour AP: High sensitivity of children to swimming-associated gastrointestinal illness: results using a rapid assay of recreational water quality. Epidemiology. 2008, 19 (3): 375-383. 10.1097/EDE.0b013e318169cc87.View ArticlePubMedGoogle Scholar
- Colford JM, Wade TJ, Schiff KC, Wright CC, Griffith JF, Sandhu SK, Burns S, Sobsey M, Lovelace G, Weisberg SB: Water quality indicators and the risk of illness at beaches with nonpoint sources of fecal contamination. Epidemiology. 2007, 18: 27-35. 10.1097/01.ede.0000249425.32990.b9.View ArticlePubMedGoogle Scholar
- Altman DG, Bland JM: Interaction revisited: the difference between two estimates. Brit Med J. 2003, 326: 219-10.1136/bmj.326.7382.219.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1471-2458/13/459/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.