Nothing Special   »   [go: up one dir, main page]

Academia.eduAcademia.edu

Scenario–model–parameter

https://doi.org/10.1016/S0160-4120(02)00025-9

Abstract

The recently developed concepts of aggregate risk and cumulative risk rectify two limitations associated with the classical risk assessment paradigm established in the early 1980s. Aggregate exposure denotes the amount of one pollutant available at the biological exchange boundaries from multiple routes of exposure. Cumulative risk assessment is defined as an assessment of risk from the accumulation of a common toxic effect from all routes of exposure to multiple chemicals sharing a common mechanism of toxicity. Thus, cumulative risk constitutes an improvement over the classical risk paradigm, which treats exposures from multiple routes as independent events associated with each specific route. Risk assessors formulate complex models and identify many realistic scenarios of exposure that enable them to estimate risks from exposures to multiple pollutants and multiple routes. The increase in complexity of the risk assessment process is likely to increase risk uncertainty. Despite evidence that scenario and model uncertainty contribute to the overall uncertainty of cumulative risk estimates, present uncertainty analysis of risk estimates accounts only for parameter uncertainty and excludes model and scenario uncertainties. This paper provides a synopsis of the risk assessment evolution and associated uncertainty analysis methods. This evolution leads to the concept of the scenario -model -parameter (SMP) cumulative risk uncertainty analysis method. The SMP uncertainty analysis is a multiple step procedure that assesses uncertainty associated with the use of judiciously selected scenarios and models of exposure and risk. Ultimately, the SMP uncertainty analysis method compares risk uncertainty estimates determined using all three sources of uncertainty with conventional risk uncertainty estimates obtained using only the parameter source. An example of applying the SMP uncertainty analysis to cumulative risk estimates from exposures to two pesticides indicates that inclusion of scenario and model sources increases uncertainty of risk estimates relative to those estimated using only the parameter source. Changes in uncertainty magnitude may affect decisions made by risk managers. D

Environment International 28 (2002) 247 – 261 www.elsevier.com/locate/envint Scenario–model–parameter: a new method of cumulative risk uncertainty analysis D.J. Moschandreas a,*, S. Karuchit b a Illinois Institute of Technology, Department of Chemical and Environmental Engineering, Perlstein Hall, Room 233, 10 West 33rd Street, Chicago, IL 60616-3783, USA b Suranaree University of Technology, School of Environmental Engineering, 111 University Avenue, Suranaree Subdistrict, Muang District, Nakhon Ratchasima 30000, Thailand Received 12 October 2001; accepted 27 March 2002 Abstract The recently developed concepts of aggregate risk and cumulative risk rectify two limitations associated with the classical risk assessment paradigm established in the early 1980s. Aggregate exposure denotes the amount of one pollutant available at the biological exchange boundaries from multiple routes of exposure. Cumulative risk assessment is defined as an assessment of risk from the accumulation of a common toxic effect from all routes of exposure to multiple chemicals sharing a common mechanism of toxicity. Thus, cumulative risk constitutes an improvement over the classical risk paradigm, which treats exposures from multiple routes as independent events associated with each specific route. Risk assessors formulate complex models and identify many realistic scenarios of exposure that enable them to estimate risks from exposures to multiple pollutants and multiple routes. The increase in complexity of the risk assessment process is likely to increase risk uncertainty. Despite evidence that scenario and model uncertainty contribute to the overall uncertainty of cumulative risk estimates, present uncertainty analysis of risk estimates accounts only for parameter uncertainty and excludes model and scenario uncertainties. This paper provides a synopsis of the risk assessment evolution and associated uncertainty analysis methods. This evolution leads to the concept of the scenario – model – parameter (SMP) cumulative risk uncertainty analysis method. The SMP uncertainty analysis is a multiple step procedure that assesses uncertainty associated with the use of judiciously selected scenarios and models of exposure and risk. Ultimately, the SMP uncertainty analysis method compares risk uncertainty estimates determined using all three sources of uncertainty with conventional risk uncertainty estimates obtained using only the parameter source. An example of applying the SMP uncertainty analysis to cumulative risk estimates from exposures to two pesticides indicates that inclusion of scenario and model sources increases uncertainty of risk estimates relative to those estimated using only the parameter source. Changes in uncertainty magnitude may affect decisions made by risk managers. D 2002 Published by Elsevier Science Ltd. Keywords: Cumulative risk; Aggregate risk; Uncertainty analysis; Variability; Monte Carlo simulation 1. Introduction 1. Exposures to a pollutant from multiple routes are usually treated as independent events associated with each The National Research Council (NRC) instituted the specific route (EPA, 1999a). Therefore, simultaneous expo- classical risk assessment paradigm, a multiple-step proce- sures experienced by one person from multiple routes over a dure that identifies a hazard and then relates population period of time are not considered. exposure to one agent with dose and risk (NRC, 1983). 2. Exposures to multiple chemicals are often treated as However, this conventional risk assessment practice is con- individual events and the combined toxicity effect(s) of strained by the following limitations that could lead to simultaneous exposures to multiple chemicals are not underestimation of risk. addressed. 3. Uncertainty analysis in conventional risk assessment considers only parameter uncertainty. Although both of the * Corresponding author. Tel.: +1-312-567-3040; fax: +1-312-567-8874. other two types of uncertainty (scenario and model) con- E-mail address: djm@iit.edu (D.J. Moschandreas). tribute to overall uncertainty, they are frequently assumed 0160-4120/02/$ - see front matter D 2002 Published by Elsevier Science Ltd. PII: S 0 1 6 0 - 4 1 2 0 ( 0 2 ) 0 0 0 2 5 - 9 248 D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 negligible or ignored (Fayerweather et al., 1999). Failure to new method that adds model and scenario uncertainty to the account for them could compromise the validity of the conventional parameter uncertainty analysis of the cumu- outcome and conclusions reached by current methods of lative risk assessment. We call this new inclusive method estimating risk assessment. the scenario –model – parameter (SMP) uncertainty analysis. The recently developed concepts of aggregate and This paper focuses on the development of the SMP uncer- cumulative risks respond to the first and second limitations, tainty analysis as an integral part of the cumulative risk respectively (EPA, 1999a, 2000). Risk assessment analysis assessment method. We begin with a review of essential is evolving as risk assessors formulate models that are more concepts involving exposure, dose, and risk, including the complex, identify many and more realistic scenarios of new aggregate and cumulative risk concepts, continue with exposure, and attain new insights that allow the practitioner a review of uncertainty classification and uncertainty anal- to estimate risks from exposures to multiple pollutants and ysis processes, and conclude by formulating the SMP multiple routes. This increase in complexity of the risk uncertainty analysis process. We demonstrate the applica- assessment process is likely to increase risk uncertainties. tion of this method with results from a related paper on the However, methods to estimate uncertainty associated with uncertainty of risk estimates from exposures to chlorpyrifos risk estimates have remained unchanged. Uncertainty anal- and diazinon using the National Human Exposure Assess- ysis of risk estimates accounts for only parameter uncer- ment Survey in Arizona (NHEXAS-AZ) database (Karuchit tainty and excludes model and scenario uncertainties. Risk and Moschandreas, 2001). analysts have not substantiated but assume that model and scenario uncertainties are smaller than parameter uncertain- ties. In a recent treatment of uncertainty assessment of 2. A synopsis of risk-related concepts chemical dose that the authors characterize as ‘‘introduc- tory,’’ Hertwich et al. (2000) address all three types of 2.1. Exposure and dose uncertainties. They conclude that scenario and model uncer- tainty analysis can change dose estimates by several orders Definitions of exposure, dose and related terms used in of magnitude. this paper are those established in the EPA document Currently, a specific procedure for a quantitative analysis ‘‘Guidelines for Exposure Assessment’’ (EPA, 1992a). The of scenario or model uncertainty is not available in the basic structure of the flow of an agent from the outer literature. A general suggestion regarding analysis of model boundary to the receptor target organ and associated defi- uncertainty is that risk assessors may use different models to nitions are illustrated in Table 1 (EPA, 1992a). The onset of estimate outputs (EPA, 1992a; Hoffman and Hammonds, the scheme is the contact of a chemical agent with the outer 1994). The range of outputs can be considered as represent- boundary, which establishes an exposure. The outer boun- ing the uncertainty range. A more focused approach that daries of the inhalation route are the mouth and nose, and deals specifically with scenario and model uncertainties is the outer boundary of the ingestion route is the mouth. In known as the distributional approach. This approach has this scheme, there is no outer boundary of the dermal route, been used in analyses of uncertainty from model structure since the skin is the place where absorption takes place, and and alternative assumptions or scenarios (Fayerweather et therefore it is an absorption barrier or exchange boundary, al., 1999; Evans et al., 1994a,b). The distributional approach not an outer boundary. The route-specific boundaries, with divides the risk assessment into a series of decision points corresponding chemical transfer process, are shown in Table called ‘‘nodes’’ that have alternatives. A combination of 2 (EPA, 1992a). alternatives from each node constitutes a ‘‘tree.’’ Each tree The intake process commences when the chemical has an assigned probability or ‘‘weight’’ based on expert moves through the opening of the outer boundary. The judgment. This weight is attributed to the risk estimate amount of the chemical after crossing the outer boundary resulting from each tree. Such results form the final risk is called a potential dose. Inhalation dose, oral dose and distribution. However, the integrity of the final distribution dermal dose are common names for route-specific potential relies heavily on the subjective nature of experts’ input. dose (EPA, 1992a). Potential dose is synonymous with There are also concerns that assigning probabilities to administered dose. The amount that reaches the exchange models, i.e., quantifying the possibility of a model to be boundary is called an applied dose (see Table 1). The ‘‘correct,’’ is inappropriate (Morgan and Henrion, 1990; uptake process takes place at the exchange boundary and Cullen and Frey, 1998). Although the literature does not involves absorption of the chemical through the skin or explicitly refer to scenario uncertainty, it is reasonable to exposed tissues. The amount of chemical absorbed is assume that approaches and comments on model uncertainty called an absorbed dose, while the amount of chemical are applicable to scenario uncertainty. transported to an individual organ and the amount that This paper responds to the need to account for changes in reaches it are called a delivered dose and a biologically uncertainty magnitude when two, not one, equally valid effective dose, respectively. models and two equally plausible scenarios are used to Although the above dose terms signify different quanti- estimate risk and uncertainty. The objective is to develop a ties, they all have the same unit. The unit of dose has three D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 249 Table 1 Exposure and dose scheme (adapted from EPA, 1992a) different variations: mass of the chemical, mass of the 2.2. Risk and risk assessment chemical per time, and mass of the chemical per body weight per time. More importantly, the units are common Exposure to harmful chemical agents leads to risk—the across routes, which is a major advantage when evaluating probability of suffering adverse effect, e.g., harm or loss. risk from all routes of exposure, and when comparing The process of estimating that probability is called risk contribution of each route to the resulting risk. The generic analysis (LaGrega et al., 1994; Molak, 1997). Risk analysis unit of exposure (Concentration  Time) is usually used for applied to a particular situation constitutes a risk assess- inhalation route only. It is neither practical nor common to ment, which usually estimates the probability of occurrence use this unit with ingestion and dermal routes. Instead, of human health effects (Molak, 1997). The NRC defines exposures via these two routes are frequently expressed as risk assessment as a formalized and structured process that potential dose (see, for example, EPA, 1992b, 1993). The estimates the magnitude, likelihood and uncertainty of unit difference prohibits simple addition of exposure from environmentally induced health effects (NRC, 1983). Haz- all three routes. Addition of doses, however, is an estab- ard identification, dose – response assessment, exposure lished approach as is discussed later. assessment and risk characterization are the four elements or steps of risk assessment that constitute the risk assess- ment paradigm (NRC, 1983). Hazard Identification deter- Table 2 Route-specific boundaries and chemical transfer processes (EPA, 1992a) mines whether a particular chemical is causally linked to particular health effects. Dose –response assessment formu- Scheme Process Inhalation Ingestion Dermal boundary boundary boundarya lates a relation between the magnitude of exposure and the probability of occurrence of the health effects in question. (Hypothetical) Intake Mouth/nose Mouth – outer boundary Exposure assessment estimates the extent of human expo- Exchange boundary Uptake Lung Gastrointestinal Skin sure before or after application of regulatory controls. Risk (absorption barrier) tract characterization describes the nature and often the magni- a There is no intake process for dermal route, the skin is the exchange tude of human risk, including its uncertainty. (NRC, 1983). boundary where uptake process takes place (EPA, 1992a). Details on each element of the risk paradigm and the 250 D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 significance of exposure and risk assessment with respect to These two concepts are applied jointly in an aggregate risk scientific research are found in the literature (e.g., Sexton et assessment. For each individual, dose is estimated for all al., 1993; NRC, 1983). routes considered simultaneously, and then combined as an aggregate dose. The combination is based on the dose 2.3. Aggregate and cumulative risk assessment addition approach, which is explained in the next para- graph, along with the concept of cumulative risk. Aggre- The risk assessment paradigm estimates risks from gate doses, obtained from each individual, are used to exposure to one pollutant from multiple routes or multiple formulate the population distribution of aggregate dose. pollutants from one route. A paradigm shift was conceived Consequently, the population aggregate risk assessment is to enable risk assessors to estimate risks from exposures to based on this distribution. multiple pollutants from multiple routes. This shift led to the Although aggregate risk assessment addresses the issue cumulative risk assessment procedure. Thus, the risk assess- of exposure to multiple routes, it considers only one ment evolution begins with the risk assessment paradigm, chemical. The ‘‘aggregate’’ concepts do not address cumu- evolves with the notion of aggregate risk and ends with lative effects from exposure to multiple chemicals. Cumu- cumulative risk. lative risk assessment incorporates risks from both multiple Aggregate risk is the outcome of a three-concept routes and multiple chemicals. Concepts and methods of consolidation (EPA, 1999a): (1) Aggregate exposure is cumulative risk assessment are introduced in the EPA the amount of one chemical available at the biological document entitled ‘‘Proposed Guidance on Cumulative Risk exchange boundaries (e.g., respiratory tract, gastrointestinal Assessment of Pesticide Chemicals that Have a Common tract and skin) from multiple routes of exposure. (2) Mechanism of Toxicity’’ (EPA, 2000). Fundamentally, the Aggregate dose is the amount of a single substance cumulative risk assessment can be viewed as an extension available for interaction with metabolic processes at bio- of the aggregate risk assessment. It is defined as an assess- logically significant receptors from multiple routes of ment of risk from the accumulation of a common toxic exposure. (3) Aggregate risk is the likelihood of the effect from all routes of exposure to multiple substances occurrence of an adverse health effect resulting from all sharing a common mechanism of toxicity. Common toxic routes of exposure to a single substance. effect refers to the same toxic effect caused by different The term ‘‘aggregate’’ is the keyword used throughout substances in or at the same organ or tissue (EPA, 2000). several recently published EPA guidance documents. The Common mechanism of toxicity refers to substances that term ‘‘aggregate exposure’’ is not defined as the contact of cause a common toxic effect by the same sequence of an agent with the outer boundary of an organism, which is biochemical events (EPA, 2000). the conventional definition of exposure. Instead, it refers to Dose addition provides mechanisms and methods to applied dose—the amount that reaches the exchange boun- estimate both aggregate risk and cumulative risk. This dary. Thus, ‘‘aggregate exposure’’ is the applied dose in all approach is explained by the following quote (EPA, 2000): routes of exposure. This peculiar use of the term ‘‘expo- sure’’ is a concern related to its definition and usage. The application of dose addition is based on the Indeed, EPA occasionally uses the term ‘‘exposure’’ to assumption that the chemicals behave similarly in terms refer to dose (e.g., (EPA, 2000, 1992b)). Moreover, simple of the primary physiologic processes (absorption, interpretation of the term aggregate as ‘‘added’’ or metabolism, distribution, elimination), as well as the ‘‘summed’’ could lead to misconception about how aggre- toxicologic processes. In other words, the chemicals of gate risk is estimated. In fact, this term is used to denote interest are assumed to behave as if they were dilutions of essential concepts of the new risk assessment approach and each other. When applying dose addition methods, the deserves careful consideration. Since EPA does not appear Agency has generally assumed no interactions among the to provide an exact definition of this term, for the balance chemicals (i.e., simple additivity) when there is no of this paper a practical definition of the term ‘‘aggregate’’ adequate interaction information. is used to denote two concepts jointly: (1) simultaneous consideration of all routes of exposure and (2) ‘‘individual- The margin of exposure (MOE), aggregate risk index by-individual’’ assessment. The first concept is applied to (ARI), hazardous index (HI), relative potency factor (RPF) improve the current practice of risk assessment, which and toxicity equivalency factor (TEF) methods are among typically treats exposure from different routes as independ- the several metrics that help estimate cumulative risk (EPA, ent events (EPA, 1999a). Simultaneous consideration of all 1999a, 2000; Wilkinson et al., 2000). All methods are routes of exposure contributes to a more realistic risk similar in that they normalize doses of each substance to a assessment because a person may be simultaneously common scale (EPA, 2000). The normalized doses are then exposed to a chemical from multiple routes. The ‘‘individ- summed. All methods are considered valid approaches as ual-by-individual’’ assessment considers exposures that they are expected to give similar results when certain each individual actually experiences, and uses appropriate conditions are assumed and no single method is preferred information regarding time, location, and demographics. (EPA, 2000; Wilkinson et al., 2000). D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 251 3. Conventional uncertainty analysis of risk estimates professional judgment are associated with defining appro- priate exposure schemes, selecting improper models or This section reviews the classification and prevailing determining unrepresentative conditions; and incomplete analysis of risk uncertainty before a new uncertainty anal- analysis denotes a source of errors from including or ysis procedure is developed. Uncertainty analysis is the excluding particular exposure scenarios. analysis of variation or imprecision of the outcome of an Model uncertainty refers to uncertainty from gaps in assessment (Iman and Helton, 1988). The uncertainty of the scientific theory that are necessary to make predictions outcome is caused by many sources; therefore, uncertainty based on causal inferences (EPA, 1997a). Its sources include is generally classified by its sources. Several different modeling errors and relationship errors (EPA, 1997a, classifications of uncertainty are suggested in the literature 1992a). Simplified representation of reality leads to model- (EPA, 1992a; Morgan and Henrion, 1990; Bogen, 1990; ing errors, while errors in correlation among model varia- Cullen and Frey, 1998; Finkel, 1990; IAEA, 1989). In bles result in relationship errors. general, there are two commonly used (and often not clearly separated) classifications: (1) scenario, model and parameter 3.2. U-V uncertainty and (2) uncertainty– variability (U-V). An analysis that deals with parameter uncertainty only 3.1. Scenario, model and parameter uncertainty uses the U-V classification. In this classification, uncertainty is classified as either U or V. V refers to the true hetero- The EPA classifies uncertainty involved in exposure and geneity, or interindividual variability, attributed to certain risk assessments into three types: parameter, scenario and characteristics of a population (EPA, 1997b). Other terms model uncertainty (EPA, 1992a, 1997a,b). The three types used for V in the literature include stochastic uncertainty, of uncertainty, their sources and examples are summarized aleatory uncertainty and Type A uncertainty (Cullen and below. Frey, 1998). All parameter uncertainty that is not V is Parameter uncertainty is the uncertainty regarding defined as U. parameters (EPA, 1997a). Sources of parameter uncertainty Most analysts prefer distinguishing variability from other are measurement errors, sampling errors, variability, and the types of uncertainty because of its characteristics and use of surrogate data (EPA, 1997a, 1992a). Measurement ramifications for decision-making in risk assessment. Vari- errors refer to random errors (imprecision) or systematic ability is usually not reducible by further measurement or errors (bias), while sampling errors are errors from small study, while uncertainty from other sources may be reduced sample size and/or nonrepresentative samples. Heterogene- by further measurement (Cullen and Frey, 1998; Burmaster ity in environmental and exposure-related data includes and Wilson, 1996; Haimes and Lambert, 1999). Therefore, seasonal variation, spatial variation, variation of human differentiating between variability and other types of uncer- activity patterns by age, gender and geographic location tainty in risk assessment helps decision-makers to focus on and leads to variability errors. Surrogate data refer to errors appropriate uncertainty reduction measures (EPA, 1997b). from the use of substitute data. The name of this classifica- Such distinction is fundamental to characterizing uncer- tion requires close attention. The term ‘‘parameter’’ is used tainty in the uncertainty analysis (Bogen, 1990; EPA, to reflect two concepts (EPA, 1997b). The first refers to the 1997b; MacIntosh et al., 1995; Rai et al., 1996; Haimes distribution parameter—the constants characterizing the and Lambert, 1999). Burmaster and Wilson (1996) discuss probability distribution of a variable (e.g., l or r). The the reason for separating V from U as follows: second refers to both distribution parameter and model variable, where model variable denotes a variable that is Since V and U arise from different sources, have different an element of a model, such as time, weight, concentration interpretations and have different consequences in or other variables in an exposure, dose or risk model. In our decision-making, many risk assessors have sought a opinion, the EPA uses the term ‘‘parameter uncertainty’’ way to encode and propagate them separately. At the end where ‘‘parameter’’ denotes both distribution parameter and of a long calculation, it is highly desirable for the risk model variable. This paper uses the term ‘‘distribution assessor to be able to segregate the total V from the total parameter’’ or ‘‘model variable’’ instead of ‘‘parameter’’ U so the risk manager could make appropriate decisions. to avoid possible confusion. In particular, the risk manager can do little to reduce the Scenario uncertainty refers to uncertainty associated with total V in an assessment, but she or he can often reduce missing or incomplete information needed to fully define the total U in an assessment by commissioning further the exposure and dose (EPA, 1997a). Its sources include studies. descriptive errors, aggregation errors, errors in professional judgment and incomplete analysis (EPA, 1997a, 1992a). Based on its uncertainty type, a model variable can be a U Descriptive errors are errors from incorrect or incomplete type, V type or both (Bogen, 1990; MacIntosh et al., 1995; information, while aggregation errors are spatial or temporal Burmaster and Wilson, 1996; Haimes and Lambert, 1999). approximations or homogeneity assumptions. Errors in The concept is best explained by examples. A U variable can 252 D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 represent the amount of pesticide on a child’s hand at a Parameter uncertainty analysis is the analysis conducted particular time. The amount of pesticide is not varying, but by most analysts at the present time. To analyze parameter the fixed, true amount is not known because of the lack of uncertainty, four approaches are typically employed: sensi- knowledge needed to make a perfect measurement. A V tivity analysis, analytical uncertainty propagation, probabil- variable can represent the grade point average (GPA) of each istic uncertainty analysis and classical statistical methods student in a class. The GPA is known exactly for each student (EPA, 1992a; Cox and Baybutt, 1981; Iman and Helton, but it varies from one student to another because it represents 1988; Seiler, 1987; Hamby, 1994; Cullen and Frey, 1998). heterogeneity in the population. An example of a U and V variable is a variable that represents the amount of pesticide on the hands of each student in a class. Its values are 4. A new uncertainty analysis of risk estimates uncertain because of the imperfect measurement, and varia- ble because of the heterogeneity in the population. Variables The new inclusive uncertainty analysis is called the SMP that have either U or V are sometimes referred to as ‘‘first- uncertainty analysis method. In this section, we present a order’’ random variables; while those that have both U and V step-by-step scheme to estimate cumulative risk and the are sometimes referred to as ‘‘second-order’’ random varia- SMP uncertainty. The flow chart of the scheme is illustrated bles (Burmaster and Wilson, 1996). The second-order ran- in Fig. 1; it consists of six steps: dom variable has a probability distribution that describes its variability, while the distribution parameters are themselves Step 1: Identify toxic effects and endpoints uncertain. Thus, each of the distribution parameters has a Step 2: Identify the exposure scenarios of concern specific probability distribution that describes its uncertainty. Step 3: Develop the dose models Step 4: Estimate exposure, dose and risk 3.3. Conventional uncertainty analysis: parameter uncer- Step 5: Perform uncertainty analyses tainty analysis Step 6: Characterize risk Uncertainty analysis focuses on model output. Generally, This step-wise scheme is based on fundamental princi- the objectives of an uncertainty analysis are: (1) to evaluate ples of risk assessment and methods suggested by the EPA the output uncertainty and (2) to find the relative contribu- (EPA, 1999a, 2000). Comparison with the four elements of tion of each model variable to the output uncertainty. The the early risk assessment paradigm indicates that the first second objective is commonly referred to as a sensitivity two elements of conventional risk assessment—hazard analysis (Iman and Helton, 1988; Hamby, 1994). Analysis identification and dose –response assessment—are included results make possible a more informed and sound decision- in the first step of the scheme. Exposure assessment and making process. There are two ways to analyze uncertainty: elements of risk assessment are found in Steps 2, 3 and 4. characterization and assessment (EPA, 1992a). Uncertainty Risk characterization is put together in the last three steps. characterization is a qualitative discussion that focuses on Certain steps of the scheme are explained with examples the determination of sources of uncertainty and their impact obtained from a study of the Arizona population risk assess- on the model results. Uncertainty assessment is a quantita- ment of exposure to pesticides using the NHEXAS-AZ tive analysis of uncertainty. database (Karuchit and Moschandreas, 2001). This risk Fig. 1. Flow chart of the scheme. D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 253 assessment is an application of the risk assessment uncer- pollutants. When exposure measurement is not feasible, tainty estimating approach detailed in this paper. concentration and questionnaire data are combined to esti- mate exposures using the indirect method. Concentration 4.1. Identification of toxic effects and endpoints measurements are generally obtained from field studies. Subject information (e.g., time and frequency of contact, In the first step, information is gathered regarding toxic food consumption, and area of surfaces contacted) and other effects, toxic endpoints and dose – response relationship of exposure factors can be obtained from questionnaire data, the pollutants investigated. Toxic effects are defined as literature or assumptions. A typical assumption for the effects caused by exposure to a chemical that will or can estimation is that the subjects’ exposure to pollutant con- be expected to endanger one’s quality of life (EPA, 1999b). centrations in air, food and surfaces takes place according to Toxic endpoint is the quantitative presentation of a toxic each scenario defined over periods relevant for the mani- effect at a certain exposure level, e.g., NOAEL and RfD. By festation of a toxic effect. A concentration measured in a definition, cumulative risk assessment is only applicable to bulk medium is assumed homogeneous and not varying pollutants that have common toxic effects and common over the time of interest. For each subject and environment, mechanism of toxicity. medium sampling must take place at the same time and the exposure, dose and risk of pollutants assessed must have the 4.2. Identification of the exposure scenarios and exposure same mechanism of toxicity (EPA, 2000). models Usually, certain pollutant concentrations are censored values because they are assigned values below the limit of Exposure scenario is a set of facts, assumptions and detection (LOD) of their perspective measurement instru- inferences about how exposure takes place (EPA, 1992a). ment. Below LOD measurements are generally assigned one EPA’s ‘‘Standard Operating Procedures (SOPs) for Residen- of three values (zero, the LOD value or a value half the tial Exposure Assessments’’ (EPA, 1997c) contains informa- LOD value) or they can be assigned values using the robust tion about major exposure scenarios, which need to be method. The robust method generates ‘‘fill-in’’ values for adapted to the pollutants of interest. Not all the listed those below LOD values according to the distribution of the scenarios need to be included in the final assessment. To above-LOD values (Helsel, 1990; Moschandreas et al., perform a risk assessment that is focused and meaningful, the 2001). The ‘‘fill-in’’ values are then assigned randomly. included scenarios must be carefully selected. Criteria for This assignment is permanent for all analyses for a given excluding scenarios from a study are not definitive but database. include: scenarios that have very little possibility of happen- Cumulative risk can be estimated using either the deter- ing; scenarios that are likely to result in trivial amount of ministic or the probabilistic approach; each approach has subject pollutant dose; and scenarios that have inadequate advantages and limitations. We recommend both approaches information to perform an exposure assessment (EPA, to gain insights in the assessment and to make use of extant 1992a, 2000). Conventional and clear scenarios are identi- databases. The deterministic approach is the fundamental fied early in the risk assessment study and are called ‘‘base- estimation approach that is appropriate for the application of line.’’ Later in the SMP process, different assumptions are the ‘‘individual-by-individual’’ concept of the aggregate and made leading to ‘‘alternative’’ scenarios. Exposure duration cumulative risk assessment. In this approach, each subject’s is part of an exposure scenario; therefore, duration must be data are used with appropriate models to estimate pollutant both relevant to the toxic end and realistic. Exposure and route-specific dose, and then the risk metric. Therefore, duration is selected for each of the alternative scenarios. each risk metric is calculated using the dose estimates that For subpopulations of interest, an assessment uses the base- belong to one and the same subject. However, this approach line scenarios with only subjects from the subpopulation has two major limitations. First, it cannot provide as much groups that are likely to be exposed to pollutants of interest. information about the variation, i.e., uncertainty, of the Identification of models for estimating exposure and estimated results as the probabilistic approach. Second, the potential dose, Step 3, are pollutant dependent and are estimation can be performed only on those subjects with a developed on the basis of several existing examples found complete set of data—those who have exposure estimates in the literature. Dose models employ the indirect method of for all pollutants and all routes. In other words, subject exposure estimation, also known as the scenario estimation measurements must be available for all media (e.g., indoor approach. air, food, floor dust, sill wipe and yard soil) along with other relevant data needed for the dose estimations. In this study, 4.3. Estimation of exposure, dose and risk such subjects constitute the cumulative assessment group (CAG). Although this may be the case for a few databases Efforts in this step begin with estimating exposure to generated for research purposes, this is not generally the subject pollutants and continue with estimating dose and case for all subjects and all media for most databases that are risk caused by the exposure. While measurement of expo- medium specific. The probabilistic estimation approach is sure is possible for certain pollutants, it is not possible for all used to overcome these limitations. 254 D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 The probabilistic approach uses a probability distribution The cumulative HI of each of the CAG subject is to represent each model variable instead of a point estimate, estimated by: a single value. The estimation is performed using the Monte XX Carlo method—a statistical sampling method for obtaining HICAG ¼ HQr;p ¼ HIA;chlorpyrifos þ HIA;diazinon ð4Þ the probability distribution of the possible outcomes of a r p model (EPA, 1997b). The probability distribution of each variable is developed using all available subject data. Con- 4.3.2. Probabilistic method sequently, the information used in the assessment is not The primary purpose of probabilistic risk estimation is to limited only to the information from those subjects who analyze uncertainty and its sources as they associate with have a complete set of data. The other advantage of the risk estimates. The probabilistic analysis may be performed probabilistic approach relates to its greater potential and using the Monte Carlo method and one of several commer- ability to analyze uncertainty. The limitation of the proba- cial software packages such as the Crystal Ball (Sargent and bilistic approach relates to its inability to accommodate the Wainwright, 1996). Based on the deterministic dose and risk ‘‘individual-by-individual’’ assessment concept. The proba- estimation models, the first step in a probabilistic analysis is bilistic approach eliminates the identity of each subject in the formulation of a probability distribution for each model the simulation process because the probability distribution variable. of a variable is the distribution of the population, and Model variables can be classified into two classes: (1) individual subjects used to formulate the distribution are variables with measured values from field studies and (2) no longer discernible. Therefore, the dose and risk are not variables with assigned values, either surrogates or assumed. estimated for each sample subject, but for all that combine For the purpose of sensitivity analysis, variables estimated to represent possible outcomes. Although the estimation from submodels involving observed data and surrogate or does not conform to the strict cumulative risk assessment assumed data should be segregated in the probabilistic concept, it estimates the population distribution of the out- analysis models. In other words, each variable is substituted put, given that the probability distributions of the model by its submodel variables. Thus, a probability function is variables are good representation of the population. developed for such variables based on observed data with- out the effect of surrogate or assumed data. The segregation 4.3.1. Deterministic method has the benefit of improving the characterization of the input The deterministic method employs appropriate dose variables and the identification of significant contributors in models discussed in the previous step to estimate dose for model outputs. all routes, inhalation, dietary ingestion, dermal absorption To obtain credible outputs, significant correlation among and nondietary ingestion. To estimate aggregate risk and input variables must be taken into account in the Monte cumulative risk, the HI method is used in the NHEXAS-AZ Carlo simulation. Rank correlation coefficients are calcu- risk assessment of exposure to two pesticides: chlorpyrifos lated for each pair of input variables to determine if and diazinon. The application of this method is explained significant correlation exists. Selected significant correlation below (EPA, 1999a, 2000; Patrick, 1994; Mumtaz, 1995). coefficients are then specified in the simulations. When a The HI of each subject is the summation of the hazardous correlation between variables is defined, the simulation quotient (HQ) of the subject, which is calculated using the program (e.g., in Crystal Ball) generates random numbers following equation: for each variable from its probability distribution and uses the correlation coefficient to rearrange the numbers to Dr;p achieve the specified correlation. HQr;p ¼ ð1Þ RfDr;p 4.3.2.1. Monte Carlo methods in probabilistic uncertainty where r denotes exposure route, p denotes pesticide; Dr,p is analysis. The Monte Carlo method is a statistical sampling the estimated potential dose of pesticide p from route r for method for obtaining the probability distribution of the each subject; RfDr,p is the reference dose of pesticide p and possible outcomes of a model (EPA, 1997b). The Monte route r. Carlo simulation process is described as follows (Cox and The aggregate HI for each pesticide is the sum of its HQs Baybutt, 1981; Sargent and Wainwright, 1996). Let a1. . .am in all routes, and the cumulative HI is the sum of all HQs. be the input variables of a model. First, each of the Thus, the aggregate HI is estimated by: independent variables are assigned a probability distribu- tion. Second, the simulation process selects one value for X each variable based on its probability distribution. This step HIA;chlorpyrifos ¼ HQr;1 ð2Þ r is repeated a large number of times, N. Consequently, N sets of values (a1(i). . .am(i)), i = 1 to N, are obtained and the X corresponding model outputs, Y(i), i = 1 to N, are calculated. HIA;diazinon ¼ HQr;2 ð3Þ The distribution of N outputs represents the population r distribution. The uncertainty of the output can be examined D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 255 Fig. 2. Illustration of the 2-D Monte Carlo simulation in Steps 1 and 2. using several statistics, including the standard error (S.E.) of that requires variability to be distinguished from other types the mean and the confidence interval (CI) of the mean or a of uncertainty (Bogen and Spear, 1987; IAEA, 1989; Hoff- specific percentile. Alternatively, the Monte Carlo method man and Hammonds, 1994; MacIntosh et al., 1995; Bur- can be described as a process where N sets of values are master and Wilson, 1996). Also known as ‘‘nesting’’ or obtained from a joint distribution of all of the input ‘‘double looping,’’ this simulation technique has an ability variables, and N corresponding model outputs are calculated to separately propagate the two types of uncertainty (Cullen (Cullen and Frey, 1998). and Frey, 1998). The two steps in the process are explained An advanced technique called the two-dimensional (2-D) using the following example. Let Y be the assessment Monte Carlo simulation is used with an uncertainty analysis endpoint, which is a function of three variables: a1 (a U Fig. 3. Illustration of the 2-D Monte Carlo simulation process (adapted from MacIntosh et al., 1995). 256 D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 variable), a2 (a V variable) and a3 (a U and V variable). The to that value. The range is obtained from the M distribu- 2-D Monte Carlo simulation of this assessment is illustrated tions. in Figs. 2 and 3. Step 1: (1) A random value is selected for a1, a U- 4.4. Uncertainty analysis variable, from its probability distribution. (2) The U and V variable a3 has a probability distribution that describes its 4.4.1. Parameter uncertainty analysis variability, while its distribution parameters—the mean and Sensitivity analysis and probabilistic uncertainty analysis variance—are uncertain. A random value is selected for are two approaches used to analyze parameter uncertainty in each of the parameters from their probability distributions. this study. The former finds the relative contribution of each The selected pair of mean and variance characterizes a model input to the change in the output, while the latter distribution for a3. evaluates the variation or imprecision in the output. The Step 2: (1) A random value is selected for a2, a V flow chart for parameter uncertainty analysis is shown in variable, from its probability distribution. (2) A random Fig. 4. In the NHEXAS-AZ pesticide risk assessment, seven value is selected for a3 from its probability distribution, simulation modules with appropriate models are used: which is obtained from Step 1. (3) The value of a1 (selected in Step 1) and the values of a2 and a3 (both selected in Step Module 1: Chlorpyrifos inhalation dose (D1,1) estimation 2) are used to estimate one output value. Module 2: Chlorpyrifos ingestion dose (D2,1) estimation Fig. 2 illustrates the two steps. Step 2 is called an Module 3: Chlorpyrifos dermal dose (D3,1) estimation ‘‘inner’’ simulation. It is repeated a large number of times, Module 4: Diazinon inhalation dose (D1,2) estimation N. In each repetition, the value of a1 is fixed at the same Module 5: Diazinon ingestion dose (D2,2) estimation value selected in Step 1, only the values of a2 and a3 vary. Module 6: Diazinon dermal dose (D3,2) estimation The simulation that includes one run of Step 1 and N runs Module 7: Cumulative hazardous index (HICAG) estima- of Step 2 is called an ‘‘outer’’ simulation. It creates one tion output distribution of size N. A large number of outer simulation runs, M, are performed to create a family of All input variables in dose models are V types; their distributions (see Fig. 3). For the outer simulations, the values vary from one individual to another in any popula- value of a1 is different from one run to the other as a result tion of interest. The only input variable that is U type is the of Step 1 selection of each run. The uncertainty associated RfD variable for each case. A reference dose is a benchmark with a statistic (e.g., mean or percentile) of the outcomes dose level that applies to every individual in the population, can be estimated from its S.E., obtained from the family of but its true or rather ‘‘best’’ value is unknown for each M distributions. Furthermore, the uncertainty about the pollutant; such a variable is a U type. percentile associated with a certain output value can be Simulations of Modules 1 through 6 are performed using estimated from the range of the percentiles corresponding conventional Monte Carlo methods. The number of runs Fig. 4. The flow chart of the parameter uncertainty analysis. D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 257 used for each simulation was 5000. Selection of the number the 90th percentile. For the outer simulation, the criterion for of runs in the simulation is usually based on the computing selecting the number of runs is based on the concept of limitation and acceptable level of precision for the most nonparametric tolerance limits used by Hoffman and Ham- concerned results (Cullen and Frey, 1998). In this study, we monds (1994). The concept provides a method to find the focus our attention on the high-end of the output distribu- sample size M needed to create an interval that contains at tions, particularly the 90th percentile values. Thus, the least a proportion q of the population, with a 1  a con- number of runs selected was based on the numerical fidence level (Conover, 1980; Montgomery and Runger, stability of this output. As the number of runs increases, 1999). Usually, the lower and upper tolerance limits are set the 90th percentile estimate stabilizes, i.e., closes in on to be the smallest and largest sample values, respectively. nearly constant values. The use of 5000 runs ensures that Using q = 0.99 and a = 0.05, a sample size of M = 473 runs numerical stability of the 90th percentile was achieved. was calculated for our example. Thus, with 500 outer For Modules 1 through 6, analyses of the variation of simulation runs, there is at least a .95 probability that at outputs used S.E. of the 90th percentile estimates that are least 99% of the population of the estimate is between the calculated using the nonparametric Bootstrap method (Efron smallest and largest values of the set of values obtained. and Tibshirani, 1993; Montgomery and Runger, 1999). Five Therefore, in the 2-D simulation, 500 distributions of the hundred bootstrap samples, each consisting of 5000 values, cumulative hazardous indexes (HICAG) were obtained. The are randomly sampled with replacement from the original mean and median of each percentile and their uncertainty set of 5000 output values. Then, the 90th percentile is were then estimated. estimated for each bootstrap sample, resulting in 500 values of the 90th percentile, from which one obtains the S.E. and 4.4.2. The SMP uncertainty analysis other statistics of the 90th percentile. The sensitivity anal- At present, there is no standard method for quantitatively ysis of each module is performed simultaneously with the analyzing these types of uncertainty. The SMP uncertainty Monte Carlo simulation using the rank correlation coeffi- analysis method presented in this section was developed to cient method. Model variables with high correlation values, incorporate scenario and model uncertainties in the uncer- R, have a significant impact on the corresponding model tainty analysis in risk assessment. The SMP uncertainty output. The model output and the rank correlation coeffi- analysis can be performed on any statistic of interest. The cient, R, between values of each variable and the output are process is best explained by an example. In the Arizona calculated simultaneously. Therefore, two outputs are pesticide risk assessment, the SMP analysis was performed obtained at the end of the simulation: a distribution of on the cumulative hazardous index, HICAG, of a subject 5000 output values and the coefficient values. The coeffi- population. It begins by dividing the analysis procedure cients of all input variables are ranked and compared to used to obtain HICAG into a series of decision points with identify the highly sensitive variables. alternatives. Two decision points, each with two alterna- 2-D Monte Carlo simulations are performed for estimat- tives, are identified and illustrated as a ‘‘decision tree’’ in ing the cumulative hazardous index of the CAG subjects Fig. 5. (HICAG), Module 7, which consists of U variables and V variables. The number of runs used is equal to 5000 and 500 4.4.2.1. Decision point #1. The first decision point is the for the inner and the outer simulation, respectively. For the selection of the method used to develop the probability inner simulation, 5000 runs ensure the numerical stability of distribution of model variables. Since the uncertainty in the Fig. 5. The ‘‘decision tree’’ of the SMP uncertainty analysis. 258 D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 model output is propagated from uncertainty in each of the The path with baseline decision for both decision points model variables, the probability distribution must be devel- is Path BB. For each analysis path, the 2-D Monte Carlo oped with appropriate methods. Two commonly used meth- simulation of Module 7 is performed using 5000 inner ods are parametric distributions, i.e., standard distributions simulation runs and 500 outer simulation runs. Therefore, that fit observations such as normal, lognormal and others, we obtained 500 distributions of HICAG estimates and 500 or empirical distributions, i.e., a histogram of study obser- 90th percentile estimates from each analysis path. Based on vations. The use of empirical distributions has certain these outputs, the uncertainty of 90th percentile estimates advantages and some limitations. Using parametric distri- was estimated and compared among different analysis paths. butions also has its benefits. With their own advantages and At this stage, uncertainty estimated for each analysis path is disadvantages, there is no general agreement as to which the parameter uncertainty only. method is preferred (EPA, 1997b). The use of different Four uncertainty analyses were established to investigate methods is likely to result in significantly different outputs the effect of inclusion of scenario or model uncertainty: and output uncertainties. Therefore, the decision made at this point is an important source of scenario uncertainty, and  Analysis P: Analysis that considers parameter uncertainty is considered as the first decision point of the SMP uncer- only tainty analysis. The alternatives of this decision point are the  Analysis SP: Analysis that considers scenario and empirical distribution method (baseline scenario) and the parameter uncertainties parametric distribution method (alternative scenario).  Analysis MP: Analysis that considers model and parameter uncertainties 4.4.2.2. Decision point #2. The second decision point is  Analysis SMP: Analysis that considers scenario, model the selection of a model for estimation of dose. Unlike and parameter uncertainties models for inhalation or ingestion route, dermal dose models are more complex and take different forms. Thus, Analysis P accounts for only parameter uncertainty and continuing with an explanation of the SMP method by ignores scenario and model uncertainties. It has only one example, we select as the baseline model that is suggested analysis path, Path BB. Analysis SP considers both scenario by the EPA in its publication entitled ‘‘Research Solicita- and parameter uncertainties; therefore, it has two analysis tion: Human Exposure Assessment’’ (EPA, 1993). It uses paths: BB and AB. In essence, this analysis assumes that the concentration data in three media (floor dust, sill wipe and two paths are equally suitable for the assessment, and assigns yard soil) and combines the data with subjects’ character- equal chance to each path to be used. In a similar fashion, istics to estimate dermal potential dose. However, the Scenario MP considers both model and parameter uncertain- model does not take into consideration information from ties, and assumes that Paths BB and BA have equal proba- hand wipe or dermal wipe. Dermal wipe data are available bility to be used in the assessment. Finally, Analysis SMP for both pesticides in the NHEXAS-AZ database. With the considers all three types of uncertainties, and assumes that all use of a general EPA dose model (EPA, 1992a), the dermal analysis paths are equally appropriate for the assessment. wipe data can be used to obtain different, but equally The scheme used to obtain estimates from each analysis is credible, estimates of dermal dose. These estimates are explained below. Analysis P is performed to obtain 500 independent of the floor dust, sill wipe or yard soil data. estimates of two statistics, the median and the 90th percen- The decision made regarding the model selection is an tile, using Path BB only. Analysis SP is performed to obtain important source of both scenario and model uncertainty, 250 estimates of the two statistics from each of the two and is considered as the second decision point of the SMP analysis Paths BB and AB. Analysis MP is performed to uncertainty analysis. The alternatives of this point are the obtain 250 estimates of the two statistics from each of the dermal model 1 (baseline model) and the dermal model 2 two analysis Paths BB and BA. Finally, Analysis SMP is (alternative model). The two models are summarized in performed to obtain 125 estimates of the two statistics from Appendix A. each of the four analysis paths. The distributions of each After establishing two alternatives for each of the two statistic are compared among analyses. The mean and decision points, four analysis paths must be considered for variance values estimated by each analysis are tested for estimating the SMP uncertainty (Fig. 5): equality. Ultimately, the relative change of risk uncertainty that accounts for only parameter uncertainty to risk uncer-  Path BB: Use empirical input distributions and dermal tainty that jointly accounts for scenario, model and parameter model 1 uncertainty is estimated using the 95% tolerance limits  Path BA: Use empirical input distributions and dermal range. model 2  Path AB: Use parametric input distributions and dermal 4.5. Risk characterization model 1  Path AA: Use parametric input distributions and dermal The findings from the risk assessment are integrated in Model 2 this final assessment step. Issues discussed in the risk D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 259 characterization include risk estimates and associated uncer- food consumption, time budget and other pertinent informa- tainties, and comparisons of risks among subpopulations. tion. Most databases, however, are not as comprehensive Additionally, risk characterization identifies variables that and therefore are likely to result in larger uncertainties than significantly affect the outcomes in each simulation module, those found in this application. or alternatives in the assessment that could change the Analysis results obtained from the NHEXAS-AZ pesti- conclusions reached. Finally, risk characterization elaborates cide risk assessment indicate that inclusion of scenario on the results of the SMP uncertainty analysis and substan- uncertainty source into the process for estimating cumula- tiates all findings to assist and support the decision-making tive risk uncertainty increases overall uncertainty. The process. uncertainty of the 90th percentile estimate of HICAG—as measured by its 95% tolerance limits range—increases almost threefold compared to the output uncertainty that 5. Discussion considers only parameter uncertainty. Inclusion of the model uncertainty source increases the uncertainty of this statistic The SMP uncertainty analysis method is not intended to by 56%, and inclusion of both the scenario and model quantify all uncertainty that exists, i.e., uncertainty from all uncertainty sources increases uncertainty by nearly a factor imaginable scenarios and all published models. Instead, it of two. Similar results are obtained when the uncertainty is provides the mechanism that allows judiciously selected measured by the range of the 95% confidence level of the scenarios and/or model uncertainty sources to be included in mean of the 90th percentile HICAG. the analysis. Ultimately, the SMP uncertainty analysis Clearly, this result confirms that the scenario and model compares the uncertainty based on all selected uncertainty uncertainty sources are significant contributors to overall sources with that based on parameter uncertainty alone to uncertainty of the outcome of the assessment. When both are ascertain if ignoring certain sources of errors would change ignored, the 90th percentile of HICAG is not likely to be near the conclusions reached. This method, therefore, allows the the level of concern: 95% of the estimates are between 0.22 risk assessor to be all-inclusive and consider all appropriate and 0.70. When the scenario uncertainty source is included, sources of uncertainty. If the SMP estimate is significantly i.e., the use of parametric distribution is considered an larger than the conventional estimate, the decision may be equally appropriate alternative as the use of empirical dis- affected. Conversely, if the SMP result is not significantly tribution, the abovementioned conclusion about the 90th larger than that of the conventional analysis, it is reassuring percentile of HICAG changes substantially. Both analysis to know that the uncertainty estimate is not sensitive to the scenarios that include the scenario uncertainty yield tolerance additional uncertainty sources included in the SMP analysis. limits range that extend more than 1.50, which means that the Selection of alternative models and scenarios as sources 90th percentile HICAG could exceed the level of concern. of uncertainty is the nucleus of the SMP analysis process; it Thus, the cumulative risk assessment process that includes must focus on realistic and practicable alternatives. Clearly, two different but realistic scenarios with two different but exposure scenario selection depends on the population, equally feasible models may lead to risk estimates that have pollutant, subject population and relevant information about substantively different uncertainty from that estimated with the population. Recall that cumulative risk requires that the conventional estimating risk uncertainty methods. pollutants share a common toxic end and the same mech- anism of adverse effect. Such information and associated factors can be obtained from the literature. The models Appendix A. Two dermal dose models selected for use and their alternatives depend on the expo- sure route. It is important to note that the literature contains A.1. Dermal dose model 1 many additional models, making the appropriate choice of alternative models a critical concern. The baseline dermal models for estimating potential dose Performance of the SMP uncertainty analysis requires are as follows (Moschandreas et al., 2001): performance of a risk assessment study. Therefore, it requires identification of one or more databases, information Dose : PDder;t ¼ Eder;t  BW1  103 ðA:1Þ on the subject population and subpopulations, selection of model and scenario uncertainty sources and factors that will be used in the performance of the research. In the work Exposure : Eder;t ¼ Eder;r þ Eder;y ðA:2Þ presented in the related paper, the SMP uncertainty method was applied using NHEXAS-AZ database. It is one among X the very few multiple pollutant, multiple route exposure, Eder;r ¼ ½CDs  Aps  Tps  ð1  DOps Þ ðA:3Þ s risk studies sponsored by a consortium of federal agencies led by the EPA. NHEXAS-AZ consists of comprehensive X subject information obtained from a multiple stage survey Eder;r ¼ ½CSs  ððSps  SAps Þ  SOps Þ  M ðA:4Þ using six different questionnaires on demographic, housing, s 260 D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 PDder,t is the total dermal potential dose of the exposure duration is assumed 24 h per day. Therefore, the pesticide of each subject (ng/kg day) total potential dose is the potential dose integrated over the Eder,t is the total dermal exposure to a pesticide of 1-day duration and the averaging time used in the model is 1 each subject (Ag/day) day. Furthermore, it is assumed that the pesticide mass is BW is the body weight of the subject (kg) distributed uniformly over the exposed body surface area Eder,r is the dermal exposure to the pesticide in and is represented by the dermal wipe concentration. There- dislodgeable surface residue of each subject fore, the total potential dose is estimated by the dermal wipe (Ag/day) concentration times the exposed body surface area: Eder,y is the dermal exposure to the pesticide in soil of each subject (Ag/day) s is the type of surfaces contacted per day. Total Potential Dose ¼ Chand  SAps  103 ðA:6Þ Dislodgeable surfaces residue data in the NHEXAS database were obtained from two surfaces: floor surface and window sill Chand is the pesticide concentration in the dermal surface. The latter is assumed representative wipe sample (Ag/m2) of residue from ‘‘nonfloor’’ surfaces, i.e., SAps is the body surface area of the subject exposed surfaces other than the floor in the house, to surface s (m2) such as furniture surfaces. For Eq. (A.3), s = 1 for floor surface and s = 2 for nonfloor sur- face. For Eq. (A.4), s = 1 for yard soil surface. CDs is the pesticide concentration of dislodgeable References surface residue on surface s (Ag/m2) Bogen KT. Uncertainty in environmental health risk assessment. Garland As is the surface area of surface s contacted by Publishing; 1990. the subject (m2/day) Bogen KT, Spear RC. Integrating uncertainty and interindividual variability Tps is the transfer proportion of surface s by the in environmental risk assessment. Risk Anal 1987;7:427 – 36. subject, proportion Burmaster DE, Wilson AM. An introduction to second-order random var- DOps is the proportion of dislodgeable residue of iables in human health risk assessments. Hum Ecol Risk Assess 1996; 2(4):892 – 919. surface s transferred to oral route by the Conover WJ. Practical nonparametric statistics. 2nd ed. Wiley; 1980. subject via hands, food and objects; Cox DC, Baybutt P. Methods for uncertainty analysis: a comparative sur- proportion vey. Risk Anal 1981;1(4):251 – 8. CSs is the pesticide concentration in soil surface s Cullen CA, Frey HC. Probabilistic techniques in exposure assessment: a (Ag/g) handbook for dealing with variability and uncertainty in models and inputs. New York: Plenum; 1998. Sps is the soil from surface s covering on skin of Efron B, Tibshirani RJ. An introduction to the bootstrap. Monographs on the subject (g/m2 day) statistics and applied probability, vol. 57. New York: Chapman and SAps is the body surface area of the subject exposed Hall; 1993. to surface s (m2) EPA, US Environmental Protection Agency. Guidelines for exposure as- SOps is the amount of soil from surface s covering sessment, 1992a. EPA, US Environmental Protection Agency. Dermal exposure assessment: on skin that is transferred to oral route by the principles and application, 1992b. subject (g/day) EPA, US Environmental Protection Agency. Research solicitation: human M is the matrix effect of soil, proportion exposure assessment. Office of Research and Development, 1993. EPA, US Environmental Protection Agency. Exposure factors handbook, 1997a. A.2. Dermal dose model 2 EPA, US Environmental Protection Agency. Guiding principles for Monte Carlo analysis, EPA/630/R-97/001, 1997b. The general EPA dose model calculates the average daily EPA, US Environmental Protection Agency. Standard operating procedure (SOPs) for residential exposure assessments. Draft, The Residential potential dose, ADDpot, by (EPA, 1992a,b, 1997a): Exposure Assessment Work Group, Office of Pesticide Programs, 1997c. EPA, US Environmental Protection Agency. Guidance for performing ag- ADDpot ðng=kg dayÞ gregate exposure and risk assessments, 1999a. Total Potential Dose ðngÞ EPA, US Environmental Protection Agency. Guidance for identifying pes- ¼ ðA:5Þ ticide chemicals and other substances that have a common mechanism Body Weight ðkgÞ  Averaging Time ðdayÞ of toxicity, 1999b. EPA, US Environmental Protection Agency. Proposed guidance on cumu- To use the general EPA dose model, a scenario of dermal lative risk assessment of pesticide chemicals that have a common mech- anism of toxicity. Office of Pesticide Programs, June 22, 2000. exposure may be defined as follows. Since pesticide residue Evans JS, Graham JD, Gray GM, Sielken Jr RL. A distributional approach on each subject’s skin comes from both outdoor (e.g., soil) to characterizing low-dose cancer risk. Risk Anal 1994a;14(1):24 – 34. and indoor (e.g., floor and furniture surfaces) sources, the Evans JS, Gray GM, Sielken Jr RL, Smith AE, Valdes-Flores C, Graham JD. D.J. Moschandreas, S. Karuchit / Environment International 28 (2002) 247–261 261 Use of probabilistic expert judgment in uncertainty analysis of carcino- MacIntosh DL, Xue J, Ozkaynak H, Spengler JD, Ryan PB. A population- genic potency. Regul Toxicol Pharmacol 1994b;20:15 – 36. based exposure model for benzene. JEAEE 1995;5(3):375 – 403. Fayerweather WE, Collins JJ, Schnatter R, Hearne FT, Menning RA, Rey- Molak V. Fundamentals of risk analysis and risk management. New York: ner DP. Quantifying uncertainty in a risk assessment using uncertainty Lewis Publishers; 1997. data. Risk Anal 1999;19(6):1077 – 90. Montgomery DC, Runger GC. Applied statistics and probability for engi- Finkel AM. Confronting uncertainty in risk management: a guide for deci- neers. 2nd ed. New York: Wiley; 1999. sion-makers. Center for Risk Management Resources for the Future, Morgan MG, Henrion M. Uncertainty: a guide to dealing with uncertainty 1990. in quantitative risk and policy analysis. Cambridge: Cambridge Univ. Haimes YY, Lambert JH. When and how can you specify a probability Press; 1990. distribution when you don’t know much? Foundations: A. Uncertainty Moschandreas DJ, Kim Y, Karuchit S, Ari H, Lebowitz MD, O’Rourke and variability. Risk Anal 1999;19(1):43 – 68. MK, Gordon S, Robertson G. Occurrence and distribution of residential Hamby DM. A review of techniques for parameter sensitivity analysis of exposure to chlorpyrifos and diazinon. J Atmos Environ 2001;35(12): environmental models. Environ Monit Assess 1994;32:135 – 54. 2201 – 13. Helsel DR. Less than obvious: statistical treatment of data below the de- Mumtaz MM. Risk assessment of chemical mixtures from a public health tection limit. Environ Sci Technol 1990;24(12):1766 – 74. perspective. Toxicol Lett 1995;82/83:527 – 32. Hertwich EG, McKone TE, Pease WS. A systematic uncertainty analysis of National Research Council (NRC). Risk assessment in the federal govern- an evaluative fate and exposure model. Risk Anal 2000;20(4):439 – 54. ment: managing the process. National Academy Press; 1983. Hoffman FO, Hammonds JS. Propagation of uncertainty in risk assess- Patrick DR. Toxic air pollution handbook, 1994. ments: the need to distinguish between uncertainty due to lack of Rai SN, Krewski D, Bartlett S. A general framework for the analysis of knowledge and uncertainty due to variability. Risk Anal 1994;14(5): uncertainty and variability in risk assessment. Hum Ecol Risk Assess 707 – 12. 1996;2(4):972 – 89. Iman RL, Helton JC. An investigation of uncertainty and sensitivity anal- Sargent R, Wainwright E. Crystal ball version 4.0 user manual. Decision- ysis techniques for computer models. Risk Anal 1988;8(1):71 – 90. eering; 1996. International Atomic Energy Agency (IAEA). Evaluating the reliability of Seiler FA. Error propagation for large errors. Risk Anal 1987;7(4):509 – 18. predictions using environmental transfer model. Safety Practice Publi- Sexton K, Olden K, Johnson BL. ‘‘Environmental justice’’: the central role cations of IAEA, Safety Series No. 100, 1989. of research in establishing a credible scientific foundation for informed Karuchit S, Moschandreas DJ. Scenario, model and parameter uncertainty decision making. Toxicol Ind Health 1993;9(5):685 – 727. analysis of cumulative risk, a case study with population exposures to Wilkinson CF, Christoph GR, Julien E, Kelley JM, Kronenberg J, McCar- chlorpyrifos and diazinon. Submitted for publication, 2001. thy J, Reiss R. Assessing the risk of exposures to multiple chemicals LaGrega MD, Buckingham PL, Evans JC. Hazardous waste management. with a common mechanism of toxicity: how to cumulate? Regul Tox- New York: McGraw-Hill; 1994. icol Pharmacol 2000;31:30 – 43.

References (41)

  1. Bogen KT. Uncertainty in environmental health risk assessment. Garland Publishing; 1990.
  2. Bogen KT, Spear RC. Integrating uncertainty and interindividual variability in environmental risk assessment. Risk Anal 1987;7:427 -36.
  3. Burmaster DE, Wilson AM. An introduction to second-order random var- iables in human health risk assessments. Hum Ecol Risk Assess 1996; 2(4):892 -919.
  4. Conover WJ. Practical nonparametric statistics. 2nd ed. Wiley; 1980.
  5. Cox DC, Baybutt P. Methods for uncertainty analysis: a comparative sur- vey. Risk Anal 1981;1(4):251 -8.
  6. Cullen CA, Frey HC. Probabilistic techniques in exposure assessment: a handbook for dealing with variability and uncertainty in models and inputs. New York: Plenum; 1998.
  7. Efron B, Tibshirani RJ. An introduction to the bootstrap. Monographs on statistics and applied probability, vol. 57. New York: Chapman and Hall; 1993.
  8. EPA, US Environmental Protection Agency. Guidelines for exposure as- sessment, 1992a.
  9. EPA, US Environmental Protection Agency. Dermal exposure assessment: principles and application, 1992b.
  10. EPA, US Environmental Protection Agency. Research solicitation: human exposure assessment. Office of Research and Development, 1993.
  11. EPA, US Environmental Protection Agency. Exposure factors handbook, 1997a.
  12. EPA, US Environmental Protection Agency. Guiding principles for Monte Carlo analysis, EPA/630/R-97/001, 1997b.
  13. EPA, US Environmental Protection Agency. Standard operating procedure (SOPs) for residential exposure assessments. Draft, The Residential Exposure Assessment Work Group, Office of Pesticide Programs, 1997c.
  14. EPA, US Environmental Protection Agency. Guidance for performing ag- gregate exposure and risk assessments, 1999a.
  15. EPA, US Environmental Protection Agency. Guidance for identifying pes- ticide chemicals and other substances that have a common mechanism of toxicity, 1999b.
  16. EPA, US Environmental Protection Agency. Proposed guidance on cumu- lative risk assessment of pesticide chemicals that have a common mech- anism of toxicity. Office of Pesticide Programs, June 22, 2000.
  17. Evans JS, Graham JD, Gray GM, Sielken Jr RL. A distributional approach to characterizing low-dose cancer risk. Risk Anal 1994a;14(1):24 -34.
  18. Evans JS, Gray GM, Sielken Jr RL, Smith AE, Valdes-Flores C, Graham JD. Use of probabilistic expert judgment in uncertainty analysis of carcino- genic potency. Regul Toxicol Pharmacol 1994b;20:15 -36.
  19. Fayerweather WE, Collins JJ, Schnatter R, Hearne FT, Menning RA, Rey- ner DP. Quantifying uncertainty in a risk assessment using uncertainty data. Risk Anal 1999;19(6):1077 -90.
  20. Finkel AM. Confronting uncertainty in risk management: a guide for deci- sion-makers. Center for Risk Management Resources for the Future, 1990.
  21. Haimes YY, Lambert JH. When and how can you specify a probability distribution when you don't know much? Foundations: A. Uncertainty and variability. Risk Anal 1999;19(1):43 -68.
  22. Hamby DM. A review of techniques for parameter sensitivity analysis of environmental models. Environ Monit Assess 1994;32:135 -54.
  23. Helsel DR. Less than obvious: statistical treatment of data below the de- tection limit. Environ Sci Technol 1990;24(12):1766 -74.
  24. Hertwich EG, McKone TE, Pease WS. A systematic uncertainty analysis of an evaluative fate and exposure model. Risk Anal 2000;20(4):439 -54.
  25. Hoffman FO, Hammonds JS. Propagation of uncertainty in risk assess- ments: the need to distinguish between uncertainty due to lack of knowledge and uncertainty due to variability. Risk Anal 1994;14(5): 707 -12.
  26. Iman RL, Helton JC. An investigation of uncertainty and sensitivity anal- ysis techniques for computer models. Risk Anal 1988;8(1):71 -90. International Atomic Energy Agency (IAEA). Evaluating the reliability of predictions using environmental transfer model. Safety Practice Publi- cations of IAEA, Safety Series No. 100, 1989.
  27. Karuchit S, Moschandreas DJ. Scenario, model and parameter uncertainty analysis of cumulative risk, a case study with population exposures to chlorpyrifos and diazinon. Submitted for publication, 2001.
  28. LaGrega MD, Buckingham PL, Evans JC. Hazardous waste management. New York: McGraw-Hill; 1994.
  29. MacIntosh DL, Xue J, Ozkaynak H, Spengler JD, Ryan PB. A population- based exposure model for benzene. JEAEE 1995;5(3):375 -403.
  30. Molak V. Fundamentals of risk analysis and risk management. New York: Lewis Publishers; 1997.
  31. Montgomery DC, Runger GC. Applied statistics and probability for engi- neers. 2nd ed. New York: Wiley; 1999.
  32. Morgan MG, Henrion M. Uncertainty: a guide to dealing with uncertainty in quantitative risk and policy analysis. Cambridge: Cambridge Univ. Press; 1990.
  33. Moschandreas DJ, Kim Y, Karuchit S, Ari H, Lebowitz MD, O'Rourke MK, Gordon S, Robertson G. Occurrence and distribution of residential exposure to chlorpyrifos and diazinon. J Atmos Environ 2001;35(12): 2201 -13.
  34. Mumtaz MM. Risk assessment of chemical mixtures from a public health perspective. Toxicol Lett 1995;82/83:527 -32.
  35. National Research Council (NRC). Risk assessment in the federal govern- ment: managing the process. National Academy Press; 1983.
  36. Patrick DR. Toxic air pollution handbook, 1994.
  37. Rai SN, Krewski D, Bartlett S. A general framework for the analysis of uncertainty and variability in risk assessment. Hum Ecol Risk Assess 1996;2(4):972 -89.
  38. Sargent R, Wainwright E. Crystal ball version 4.0 user manual. Decision- eering; 1996.
  39. Seiler FA. Error propagation for large errors. Risk Anal 1987;7(4):509 -18.
  40. Sexton K, Olden K, Johnson BL. ''Environmental justice'': the central role of research in establishing a credible scientific foundation for informed decision making. Toxicol Ind Health 1993;9(5):685 -727.
  41. Wilkinson CF, Christoph GR, Julien E, Kelley JM, Kronenberg J, McCar- thy J, Reiss R. Assessing the risk of exposures to multiple chemicals with a common mechanism of toxicity: how to cumulate? Regul Tox- icol Pharmacol 2000;31:30 -43.