A Step-by-Step Guide to Developing PECO Statements for Ecotoxicity Systematic Reviews

Abstract

This article provides a comprehensive, practical guide for researchers, scientists, and drug development professionals on developing robust PECO (Population, Exposure, Comparator, Outcome) statements for ecotoxicity and environmental health systematic reviews. It covers the foundational principles of the PECO framework, moving beyond its clinical PICO origins to address the unique challenges of exposure science. The guide details methodological applications through different research scenarios, offers solutions for common challenges like exposure misclassification and evidence integration, and examines validation through frameworks like GRADE. It aims to equip professionals with the tools to formulate precise, protocol-driven research questions that enhance the transparency, reproducibility, and regulatory acceptance of systematic reviews in toxicology and risk assessment.

The PECO Framework Explained: Building the Foundation for Ecotoxicity Reviews

Core PECO Components and Their Operational Definitions

The PECO framework is the foundational structure for formulating precise, answerable research questions in environmental health systematic reviews and evidence mapping. It translates a broad assessment objective into a structured format that guides every subsequent step of the review process, from literature search to evidence synthesis [1]. In the context of ecological and human health risk assessment, it shifts focus from a clinical "intervention" to an environmental "exposure" [2].

Table 1: Operational Definitions and Applications of PECO Components

PECO Component	Core Definition	Key Considerations for Ecotoxicity Systematic Reviews	Example from PFAS Assessment [3]
Population (P)	The biological system(s) of interest that are subjected to exposure.	Defines the scope of extrapolation. May include humans (general or occupational populations), specific mammalian species in vivo, or non-traditional models (e.g., fish embryos, in vitro systems) [4].	Human: Any population/lifestage. Animal: Nonhuman mammalian species of any lifestage.
Exposure (E)	The chemical, physical, or biological agent, its specific form, and the conditions of contact (route, duration, magnitude).	Critical for relevance. Must specify chemical forms, relevant environmental routes (e.g., oral, inhalation), and exclude irrelevant routes (e.g., injection) unless for supplemental mechanistic insight [3].	Exposure to specific PFAS via oral or inhalation routes. Biomarker studies are included.
Comparator (C)	The reference condition against which the exposed group is compared.	Establishes the basis for effect detection. For animal studies, a concurrent control group (vehicle-only) is standard. For human studies, a population with lower or no exposure is required [3].	Animal: Concurrent vehicle-only control. Human: Population with lower/no exposure.
Outcome (O)	The measured health effects or endpoints linked to the exposure.	Initially kept broad to capture all potential hazards during problem formulation. Later refined to prioritize endpoints for quantitative analysis [1].	All health outcomes (cancer and noncancer).

The PECO statement's primary function is to establish explicit inclusion and exclusion criteria for the systematic review. A well-defined PECO ensures the review captures all pertinent evidence while excluding irrelevant studies, minimizing bias, and enhancing reproducibility [1]. For New Approach Methodologies (NAMs), such as cell-based models or computational toxicology tools, defining a PECO is a critical step to bridge their development with application in formal risk assessment [4].

Practical Implementation: From Problem Formulation to Protocol

Developing a PECO is an iterative process that begins with broad scoping and is progressively refined. The U.S. EPA's Integrated Risk Information System (IRIS) handbook outlines a staged approach where a broad initial PECO is used to create a Systematic Evidence Map (SEM), which then informs a more focused PECO for specific hazard identification reviews [5] [6].

Diagram 1: PECO Development in Assessment Planning (83 characters)

A significant challenge noted by the National Academies is maintaining transparency during this refinement process. The initial broad PECO ensures a comprehensive survey of literature, but the criteria for later focusing on specific outcomes must be clearly documented and justified to avoid the perception of subjective selection [6].

Table 2: Comparison of PECO Framing for Different Review Objectives

Review Objective	Population (P)	Exposure (E)	Comparator (C)	Outcome (O)
Human Hazard Identification [3]	Human populations (general/occupational).	Environmental exposure via relevant routes (e.g., oral).	Unexposed/low-exposure group.	Pre-defined adverse health outcomes.
Animal Bioassay Synthesis [3]	Specified mammalian test species (e.g., rat, mouse).	Controlled experimental dosing (e.g., gavage, diet).	Concurrent vehicle-treated control group.	Pathological, clinical, or molecular endpoints.
NAM Integration [4]	In vitro cell systems or non-mammalian models (e.g., fish embryo).	Chemical exposure in a defined test medium.	Unexposed cells/embryos in vehicle control.	Mechanistic or apical toxicity endpoints (e.g., cytotoxicity, gene expression).
Evidence Mapping [1]	Broad (Human & Mammalian animals).	Broad (All relevant forms & routes).	Broad (As defined per study type).	All health outcomes (captures everything).

Integration into Systematic Review Workflow

The PECO statement is the engine of the systematic review workflow. A proposed adaptive framework for risk assessment integrates PECO-driven problem formulation with systematic evidence mapping and subsequent targeted reviews [7].

Diagram 2: Systematic Review Workflow Driven by PECO (73 characters)

A key output of the PECO-driven search and screening process is the literature inventory or SEM. This database tags studies as either "PECO-relevant" (e.g., mammalian bioassays, epidemiology) or "supplemental" (e.g., in vitro mechanistic studies, toxicokinetic models) [1] [6]. Tracking supplemental NAMs evidence is crucial for understanding mechanistic pathways and supporting weight-of-evidence determinations [4] [1].

Experimental Protocols for PECO-Relevant Studies

For primary studies to be included under a PECO, they must meet minimum design standards. The following protocols outline the core methodologies for generating key streams of PECO-relevant evidence.

Table 3: Protocol for a Standard Subchronic Rodent Toxicity Bioassay

Protocol Component	Detailed Specifications	Purpose & Rationale
Test System (P)	Young adult rats (e.g., Sprague-Dawley), 10-12 per sex per group.	A standardized mammalian model for extrapolation to human health risk.
Exposure Regimen (E)	Test Article: High-purity chemical. Route: Oral gavage (or diet). Doses: At least 3 dose levels + vehicle control (C). Duration: 90 days.	Mimics sustained human environmental exposure. Multiple doses establish dose-response.
Comparator (C)	Concurrent control group receiving vehicle only (e.g., corn oil, water) via identical method and volume.	Isolates the effect of the test chemical from procedure or vehicle effects.
Outcome Measures (O)	In-life: Clinical signs, body weight, food consumption. Hematology & Clinical Chemistry. Terminal: Organ weights, gross necropsy, histopathology of all major tissues.	Captures a broad range of systemic toxicological outcomes for hazard identification.
Data Analysis	Comparison of dose groups to control using ANOVA followed by Dunnett's test. Statistical significance (p<0.05) indicates a treatment-related effect.	Provides objective, quantitative criteria for determining adverse outcomes.

Protocol for High-Throughput Transcriptomics (NAM) to Inform Mechanism

• Objective: To identify pathway-level perturbations following chemical exposure for mechanistic hazard characterization [4].
• Test System (P): Human primary hepatocytes or established cell line (e.g., HepG2) cultured in 96-well plates.
• Exposure (E): Cells exposed to a log-spaced concentration range (e.g., 8 concentrations) of test chemical for 24 hours. Each concentration has 4-6 replicates. A vehicle control (DMSO <0.5%) is included.
• Comparator (C): Pooled RNA from all vehicle-control wells serves as the reference comparator for gene expression analysis.
• Outcome (O): Genome-wide mRNA expression is measured via RNA-sequencing. The primary outcome is a set of differentially expressed genes (DEGs) at each concentration (fold-change > |2|, adjusted p-value < 0.05).
• Analysis: DEGs are analyzed using pathway enrichment tools (e.g., Ingenuity Pathway Analysis, GO enrichment) to identify activated toxicity pathways (e.g., oxidative stress, xenobiotic metabolism).

Protocol for an Epidemiological Cohort Study

• Objective: To investigate associations between environmental exposure and health outcomes in a human population [3].
• Population (P): A defined cohort (e.g., residents of a specific area, workers in an industry). Susceptible subpopulations (e.g., children) should be considered [4].
• Exposure Assessment (E): Exposure is estimated via environmental monitoring data, biomonitoring (e.g., chemical levels in blood/serum), or detailed exposure questionnaires [3].
• Comparator (C): The reference group consists of cohort members with the lowest exposure (e.g., bottom quartile of exposure distribution or levels below detection limits).
• Outcome Measurement (O): Health outcomes are ascertained via medical records, registries (e.g., cancer), clinical examinations, or validated questionnaires. The analysis calculates effect estimates (e.g., hazard ratios) comparing disease incidence in higher exposure groups to the reference group.

The Scientist's Toolkit: Research Reagent Solutions

Table 4: Essential Materials and Tools for PECO-Driven Ecotoxicity Research

Item / Tool	Function in PECO Context	Example & Notes
EPA CompTox Chemicals Dashboard	Provides curated physicochemical, toxicological, and exposure data to inform the Exposure (E) component and assessment scoping [1].	Used to identify relevant chemical forms, structures, and prior data during problem formulation.
Systematic Review Software (e.g., HAWC, DistillerSR)	Manages the PECO-driven workflow: literature screening, tagging PECO-relevant studies, data extraction, and creating evidence inventories [5] [8].	HAWC (Health Assessment Workspace Collaborative) is specifically used by EPA IRIS to create interactive evidence tables and maps [5].
Defined Test Media & Vehicle Controls	Essential for establishing a valid Comparator (C) in in vitro and in vivo studies. The vehicle must not induce effects itself.	Examples: Cell culture media with defined serum; corn oil or methyl cellulose for rodent gavage.
Reference Chemicals (Positive/Negative Controls)	Used to validate experimental Outcome (O) measurements and ensure test system responsiveness.	Included in each experimental run to demonstrate assay reliability and minimize risk of bias [4].
Biomarker Assay Kits	Tools to quantify specific Outcome (O) measures, such as oxidative stress markers (e.g., glutathione, MDA), cytokine levels, or enzymatic activity.	Provide standardized, reproducible endpoints for mechanistic or apical outcome assessment.
Pathway Analysis Software	Interprets high-dimensional Outcome (O) data (e.g., transcriptomics) from NAMs to identify perturbed biological pathways for mechanistic insight [4].	Examples: Ingenuity Pathway Analysis (IPA), Cytoscape with relevant plugin suites.

The Critical Role of a Well-Framed PECO Statement in Systematic Review Design and Transparency

A well-framed research question is the indispensable foundation of any rigorous systematic review (SR). In the field of ecotoxicology and environmental health, where questions often concern the association between an exposure and an outcome rather than a deliberate intervention, the PECO framework (Population, Exposure, Comparator, Outcome) has emerged as the critical structuring tool [9]. This framework defines the review's objectives and directly informs its design, including the study eligibility criteria, the search strategy, and the interpretation of findings [9]. A precisely articulated PECO statement enhances methodological transparency, reduces bias, and ensures that the review's conclusions are directly relevant to the original, pre-specified question.

Despite its recognized importance, specific guidance for operationalizing the PECO framework, particularly for addressing the unique challenges of defining exposures and comparators in observational research, has been limited [9]. This application note provides detailed protocols and conceptual frameworks for developing and applying PECO statements within the context of ecotoxicity systematic reviews, aiming to standardize practice and improve the quality and utility of evidence synthesis in this field.

Foundational Concepts and PECO Formulation Guidance

The PECO framework is an adaptation of the more widely known PICO (Population, Intervention, Comparator, Outcome) framework, tailored for questions about exposures [9]. Leading evidence synthesis organizations, including the Collaboration for Environmental Evidence, the Navigation Guide, and the U.S. Environmental Protection Agency’s IRIS Program, endorse the use of PECO to guide systematic reviews of environmental exposures [9].

Formulating a PECO question is not a one-size-fits-all process. The approach depends heavily on the research context and the existing state of knowledge about the exposure-outcome relationship [9]. The following table outlines five paradigmatic scenarios for PECO formulation, each serving a different research or decision-making need [9].

Table 1: Framework for PECO Formulation Scenarios in Exposure Science [9]

Systematic-Review Context	Approach	PECO Example (Hearing Impairment)
1. Calculate health effect from exposure	Explore the shape/distribution of the exposure-outcome relationship.	Among newborns, what is the incremental effect of a 10 dB increase in gestational noise exposure on postnatal hearing impairment?
2. Evaluate effect of an exposure cut-off (data-derived)	Use cut-offs (e.g., tertiles, quartiles) defined from the distribution in identified studies.	Among newborns, what is the effect of the highest dB exposure tertile during pregnancy versus the lowest tertile on postnatal hearing impairment?
3. Evaluate association with known external cut-offs	Use mean cut-offs or thresholds identified from other populations or research.	Among commercial pilots, what is the effect of occupational noise exposure vs. noise exposure in other occupations on hearing impairment?
4. Identify exposure cut-off that ameliorates health effects	Use existing exposure cut-offs associated with known health outcomes.	Among industrial workers, what is the effect of exposure to <80 dB (a safety threshold) compared to ≥80 dB on hearing impairment?
5. Evaluate effect of an achievable intervention cut-off	Select comparator based on exposure cut-offs achievable through an intervention.	Among the general population, what is the effect of an intervention reducing noise levels by 20 dB versus no intervention on hearing impairment?

Scenario 1 is often the starting point when little is known about an association, aiming to establish if a relationship exists and characterize its shape (e.g., linear, logarithmic). Scenarios 2-5 become applicable once basic association is established and require prior research to quantify the exposure and define meaningful cut-offs or thresholds [9].

For ecotoxicity reviews, the PECO components require careful consideration:

• Population (P): The animal species, strain, life stage, and/or ecological receptor under study.
• Exposure (E): The chemical, physical, or biological agent, including its dose, duration, route, and timing.
• Comparator (C): The alternative against which the exposure is compared (e.g., a lower dose, a control group, a different agent, or background exposure). Defining an appropriate comparator is one of the most significant challenges in exposure science [9].
• Outcome (O): The measured health or ecological endpoint(s) of interest (e.g., mortality, reproduction, growth, biochemical marker).

Integrating PECO into the Systematic Review Workflow: A 10-Step Protocol

A high-quality systematic review is a methodical, multi-stage process. The PECO statement is not developed in isolation; it is the central pillar that informs and is refined by subsequent steps. The following protocol integrates PECO development into a standardized 10-step SR workflow [10] [11].

Application Protocol: Systematic Review Conduct with PECO Integration

Step 1: Structure the Topic and Define the PECO

• Action: Formulate the primary research question using the PECO framework. For greater specificity, use the PICOTS extension, which adds Timeframe and Study Design [10].
• Protocol Detail: Explicitly define each component. For the Population, specify species and relevant characteristics. For Exposure, define the agent, matrix, and metrics. For Comparator, justify the chosen alternative. For Outcomes, distinguish between primary and secondary endpoints. Validate the novelty of the question through a preliminary literature scan [10].
• Output: A finalized, written PECO/PICOTS statement.

Table 2: The PICOTS Framework for Question Formulation [10]

Component	Meaning	Ecotoxicity Example
Population	The subjects (e.g., species, ecosystem) of interest.	Daphnia magna, neonates (<24h old).
Intervention/Exposure	The agent or condition studied.	Exposure to glyphosate-based herbicide in water.
Comparator	The alternative against which exposure is compared.	Vehicle control (water) or exposure to a reference toxicant.
Outcome	The measured effect or endpoint.	48-hour immobilization (mortality).
Time	The relevant timeframe for the outcome.	48-hour exposure period.
Study Design	The type of primary study design sought.	Laboratory toxicity tests following OECD guideline 202.

Step 2: Assemble the Team and Plan Resources

• Action: Assemble a team with content expertise (ecotoxicology), methodological expertise (SR conduct), and information specialist support [11].
• Protocol Detail: Define roles for protocol writing, literature searching, screening, data extraction, and quality assessment. Plan for dual, independent work at key stages to minimize error and bias [11].

Step 3: Develop & Register the Review Protocol

• Action: Document the planned methods in a protocol and register it prospectively in a registry like PROSPERO [11].
• Protocol Detail: The protocol must include the PECO statement, eligibility criteria, search strategy, data extraction plan, risk-of-bias assessment method, and data synthesis approach. Registration commits the team to a plan, reduces duplication, and guards against outcome reporting bias [11].

Step 4: Design & Execute the Search Strategy

• Action: Develop a comprehensive, reproducible search strategy to identify all relevant evidence.
• Protocol Detail: With an information specialist, translate the PECO components into search terms and Boolean logic. Search multiple databases (e.g., Web of Science, Scopus, PubMed, Environment Complete). Search strategies must be documented in full [10].
• Output: A merged library of retrieved citations.

Table 3: Key Bibliographic Databases for Ecotoxicity Reviews

Database	Principal Characteristics & Relevance
Web of Science Core Collection	Multidisciplinary; strong coverage of environmental sciences and toxicology journals. Essential for comprehensive searching.
Scopus	Large abstract and citation database; good complementary coverage to Web of Science.
PubMed/MEDLINE	Life sciences and biomedicine; crucial for reviews with human health or mammalian toxicology endpoints.
Environment Complete	Focus on environmental science, policy, and ecology. Covers specialized journals.
TOXLINE	Specialized toxicology literature, including technical reports.

Step 5: Screen Titles, Abstracts, and Full Texts

• Action: Apply the pre-defined eligibility criteria (derived directly from PECO) to select studies.
• Protocol Detail: Use systematic review software (e.g., Rayyan, Covidence) for blinding and collaboration. Two reviewers screen independently, resolving conflicts through discussion or a third reviewer [10].
• Output: The final list of included studies.

Step 6: Extract Data from Included Studies

• Action: Systematically extract relevant data from each study into a pre-piloted form.
• Protocol Detail: Extract data on PECO elements (population details, exposure parameters, comparator, outcome results), study design, and key findings. Perform extraction in duplicate to ensure accuracy [11].

Step 7: Assess the Risk of Bias (Quality Appraisal)

• Action: Critically appraise the internal validity of each included study.
• Protocol Detail: Use a tool appropriate to the study design (e.g., SYRCLE's RoB tool for animal studies, ROBINS-I for observational studies). Assessment focuses on domains like selection bias, performance bias, detection bias, and reporting bias [11].

Step 8: Synthesize the Evidence

• Action: Collate and summarize the findings.
• Protocol Detail: If studies are sufficiently homogeneous, perform a meta-analysis to generate a quantitative summary effect estimate. If not, provide a structured narrative synthesis, tabulating results and describing patterns aligned with the PECO framework [11].

Step 9: Assess the Certainty of the Evidence

• Action: Grade the overall confidence in the body of evidence for each critical outcome.
• Protocol Detail: Use the GRADE (Grading of Recommendations Assessment, Development, and Evaluation) approach. Rate evidence from observational studies (common in ecotoxicity) as starting at "low certainty" and adjust based on risk of bias, inconsistency, indirectness, imprecision, and other factors [11].

Step 10: Report and Disseminate Findings

• Action: Write the final review manuscript following reporting guidelines.
• Protocol Detail: Adhere to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement. The report must clearly link all methods and results back to the initial PECO question [11].

Diagram 1: Systematic Review Workflow with Integrated PECO Development. This workflow illustrates the central, guiding role of the PECO statement (Step 1) in informing all subsequent methodological steps of a systematic review, from protocol development to final reporting [10] [11].

The Scientist's Toolkit: Reagents and Materials for PECO Implementation

Table 4: Research Reagent Solutions for PECO-Driven Systematic Reviews

Tool / Resource	Function in PECO/SR Process	Key Features & Notes
PECO Framework [9]	Question Formulation: Structures the research question into discrete, searchable components (Population, Exposure, Comparator, Outcome).	Essential for exposure-focused reviews. The "C" (Comparator) requires careful operationalization, often as a cut-off value or alternative exposure level [9].
PICOTS Template [10]	Question Refinement: Extends PECO by adding Timeframe and Study Design, providing greater specificity for protocol development.	Ensures the review question explicitly addresses when outcomes are measured and what types of primary studies are eligible.
PROSPERO Registry [11]	Protocol Registration & Transparency: International prospective register for systematic review protocols. Registration is mandatory for many journals.	Reduces duplication of effort, promotes transparency, and helps guard against selective reporting bias by committing to a plan before starting the review.
Rayyan / Covidence Software	Screening & Selection: Web-based tools designed to facilitate the dual, independent screening of titles/abstracts and full-text articles.	Manages the screening workflow, keeps reviewers blinded to each other's decisions, and aids in conflict resolution. Increases efficiency and reproducibility.
SYRCLE's RoB Tool	Quality Appraisal: Risk of Bias tool tailored for animal intervention studies. Critical for assessing internal validity in ecotoxicology reviews.	Assesses domains like sequence generation, baseline characteristics, blinding, random outcome assessment, and incomplete outcome data.
GRADE Approach [11]	Evidence Grading: Systematic framework for rating the certainty (quality) of a body of evidence (e.g., high, moderate, low, very low).	Critical final step. Transparently communicates to decision-makers how much confidence to place in the summary effect estimates. Observational evidence starts as "low certainty."

Visualizing Logical Relationships: From PECO to Review Outcomes

A well-constructed PECO statement creates a logical chain that drives the entire review process. The following diagram maps how each PECO component directly informs specific, concrete actions in the review methodology, ultimately leading to a coherent synthesis.

Diagram 2: The Logical Pathway from PECO Components to Review Methodology. This diagram demonstrates the operationalization of a PECO statement, showing how each conceptual component directly generates specific, actionable methodological elements that converge to produce the final systematic review output.

Key Differences Between PECO for Environmental Exposures and PICO for Clinical Interventions

The PICO (Population, Intervention, Comparison, Outcome) and PECO (Population, Exposure, Comparator, Outcome) frameworks are foundational for structuring research questions in evidence synthesis. Their core distinction lies in their conceptual focus: PICO is designed for evaluating the effects of intentional interventions (e.g., a drug or therapy), while PECO is adapted for investigating the health effects of environmental or occupational exposures (e.g., chemicals, noise, air pollution) [9] [12] [2]. This difference fundamentally shapes their application, optimal study designs, and the nature of the "comparator" element. PICO is the standard in clinical medicine and systematic reviews of interventions, often leading to randomized controlled trials (RCTs) [13] [14] [15]. In contrast, PECO is essential for fields like environmental health, ecotoxicology, and occupational safety, where RCTs are often unethical or impractical, and evidence is primarily derived from observational studies (e.g., cohort, case-control) [9] [12] [16]. Within a thesis on PECO development for ecotoxicity reviews, understanding this distinction is critical for formulating precise, answerable questions that appropriately reflect the challenges of exposure science, such as defining relevant exposure gradients and comparison groups in real-world settings [9] [16].

Comparative Analysis of PICO and PECO Frameworks

Table 1: Conceptual and Methodological Comparison of PICO and PECO Frameworks

Aspect	PICO Framework (Clinical Interventions)	PECO Framework (Environmental Exposures)
Primary Focus & Philosophy	Evaluates the efficacy, effectiveness, or safety of a deliberate action (intervention) intended to improve health or treat a condition [13] [14] [2].	Investigates the association between a health outcome and an environmental, occupational, or unintentional exposure, often for hazard identification and risk characterization [9] [12] [2].
Typical Study Designs	Randomized Controlled Trials (RCTs) are the gold standard. Other controlled clinical trials and experimental studies [14] [17] [15].	Observational studies: Cohort, case-control, cross-sectional. Human biomonitoring and ecological studies. Animal toxicological studies [9] [12].
Nature of "I" vs. "E"	Intervention: A planned, administered agent (drug, surgery, behavioral therapy). It is controlled and defined by the researcher [14] [2].	Exposure: An external factor individuals encounter in their environment (chemical, physical agent, behavior). It is measured, not assigned [9] [2].
Nature of Comparator (C)	Often a placebo, standard care, or an alternative active intervention. The comparison is clear and defined within the study protocol [14] [2] [18].	Can be another exposure level (e.g., low vs. high), an unexposed group, or a different exposure source. Defining a relevant comparator is a major challenge and may be based on thresholds, percentiles, or background levels [9].
Key Methodological Challenge	Ensuring internal validity (blinding, randomization) to minimize bias in estimating the intervention's effect [13].	Measuring exposure accurately and defining a meaningful comparator to establish a causal association while controlling for confounding [9] [16].
Example Research Question	"In adults with hypertension (P), does drug A (I) compared to drug B (C) reduce the risk of stroke (O)?" [14] [15]	"Among factory workers (P), does long-term exposure to airborne particulate matter (E) compared to low-exposure office workers (C) increase the risk of chronic bronchitis (O)?" [12]

Detailed Application Notes and Protocols for PECO in Ecotoxicity Systematic Reviews

For a thesis focused on PECO development, moving beyond the basic definition to operationalize the framework is crucial. The following scenarios and protocols address specific challenges in ecotoxicity research.

Protocol 1: Defining the Dose-Response Relationship (PECO Scenario 1)

• Objective: To quantify the shape and magnitude of the association between an environmental exposure and a health outcome across a continuum of exposure levels [9].
• Context: Used when little is known about the nature of the relationship, serving as the foundational assessment for risk characterization [9].
• PECO Elaboration:
  • Population: Precisely define the human or model organism population (species, strain, age, susceptibility).
  • Exposure: Specify the chemical/stressor, its matrix (e.g., water, soil), route of exposure (oral, dermal, inhalation), and duration. The exposure is treated as a continuous variable.
  • Comparator: Defined as an incremental increase in exposure (e.g., per 1 mg/L increase in concentration). The comparison is across the entire observed range of exposures [9].
  • Outcome: Define the specific ecotoxicological or health endpoint (e.g., mortality, reproductive output, histopathological change) and the measure (e.g., LC50, NOAEL, odds ratio).
• Search Strategy Protocol:
  • Concept Development: Break down each PECO element into core concepts and synonyms.
  • Vocabulary: Identify relevant controlled terms (e.g., MeSH for PubMed: "Water Pollutants, Chemical," "Dose-Response Relationship, Drug").
  • Search Structure: Construct blocks for Population, Exposure, and Outcome. Avoid restricting by study design initially to capture all relevant observational and experimental data [9].
  • Database Selection: Search environmental science databases (e.g., TOXLINE, Web of Science core collection, PubMed, Scopus) alongside ecology-specific databases.
• Data Extraction & Analysis Plan:
  • Extract quantitative data on exposure levels (mean, range, units), outcome measures, effect sizes, and study characteristics.
  • Plan for dose-response meta-analysis or graphical synthesis to explore linear, threshold, or other relationship shapes [9].

Protocol 2: Evaluating Health Effects Against a Regulatory or Biologically Relevant Cut-off (PECO Scenarios 4 & 5)

• Objective: To assess the health impact of exposure above a specific threshold compared to exposure below that threshold [9].
• Context: Informs standard setting, risk management, and evaluation of mitigation strategies. The cut-off may be a regulatory limit (e.g., EPA Maximum Contaminant Level), a toxicity benchmark (e.g., PNEC - Predicted No-Effect Concentration), or an exposure level achievable through intervention [9].
• PECO Elaboration:
  • Population: As defined in Protocol 1.
  • Exposure: Exposure above the defined cut-off value.
  • Comparator: Exposure below the defined cut-off value (which may be "no" or "background" exposure).
  • Outcome: As defined in Protocol 1.
• Search Strategy Protocol:
  • Follow steps 1-3 from Protocol 1.
  • Refinement: After the initial broad search, introduce search terms related to the specific cut-off or standard (e.g., "maximum contaminant level," "threshold limit value," "water quality criteria") to identify literature that directly addresses regulatory or benchmarked exposures.
• Data Extraction & Analysis Plan:
  • Extract data to calculate a binary effect measure (e.g., Risk Ratio, Odds Ratio) for the "high vs. low" exposure comparison.
  • Clearly document the source and justification for the selected cut-off value in the review.

Protocol 3: Systematic Review Workflow for PECO-Based Ecotoxicity Questions

This protocol outlines the end-to-end process from question formulation to evidence synthesis.

Table 2: Systematic Review Workflow Protocol for PECO Questions

Stage	Key Actions	Tools & Documentation
1. Question Formulation & Scoping	Define the PECO according to the relevant scenario. Conduct preliminary searches to map the evidence. Develop a pre-registered review protocol.	PECO worksheet; Protocol registration (PROSPERO, OSF); Scoping review notes.
2. Search Strategy Development	Develop comprehensive, reproducible search strings for multiple databases. Include gray literature sources (theses, reports from agencies like EPA, EFSA).	Search strategy documentation with all terms and filters; Use of PRISMA-S checklist [15].
3. Study Selection & Screening	Use the PECO as inclusion/exclusion criteria. Perform dual, independent screening at title/abstract and full-text levels.	Reference management software (e.g., Covidence [13], Rayyan); PRISMA flow diagram [15].
4. Critical Appraisal & Data Extraction	Assess risk of bias/study quality using tools tailored to observational/exposure studies (e.g., OHAT, NAS, ROBINS-E). Design and pilot a data extraction form aligned with PECO.	Risk of bias tools; Customized data extraction forms in Excel or systematic review software.
5. Evidence Synthesis & Grading	Synthesize data narratively and, if appropriate, meta-analytically. Grade the overall certainty (confidence) of the evidence using adapted frameworks (e.g., GRADE for exposures [16]).	Statistical software (R, Stata); GRADE evidence profile tables [16].

Visualization of Frameworks and Workflows

Diagram 1: Decision Framework for PICO vs. PECO Selection

Short Title: Framework Selection: PICO vs. PECO

Diagram 2: Methodological Workflow for PECO Statement Development

Short Title: PECO Development Workflow

The Scientist's Toolkit: Essential Materials for Ecotoxicity Systematic Reviews

Table 3: Research Reagent Solutions for PECO-Based Systematic Reviews

Tool / Resource Category	Specific Item / Platform	Function in PECO Review Process
Protocol Registration & Management	PROSPERO, Open Science Framework (OSF), Covidence [13]	Pre-registers review questions and methods to reduce bias; platforms for managing screening and data extraction workflows.
Bibliographic & Systematic Review Software	EndNote, Zotero, Rayyan, DistillerSR	Manages references, facilitates de-duplication and blinded screening of studies by multiple reviewers.
Specialized Search Databases	PubMed/MEDLINE, TOXLINE, Web of Science, Scopus, GreenFile, ECOTOX (EPA)	Provides comprehensive coverage of biomedical, toxicological, and environmental science literature critical for exposure and ecology questions.
Risk of Bias / Quality Appraisal Tools	Risk Of Bias In Non-randomized Studies - of Exposures (ROBINS-E), Office of Health Assessment and Translation (OHAT) Tool, Navigation Guide [9]	Assesses methodological quality and risk of bias in non-randomized (observational and animal) studies, which form the core evidence for PECO reviews.
Data Extraction & Synthesis Tools	Custom-designed extraction forms (Excel, Google Sheets), RevMan (Cochrane), R packages (metafor, robvis)	Standardizes the collection of PECO-specific data (exposure metrics, outcome measures) from included studies and enables statistical meta-analysis.
Evidence Grading Frameworks	GRADE for exposures [16], Navigation Guide approach [9]	Provides a structured, transparent system to rate the overall certainty (confidence) in the body of evidence for each PECO outcome.
Reporting Guidelines	PRISMA (Preferred Reporting Items for Systematic Reviews) [15], PRISMA-S (for searches)	Ensures complete and transparent reporting of the review process, from search strategy to synthesis.

Connecting PECO to Problem Formulation and Scoping in the Assessment Workflow

In the domain of ecotoxicity systematic reviews, the initial phases of problem formulation and scoping determine the scientific rigor, relevance, and efficiency of the entire assessment. These steps establish the purpose, boundaries, and methodology for the review [19]. Central to this process is the development of a precise PECO statement (Population, Exposure, Comparator, Outcome), which operationalizes the research question into a structured framework that guides all subsequent activities [9]. A well-constructed PECO statement defines the objectives of the review, informs study design and inclusion criteria, and facilitates the interpretation of findings [9]. For researchers and drug development professionals, mastering the integration of PECO within the broader assessment workflow is critical for producing transparent, defensible, and decision-relevant syntheses of evidence on chemical hazards.

Conceptual Framework: Integration of PECO, Scoping, and Problem Formulation

The workflow for initiating a systematic review is a logical sequence where scoping informs problem formulation, which is crystallized into a PECO statement. This structured approach ensures the review is focused, feasible, and aligned with its decision-making context.

Scoping is an exploratory exercise to survey the extant literature and other pertinent information (e.g., reviews by authoritative bodies) to determine the extent, range, and nature of available data [19]. It identifies knowledge gaps and helps determine the level of scientific rigor required. A key output is an evidence table or map, which provides a descriptive or visual summary of data availability, highlighting data-rich subjects and critical gaps [19].

Problem formulation is the process of defining the problem's scope, formulating specific questions, and planning the assessment methods [19]. It translates the broad insights from scoping into actionable plans. Critical elements include specifying the chemical agent, exposure routes, health endpoints, and the types of evidence (human, animal, mechanistic) to be considered [19].

The PECO statement is the definitive product of problem formulation. It explicitly frames the review question into four components, creating clear eligibility criteria for the systematic review [9] [19]. This prevents ambiguity during study screening and data extraction. The PECO framework is particularly vital in environmental health, where defining the Exposure and Comparator is more complex than in clinical intervention reviews [9].

Application Notes: Developing and Applying the PECO Statement

Operationalizing the PECO Framework

The utility of a PECO statement depends on the precision and thoughtfulness applied to each component, especially the Exposure (E) and Comparator (C), which pose unique challenges in ecotoxicology.

• Population (P): This defines the subject of interest. In ecotoxicity reviews, this can range from specific animal models (e.g., Sprague-Dawley rats, zebrafish embryos) to broader ecological populations (e.g., freshwater invertebrates). The population should be specified with relevant characteristics (species, life stage, health status) [9].
• Exposure (E): This details the chemical agent, its form, route (oral, inhalation, dermal), duration (acute, subchronic, chronic), and dose or concentration. Quantifying exposure is foundational [9].
• Comparator (C): This is a critical and often challenging element. The comparator may be a true negative control (no exposure), a background exposure level, or an alternative exposure level (e.g., a lower dose or a different chemical). The choice of comparator dictates the interpretation of the effect [9].
• Outcome (O): These are the measured health effects or endpoints. Outcomes should be biologically relevant and measurable, such as mortality, reproductive success, organ weight changes, histopathology, or specific molecular biomarkers. A common pitfall is defining outcomes too broadly (e.g., "all adverse effects"), which makes the review unmanageable [19].

PECO Scenarios for Different Review Contexts

The research question's context dictates how the PECO is structured. The framework can be applied across different phases of evidence synthesis, from exploratory hazard identification to quantitative risk characterization [9].

Table 1: PECO Scenarios and Their Applications in Ecotoxicology Systematic Reviews [9]

Scenario	Review Context & Objective	PECO Approach	Example for a Chemical Toxicant
1. Explore Association	Initial investigation of whether an exposure is linked to an outcome; describes the dose-effect relationship.	Explore the shape of the exposure-outcome relationship across the available range. C is an incremental increase in exposure.	P: Laboratory rodents; E: Oral exposure to chemical X; C: Incremental increase of 5 mg/kg/day; O: Liver-to-body weight ratio increase.
2. Evaluate Internal Cut-offs	Compare effects of high vs. low exposure levels when no external standard exists.	Define C based on distributional cut-offs (e.g., tertiles, quartiles) from the studies identified.	P: Fathead minnows; E: Aquatic concentration of chemical X; C: Highest quartile of exposure vs. lowest quartile; O: Incidence of spinal deformity.
3. Apply External Cut-offs	Evaluate a specific exposure level against a known or hypothesized safety benchmark.	Use C derived from other populations, regulations, or previous risk assessments.	P: Adult zebrafish; E: Concentration of chemical X at 50% of the LC₅₀; C: Exposure at 10% of the LC₅₀; O: Changes in swimming behavior.
4. Define a Protective Cut-off	Identify an exposure level that ameliorates adverse health effects.	Use C as an existing exposure limit or threshold associated with no observed adverse effect.	P: Daphnia magna; E: Concentration of chemical X ≥ 1.0 mg/L; C: Concentration < 0.1 mg/L (NOAEL); O: Inhibition of reproduction (< 20% of control).
5. Assess an Intervention	Evaluate the potential effect of a risk mitigation strategy.	Frame E as the implementation of an intervention (e.g., treatment, remediation).	P: Benthic macroinvertebrates in a model ecosystem; E: Sediment remediation technique A; C: No remediation (background contamination); O: Taxonomic richness and abundance.

A well-formulated PECO must remain distinct from methodological considerations. A common error is embedding aspects of study evaluation (e.g., "high-quality studies") within the PECO statement, which should solely define the question and relevance criteria [19].

Experimental Protocols for Key Workflow Phases

Protocol for Conducting a Scoping Exercise

Objective: To systematically map the available evidence on a specified chemical or toxicological endpoint to inform problem formulation.

• Engage an Information Specialist: Collaborate with a research librarian or information specialist to design a comprehensive, broad search strategy [19].
• Search Authoritative Sources: Identify and retrieve existing high-quality assessments from bodies like the U.S. EPA Integrated Risk Information System (IRIS), the European Chemicals Agency (ECHA), or the National Toxicology Program (NTP) [19].
• Execute Broad Literature Searches: Conduct searches in multiple databases (e.g., PubMed, Web of Science, Scopus, TOXLINE) using broad chemical and toxicological terms. Limit by date if updating a prior review [19].
• Develop an Evidence Table/Map: Screen titles and abstracts from the search. Create a structured table or visual map cataloging the identified studies by key characteristics:
  • Study type (in vivo, in vitro, epidemiological)
  • Population/Species
  • Exposure route and duration
  • Reported health outcomes
  • General study quality indicators
• Identify Evidence Gaps and Clusters: Analyze the evidence table to identify outcomes with sufficient data for synthesis and areas with limited or no data [19].
• Solicit Stakeholder Input: Where relevant, gather input from toxicologists, industrial hygienists, or other experts on populations of concern and endpoints of interest [19].

Protocol for Systematic Review Problem Formulation & PECO Development

Objective: To define the specific review question, scope, and methodology based on scoping results.

• Convene Expert Team: Assemble a team with expertise in toxicology, systematic review methodology, statistics, and the relevant subject matter.
• Review Scoping Outputs: Analyze the evidence map to select outcomes for review. Use expert judgment to prioritize outcomes that are biologically plausible, significant to population health, and likely to occur at relevant exposure levels [19].
• Draft Specific Review Questions: Formulate focused questions. Avoid overly broad questions (e.g., "What are the effects of chemical X?") which retrieve unmanageably heterogeneous data [19].
  • Example: "Does prenatal exposure to chemical X in mammalian models result in skeletal malformations?"
• Develop the PECO Statement: For each review question, define the four components with precision.
  • Guidance: Refer to the scenarios in Table 1. Ensure the C is meaningful and clearly different from E. Define O with operational specificity.
• Document Methodological Plans: Pre-specify in a protocol:
  • The role of different evidence streams (how human, animal, and mechanistic data will be integrated) [19].
  • Methods for assessing individual study quality or risk of bias (avoid using numeric scores as exclusion criteria) [20].
  • Plans for assessing funding bias or conflict of interest for individual studies [20].
  • Approach for data synthesis (narrative, meta-analysis).
• Peer-Review and Publish Protocol: Submit the finalized protocol for peer review and publish it in a registry (e.g., PROSPERO) or journal to ensure transparency and reduce bias [20].

The Scientist's Toolkit: Essential Reagents and Materials

Table 2: Key Research Reagent Solutions for Ecotoxicity Assessment

Item / Solution	Function in Assessment Workflow	Application Notes
Authoritative Toxicological Databases (e.g., EPA IRIS, NTP Reports, ECHA Dossiers)	Provide curated, peer-reviewed assessments for scoping; establish baseline toxicity data and potential comparator values [19].	Critical for initial scoping to avoid duplicating work and to identify established health effect levels.
Reference Management Software (e.g., EndNote, Zotero, Covidence)	Manages bibliographic data during scoping and review; facilitates de-duplication and collaborative screening.	Essential for handling large volumes of citations from broad literature searches.
Systematic Review Management Platforms (e.g., Rayyan, DistillerSR)	Supports the entire systematic review process: screening studies against PECO criteria, data extraction, and quality assessment.	Improves reproducibility, transparency, and efficiency of the review team's work.
Risk of Bias (RoB) Assessment Tools (e.g., SYRCLE's RoB tool for animal studies, OHAT RoB tool)	Provides structured, domain-based frameworks to evaluate methodological strengths and limitations of individual studies.	Should be used to inform evidence weighting, not as a simple scoring system for study exclusion [20].
Evidence Integration Software (e.g., GRADEpro, EGM)	Supports the transparent synthesis of findings across studies and assessment of the overall certainty or strength of evidence.	Helps translate review findings into clear conclusions for decision-makers.
Chemical-Specific Analytical Standards	Provides pure, quantified samples of the chemical under review for verifying exposure concentrations in experimental studies.	Crucial for evaluating and comparing exposure quantification across studies during data extraction.

Analysis of Common Pitfalls and Best Practices

The integration of PECO into the assessment workflow is often undermined by recurring methodological flaws. A prominent case analysis involves the U.S. Environmental Protection Agency's (EPA) methodology under the Toxic Substances Control Act (TSCA) [20]. A 2022 review identified critical shortcomings: the use of generic, non-chemical-specific protocols instead of pre-published, assessment-specific protocols; and PECO statements that inappropriately excluded studies showing early biological changes (e.g., altered hormone levels) by defining outcomes too narrowly [20]. Furthermore, the method used quantitative scoring for study quality as an exclusion criterion, contravening best practices which advise using quality assessment to inform evidence weighting, not study eligibility [20].

The diagram below illustrates the impact of a flawed versus a robust PECO-driven workflow on the final evidence base and review conclusion.

Best practices to avoid these pitfalls include:

• Develop Chemical-Specific Protocols: A generic method document is insufficient. Each assessment must have its own peer-reviewed protocol detailing the PECO and methods [20].
• Use Inclusive PECO Statements for Hazards: For hazard identification, PECO statements should be designed to capture all possible health outcomes, including early biological changes, to avoid missing signals of toxicity [20].
• Separate Eligibility from Quality Assessment: The PECO statement defines study relevance. Methodological quality should be assessed separately and used to gauge confidence in findings, not to exclude studies from the review [19] [20].
• Account for Funding Bias: Systematically document funding sources and author conflicts of interest for all included studies and consider their potential influence when interpreting evidence [20].

From Theory to Protocol: A Practical Guide to Crafting Your PECO Statement

Scoping the Systematic Review

The scoping phase establishes the boundaries, objectives, and feasibility of an ecotoxicity systematic review. This initial planning stage is critical for preventing bias, ensuring transparency, and aligning the review with evidence-based synthesis principles [21].

Core Objectives of Scoping

The primary goals are to:

• Define the research need: Identify the knowledge gap the review will address within regulatory or research contexts (e.g., hazard identification for a chemical class, validation of a New Approach Methodology (NAM)) [22] [23].
• Explore the evidence landscape: Conduct a preliminary survey to gauge the volume, type, and distribution of available literature across multiple evidence streams (in vivo, in vitro, in silico, epidemiological) [24] [5].
• Formulate the initial problem: Develop a draft structured question using the PECO framework to guide subsequent protocol development [9] [5].
• Assess resources and timeline: Determine the practical feasibility of the full systematic review based on the anticipated scope [21].

Key Scoping Activities & Methodological Standards

Scoping employs systematic methods to map the available evidence. The U.S. EPA’s IRIS program, for instance, uses Systematic Evidence Maps (SEMs) as a foundational scoping tool [5].

Table 1: Methodological Standards for Scoping and Preliminary Evidence Mapping

Activity	Description	Best Practice Standard / Tool	Key Outcome
Stakeholder Engagement	Identifying and consulting subject matter experts, risk assessors, and regulators.	EPA IRIS Problem Formulation [5].	Refined review objectives and relevance to decision-making.
Exploratory Searching	Broad, iterative searches in scientific databases to estimate evidence volume.	Use of databases like PubMed, Web of Science, and specialized sources (e.g., ECOTOX) [22].	Preliminary search strategy and list of key studies.
Evidence Mapping	Cataloging and categorizing studies based on PECO elements and study design.	Systematic Evidence Map (SEM) or "literature inventory" [5].	Visual or tabular summary of evidence clusters and gaps.
Protocol Planning	Drafting the methods for the full systematic review.	Registration in platforms like PROSPERO; adherence to PRISMA-P [21] [25].	Draft review protocol for stakeholder feedback.

Protocol Note 1.1: Conducting a Systematic Evidence Map

• Define SEM Objectives: Clearly state if the SEM is for scoping, identifying data for a review, or as a public resource [5].
• Develop a Search Strategy: With an information specialist, create a broad, sensitive search string for electronic databases.
• Screen Studies for Mapping: Apply liberal, eligibility criteria (e.g., any study on chemical X and any aquatic species). Title/abstract screening is typically performed by one reviewer with verification by a second.
• Extract and Code Data: Extract core metadata (author, year, chemical, species, endpoint) into a structured database or tool (e.g., HAWC – Health Assessment Workspace Collaborative) [5].
• Visualize the Map: Create charts and tables showing evidence distribution (e.g., number of studies per species group, per toxicity endpoint).

Preliminary Literature Survey

The preliminary survey is a rapid, systematic assessment that informs the depth and focus of the scoping exercise and the subsequent PECO formulation.

Survey Methodology

This is distinct from the exhaustive search in the full review. Its goal is informed estimation, not comprehensiveness [21].

Protocol Note 2.1: Executing a Preliminary Literature Survey

• Targeted Database Search: Execute the draft search strategy from scoping in 2-3 core databases (e.g., PubMed, Scopus, ECOTOX).
• Limited Screening: Screen the first 200-300 results by title/abstract to calibrate inclusion criteria and estimate the rate of relevant studies.
• Full-Text Review of Sample: Obtain and review the full text of 20-30 highly relevant studies.
• Data Extraction Pilot: Pilot-test a simple data extraction form on the sample studies to identify key recurring methodological variables and challenges.
• Analysis and Reporting: Summarize findings regarding:
  • Estimated total volume of relevant evidence.
  • Common study designs (e.g., acute vs. chronic tests, lab vs. field).
  • Recurring methodological strengths and limitations.
  • Preliminary trends in reported outcomes.

Utilizing Curated Ecotoxicity Databases

Leveraging existing curated databases dramatically increases the efficiency and reliability of preliminary surveys in ecotoxicology.

Table 2: Key Research Reagent Solutions for Ecotoxicity Systematic Reviews

Resource	Function in Scoping/Survey	Access / Source
ECOTOX Knowledgebase (EPA) [22]	Provides pre-curated, single-chemical ecotoxicity data from peer-reviewed literature. Essential for estimating data availability for specific chemicals and taxa.	https://cfpub.epa.gov/ecotox/
Health Assessment Workspace Collaborative (HAWC) [5]	An open-source, modular web application used to conduct and document systematic reviews. Supports data extraction, study evaluation, and evidence visualization.	https://hawcproject.org/
Navigation Guide Library [9] [26]	A methodology and repository of systematic reviews on environmental health, providing models for protocol development and evidence integration.	Published literature / Methodology resources.
PRISMA Checklist & Extensions [21] [25]	Reporting guidelines ensuring transparency and completeness. PRISMA protocols for animal studies (in development) are particularly relevant [25].	http://www.prisma-statement.org/

Developing the PECO Statement

The PECO statement (Population, Exposure, Comparator, Outcome) is the structural foundation of an ecotoxicity systematic review question, translating the scoped problem into an actionable, focused query [9].

The PECO Framework in Ecotoxicology

While derived from clinical PICO, PECO is adapted for environmental exposure science. The key distinction is framing the Exposure (E) and Comparator (C) around environmental or experimental dose levels, rather than clinical interventions [9].

PECO Component Definitions:

• Population (P): The ecological receptor(s) of concern (e.g., Daphnia magna, freshwater fish embryos, soil invertebrate communities). Definitions should include relevant life stages and habitat [9].
• Exposure (E): The chemical, physical, or biological agent and its specific regime (e.g., concentration, duration, route of exposure) [9].
• Comparator (C): The alternative exposure scenario for comparison. This is often a lower dose, a control (zero exposure), or an environmentally relevant threshold [9].
• Outcome (O): The measured adverse effect or endpoint (e.g., mortality, reproduction inhibition, growth reduction, biomarker change) [9].

Five Paradigmatic PECO Scenarios

The formulation of the PECO depends heavily on the review's context and the pre-existing knowledge about the exposure-outcome relationship. Morgan et al. (2018) define five common scenarios [9].

Table 3: Framework for PECO Development in Different Review Contexts [9]

Scenario	Review Context & Objective	Approach to Defining 'Exposure' & 'Comparator'	Example PECO Question
1. Exploring Association	Little known about the exposure-outcome relationship. Goal is to describe the dose-effect shape.	Comparator is an incremental increase in exposure (e.g., per 1 mg/L). Analyze the entire exposure range.	In freshwater cladocerans (Daphnia sp.), what is the effect of a 1 mg/L increase in waterborne concentration of chemical X on 48-hour mortality?
2. Comparing Exposure Extremes	Evaluate the effect of high vs. low exposure, using data-driven cut-offs.	Define comparator based on distribution in the identified evidence (e.g., highest vs. lowest quartile of exposure).	In zebrafish (Danio rerio) embryos, what is the effect of exposure to concentrations in the highest quartile measured in effluent, compared to the lowest quartile, on developmental malformations?
3. Applying External Standards	Evaluate against a regulatory or population-based standard.	Use cut-offs from external sources (e.g., occupational limits, background levels in other populations).	In juvenile fathead minnows, what is the effect of exposure to chemical Y at the EPA Ambient Water Quality Criterion, compared to 10% of that value, on reproductive success?
4. Identifying a Hazard Threshold	Identify an exposure level that ameliorates an adverse effect.	Use an existing health-based guidance value or threshold as the comparator.	In earthworms (Eisenia fetida), what is the effect of soil concentrations of metal Z below the EC10 (effective concentration for 10% response) compared to concentrations above the EC50 on avoidance behavior?
5. Evaluating an Intervention	Assess the potential effect of a mitigation action.	Select comparator based on exposure levels achievable through an intervention.	In stream benthic invertebrate communities, what is the effect of installing a wastewater treatment upgrade (reducing chemical A by 50%) compared to no upgrade on species richness?

Protocol Note 3.1: Iterative PECO Formulation

• Draft Initial PECO: Based on scoping, draft a PECO following Scenario 1 (exploratory).
• Align with Evidence Map: Check the drafted PECO against the SEM. Can the identified studies answer this question? Refine PECO elements to match evidence clusters.
• Select Final Scenario: Determine the review's primary objective (e.g., hazard identification, dose-response, testing a NAM). Choose the most appropriate PECO scenario from Table 3 [9] [23].
• Specify Elements Operationally: Define each PECO term with precise, measurable criteria that will become inclusion/exclusion rules.
  • Example (Population): "Freshwater fish" is insufficient. Specify: "Juvenile life stages of salmonid fish (Family: Salmonidae) in controlled laboratory studies."
• Document Rationale: Justify the chosen PECO structure and definitions, linking them to the review's decision-making context [9].

PECO for Integrating New Approach Methodologies (NAMs)

Systematic reviews increasingly integrate evidence from NAMs (in vitro, in silico). A "parallel PECO" framework is recommended to define the scope and purpose of the NAM itself and articulate how its data relate to the "target" in vivo or human outcome [23].

• NAM PECO: Defines the test system (P), the treatment (E), the control (C), and the assay endpoint (O).
• Target PECO: Defines the relevant human or ecological population, exposure, comparator, and adverse outcome of regulatory concern.
• The review protocol must explicitly state the intended purpose and context of use for the NAM data and the rationale for its linkage to the target outcome [23].

Visualization of Systematic Review Workflow

Systematic Review Initiation and PECO Development Workflow

Integrated Assessment and Evidence Synthesis Planning

The scoping phase must also plan for the final evidence integration. Frameworks like SYRINA (Systematic Review and Integrated Assessment) are designed to synthesize evidence across multiple streams (e.g., in vivo, in vitro, mechanistic) which is common in ecotoxicity and essential for evaluating NAMs [24] [23].

Protocol Note 5.1: Planning for Evidence Integration

• Pre-define Evidence Streams: Based on the SEM, categorize the expected types of evidence (e.g., aquatic in vivo tests, terrestrial field studies, omics data, QSAR predictions).
• Select an Integration Framework: Adopt a structured framework (e.g., SYRINA, OHAT) for evaluating and weighting different evidence streams [24].
• Develop Stream-Specific Evaluation Criteria: Define how internal validity (risk of bias) and external validity (relevance) will be assessed for each study type. Standardized tools (e.g., SciRAP for in vivo studies) should be identified [24].
• Define Integration Logic: Specify how findings from different streams will be combined (e.g., mechanistic data supporting apical endpoint findings) to reach an overall conclusion about hazard or dose-response [24] [23].

Evidence Integration Logic for Ecotoxicity Systematic Reviews

The Population, Exposure, Comparator, Outcome (PECO) framework provides the essential scaffolding for formulating precise research questions in ecotoxicity systematic reviews. While defining the Population (including animal species) and Outcomes is often more straightforward, the complex nature of environmental studies presents unique challenges for operationalizing the 'E' (Exposure) and 'C' (Comparator) [9]. A well-defined PECO statement is not merely a procedural step; it directly determines the study design, inclusion criteria, and the interpretation of a review's findings, guiding how directly the evidence answers the intended question [9].

This document provides detailed application notes and protocols for defining complex exposures and selecting meaningful comparators within the context of ecotoxicity systematic reviews. The strategies herein are designed to enhance methodological rigor, minimize bias, and ensure that reviews produce actionable evidence for environmental risk assessment and decision-making.

Operationalizing Complex Environmental Exposures (The 'E')

Defining exposure in ecotoxicity goes beyond a simple binary classification. It requires careful consideration of the agent, its magnitude, timing, duration, and route.

Foundational Principles of Exposure Definition

The operational definition of exposure must be intrinsically linked to the study's conceptual framework and the hypothesized biological or ecological mechanism of action [27]. For environmental chemicals, this involves considering pharmacology, toxicodynamics, and toxicokinetics. The definition should reflect whether the research question concerns acute toxicity, chronic effects, or delayed impacts, which will dictate the relevant exposure window [27].

Quantitative Dimensions of Exposure

Exposure can be characterized along several quantitative dimensions, which should be pre-specified in the review protocol.

Table 1: Key Dimensions for Operationalizing Exposure in Ecotoxicity Reviews

Dimension	Description	Ecotoxicity Example	Considerations for Systematic Review
Intensity/Concentration	Magnitude of the exposure (e.g., mg/L, μg/g).	Aqueous concentration of a pesticide; tissue residue of a metal.	Specify acceptable units and ranges. Decide if analyses will use continuous or categorized data (e.g., tertiles) [9].
Duration	Length of time over which exposure occurs.	96-hour acute test; 28-day chronic sediment test; multi-generational study.	Define minimum/maximum study duration for inclusion. Distinguish between acute, sub-chronic, and chronic [27].
Timing & Life Stage	Period during the organism's lifespan when exposure occurs.	Embryonic exposure to endocrine disruptors; juvenile vs. adult sensitivity.	Population (P) and Exposure (E) are linked. Specify relevant life stages (e.g., larval, reproductive adult).
Frequency	How often exposure occurs (e.g., continuous, pulsed).	Single pesticide spray event vs. continuous effluent discharge.	Determines if studies mimicking pulsed exposures are relevant.
Route	Pathway of exposure (e.g., dietary, aqueous, sediment).	Waterborne copper uptake in fish; ingestion of contaminated prey by birds.	Different routes may have different toxicokinetics and effect levels.

Managing Exposure Complexity and Data Heterogeneity

Environmental exposures are often to complex mixtures (e.g., wastewater effluent, pesticide formulations). Reviews must establish clear rules for handling these scenarios, such as including studies of the mixture only if data on the primary chemical of interest are reported. Furthermore, studies use disparate measurement protocols, creating a barrier to data synthesis [28]. Leveraging standardized measurement protocols and data standards, such as those from the PhenX Toolkit (which includes environmental exposure domains) or the Human Health Exposure Analysis Resource (HHEAR), can provide a framework for assessing and harmonizing exposure data across studies [28].

Defining Meaningful Comparators (The 'C')

The choice of comparator is not a default option but a strategic decision that directly affects the validity and relevance of a review's conclusions [29].

Comparator Selection Strategies

The optimal comparator is a clinically—or ecologically—meaningful alternative that reflects a real-world decision or scenario [29] [30].

Table 2: Types of Comparators in Ecotoxicity Research and Their Applications

Comparator Type	Definition	When to Use	Methodological Considerations & Risks
Negative Control	A true zero or background level of exposure.	To establish a baseline effect and determine if the exposure causes any adverse effect.	The gold standard for hazard identification. May be less relevant for questions about alternative management scenarios.
Alternative Exposure Level	A different dose or concentration of the same agent.	To characterize dose-response relationships (e.g., what is the effect of concentration X vs. concentration Y?) [9].	Allows for quantitative risk assessment. Requires defining the cut-off(s) between exposure and comparator groups (e.g., regulatory limit, median split) [9].
Alternative Stressor	A different chemical or physical agent with a similar intended use or source.	To compare the relative toxicity of substitute chemicals (e.g., neonicotinoid A vs. neonicotinoid B).	Confounding by indication is reduced if agents are used for the same purpose. Must carefully control for differences in exposure intensity and potency [29].
"Usual" or Background Condition	The ambient environmental condition in the absence of a specific intervention or novel stressor.	To assess the impact of a new anthropogenic activity (e.g., new discharge) against prevailing conditions.	Defining "usual" can be complex and site-specific. Requires clear, operational criteria.
Intervention to Reduce Exposure	An action taken to mitigate exposure (e.g., remediation, treatment).	To evaluate the effectiveness of risk management strategies [9].	The comparator is the pre-intervention or non-intervention state. Focuses on outcomes of mitigation rather than hazard.

Minimizing Bias in Comparator Selection

A key risk in observational and comparative effectiveness research is confounding by indication or severity, where the choice of exposure is influenced by the baseline risk or condition of the population [29]. In ecotoxicity, an analogous bias occurs if test organisms assigned to different exposure groups systematically differ in health, size, or genetic strain. Selecting a comparator that shares a similar indication and modality (e.g., comparing two herbicides used on the same crop) can minimize this bias [29]. Furthermore, differential exposure misclassification can occur if the methods for ascertaining exposure are less accurate for one group than another (e.g., modeled exposure for one chemical vs. measured for another), potentially biasing effect estimates [29].

Integrating 'E' and 'C' into a Coherent PECO Statement

The PECO components are interdependent. The framework offered by [9] outlines five paradigmatic scenarios for formulating PECO questions, which can be adapted for ecotoxicity.

Table 3: PECO Formulation Scenarios Adapted for Ecotoxicity Systematic Reviews

Review Context & Objective	Operationalization Strategy for 'E' & 'C'	Example PECO Question
1. Establish a Hazard	Explore the relationship across a broad range of exposures. Comparator is the lowest exposure or control.	In freshwater mussels (P), what is the effect of exposure to microplastic concentrations (E) on filtration rate (O) compared to no microplastic exposure (C)?
2. Characterize a Dose-Response	Define exposure groups based on data-driven cut-offs (e.g., tertiles) from included studies.	In honey bee colonies (P), what is the effect of high dietary exposure to fungicide (top tertile) (E) on queen survival (O) compared to low exposure (bottom tertile) (C)? [9]
3. Apply a Specific Threshold	Use a pre-defined, fixed threshold (e.g., a regulatory standard or predicted no-effect concentration).	In aquatic invertebrate communities (P), what is the effect of chronic nickel exposure above the EPA chronic criterion (E) on species richness (O) compared to exposure below the criterion (C)? [9]
4. Compare Alternative Agents	Select a comparator that represents a viable alternative within the same class or use category.	In non-target plants (P), what is the effect of drift exposure to Herbicide A (E) on biomass (O) compared to drift exposure to Herbicide B (C)?
5. Evaluate an Intervention	Define the comparator as the absence of a specific mitigation action.	In amphibian populations (P), what is the effect of installing a constructed wetland to treat roadway runoff (E) on larval deformity rates (O) compared to no wetland intervention (C)? [9]

Diagram 1: The iterative workflow for developing a PECO statement, showing the interdependence of its components (Max Width: 760px).

Detailed Experimental and Review Protocols

Protocol for Systematic Review: Exposure Data Extraction and Harmonization

Objective: To consistently extract, evaluate, and harmonize heterogeneous exposure data from primary ecotoxicity studies for synthesis. Materials: Systematic review software (e.g., Covidence, Rayyan), data extraction form, unit conversion tools, standardized taxonomy (e.g., EPA's Substance Registry Services). Procedure:

• Pilot Extraction: Calibrate the review team using a 5-10% sample of studies. Refine the extraction form to capture all dimensions from Table 1.
• Primary Data Extraction: For each study arm, extract:
  • Exposure Agent: Chemical name(s), CASRN, purity, formulation.
  • Exposure Regime: Measured vs. nominal concentration; duration; frequency (continuous, pulsed); exposure medium (water, sediment, diet).
  • Quantification: Central tendency (mean, median) and variability (SD, SE) of exposure metric. Record units precisely.
  • Comparator Details: Full description of control or comparator group (e.g., solvent type and volume, background chemical levels).
• Harmonization Phase: Convert all exposure metrics to a standard unit (e.g., μg/L). For studies reporting only nominal concentrations, document this as a potential source of measurement error [27]. Categorize continuous exposure data according to pre-specified rules from the PECO statement (e.g., above/below a threshold, into tertiles) [9].
• Quality Assessment: Evaluate and document the exposure measurement quality for each study (e.g., was analytical verification performed? was exposure concentration stable?) as part of the risk-of-bias assessment [27].

Protocol for Primary Research: Designing Studies with PECO in Mind

Objective: To conduct a laboratory ecotoxicity study whose results will be readily synthesizable in future systematic reviews. Materials: Test organisms, exposure chemicals, analytical equipment for verification, controlled environmental chambers. Procedure:

• Pre-Define PECO: Before experimentation, formally state the study's PECO. Register the protocol in a repository like Open Science Framework or protocols.io [30].
• Exposure (E) Delivery:
  • Use analytical verification to measure actual exposure concentrations at regular intervals, reporting mean and standard deviation [27].
  • Clearly report the exposure matrix (e.g., reconstituted water specifications, sediment organic carbon content).
  • For chronic studies, detail renewal procedures and stability data.
• Comparator (C) Design:
  • Include a negative control (e.g., clean medium) and, if using a solvent carrier, a solvent control at the maximum volume used.
  • If comparing to an alternative stressor, ensure test conditions (temperature, pH, organism source) are identical across groups to minimize confounding [29].
• Reporting: Adhere to relevant reporting guidelines (e.g., STRIVES for ecotoxicology). In the manuscript, explicitly state the PECO in the abstract or methods section to facilitate future evidence synthesis [9].

Table 4: Research Reagent Solutions for Operationalizing Exposures and Comparators

Item / Resource	Function in Operationalizing 'E' & 'C'	Key Considerations & Examples
Certified Reference Materials (CRMs)	Provides the ground truth for exposure agent identity and concentration, ensuring accuracy in primary studies and calibration of analytical methods.	Use CRMs from NIST, EPA, or equivalent for chemical purity and standard solutions. Critical for analytical verification [27].
Standardized Test Guidelines	Provides a framework for defining exposure duration, life stage, endpoints, and control conditions, enhancing inter-study comparability.	OECD, EPA, or ISO guidelines for testing chemicals with aquatic and terrestrial organisms.
PhenX Toolkit (Environmental Exposures)	Provides consensus-based, standardized measurement protocols for collecting exposure data, facilitating cross-study data harmonization [28].	Protocols for "Indoor Air Quality," "Water Quality," or "Pesticide Exposure." Useful for designing primary studies or harmonizing data in reviews.
Human & Ecological Health Exposure Analysis Resource (HHEAR/CHEAR)	A network providing laboratory analysis of biological and environmental samples for exposure assessment, plus a data repository [28].	Can be used to generate high-quality exposure data for primary studies or to identify common analytes for synthesis [28].
Systematic Review Registration	Forces explicit, public a priori definition of PECO elements, reducing bias in the review process.	Register protocols on PROSPERO (for health reviews) or the Collaboration for Environmental Evidence library. Mandates defining exposure and comparator groups upfront [30].
Data Harmonization Tools	Software and ontologies that assist in mapping disparate exposure metrics and terminologies to a common standard.	The HHEAR Ontology provides a controlled vocabulary for exposure science [28]. Generic tools like OpenRefine can assist in data cleaning and unit conversion.

Diagram 2: The logical relationship between PECO elements forming a complete research question (Max Width: 760px).

Best Practices and Reporting Standards

To ensure reproducibility, minimize bias, and maximize utility, the following best practices are recommended:

• A Priori Protocol: Develop and register a detailed systematic review protocol specifying all operational definitions for exposure and comparator groups before beginning the review [30].
• Stakeholder Engagement: Engage risk managers, regulators, and other stakeholders when defining the comparator to ensure it addresses a meaningful choice in real-world environmental decision-making [30].
• Sensitivity Analyses: Pre-plan sensitivity analyses to test the robustness of conclusions to different operational definitions of exposure (e.g., using measured vs. nominal concentration) or comparator groupings [29] [30].
• Transparent Reporting: Use reporting guidelines like PRISMA and its environmental extension (PRISMA-EcoEvo). In the manuscript, present a clear PECO statement and provide a rationale for the chosen exposure metrics and comparator[s citation:9].

Applying the Five Paradigmatic PECO Scenarios for Different Research Questions

In ecotoxicity research, where the central questions involve understanding the impact of chemical, physical, or biological stressors on ecosystems, the formulation of a precise research question is a critical first step. The PECO framework—defining the Population (ecological receptors), Exposure, Comparator, and Outcomes—provides this essential structure [9]. It is increasingly recognized as the standard for systematic reviews in environmental health, moving beyond the clinical intervention-focused PICO model to address the complexities of unintentional environmental exposures [9].

A well-constructed PECO statement directly informs the protocol for a systematic review by delineating inclusion/exclusion criteria, guiding the search strategy, and framing the synthesis of evidence [9]. This is particularly vital for ecotoxicity systematic reviews, which aim to support regulatory risk assessments and environmental management decisions. The ECOTOXicology Knowledgebase (ECOTOX), a premier resource containing over one million test results, exemplifies the application of systematic, protocol-driven review to compile ecological toxicity data for chemical safety assessments [22]. Its methodology aligns with systematic review principles, emphasizing transparent and objective processes for identifying and curating data [22].

This article details the application of five paradigmatic PECO scenarios tailored for ecotoxicity research, providing the methodological scaffolding for a thesis on advanced PECO statement development. These scenarios offer a structured approach to moving from exploratory research to decision-critical analysis [9].

The Five Paradigmatic PECO Scenarios: Definitions and Ecotoxicity Applications

The five scenarios represent a logical progression in research and assessment, from initial exploration of a potential hazard to evaluating specific management or intervention thresholds [9]. Their application in ecotoxicity is summarized in the table below.

Table 1: The Five Paradigmatic PECO Scenarios with Ecotoxicity Examples [9]

Scenario	Systematic-Review Context	Approach	PECO Ecotoxicity Example
1	Calculate the health effect from an exposure; describe the dose-effect relationship.	Explore the shape of the exposure-outcome relationship (e.g., linear, logarithmic).	Among freshwater Daphnia magna (P), what is the effect of incremental increases in waterborne silver ion concentration (E) on 48-hour mortality (O)?
2	Evaluate the effect of an exposure cut-off on outcomes, informed by the review's data.	Use data-derived cut-offs (e.g., tertiles, quartiles) from identified studies.	Among juvenile rainbow trout (P), what is the effect of being in the highest quartile of sediment PCB concentration (E) compared to the lowest quartile (C) on hepatic biomarker induction (O)?
3	Evaluate association using cut-offs identified from external populations or standards.	Use known cut-offs from other contexts (e.g., regulatory levels, other species).	In a soil invertebrate community (P), what is the effect of cadmium concentrations exceeding EPA soil screening levels (E) compared to sub-threshold levels (C) on species diversity (O)?
4	Identify an exposure cut-off that ameliorates adverse health outcomes.	Use existing health-based guidance values or toxicity thresholds as the comparator.	For honey bee colonies (P), what is the effect of exposure to neonicotinoid doses below the LD50 (E) compared to doses at or above the LD50 (C) on foraging behavior and colony strength (O)?
5	Evaluate the potential effect of an achievable intervention cut-off.	Select a comparator based on a reduction achievable via a mitigation intervention.	In a wetland ecosystem (P), what is the effect of implementing a treatment wall that reduces groundwater nitrate by 50% (E) compared to pre-intervention levels (C) on algal biomass and dissolved oxygen (O)?

Application Notes and Data Synthesis Protocols

Data Source Identification and Management

A comprehensive search strategy is fundamental. For ecotoxicity reviews, key databases include PubMed/MEDLINE, Embase, Web of Science, and specialized resources like the ECOTOX Knowledgebase [31] [22]. Systematic reviews should search at least two major databases and include "gray literature" (e.g., government reports, theses) to mitigate publication bias [31]. Reference management software (e.g., EndNote, Zotero) and systematic review platforms (e.g., Covidence, Rayyan) are essential for deduplication, screening, and collaboration [32] [31].

Table 2: Key Data Sources for Ecotoxicity Systematic Reviews

Source Type	Examples	Utility in Ecotoxicity Reviews	Key Considerations
Bibliographic Databases	PubMed, Embase, Web of Science, Scopus [31].	Primary source for published journal articles.	Use controlled vocabularies (e.g., MeSH, EMTREE) and chemical-specific terms.
Specialist Repositories	ECOTOX Knowledgebase [22].	Curated ecotoxicity data for over 12,000 chemicals.	Provides pre-extracted test results but must be supplemented with original literature searches.
Gray Literature	Government agency reports (EPA, EFSA), academic theses, conference proceedings [31].	Captures non-peer-reviewed but critical regulatory studies and data.	May require targeted website searches and contacting authors or agencies.
Trial/Study Registers	ClinicalTrials.gov, ECOLEX.	Identifies ongoing or completed but unpublished studies.	Less common for ecological studies but growing in importance.

Data Extraction and Quality Assessment

Data extraction requires a priori designed forms to ensure consistency. For ecotoxicity, essential extracted data include test organism (species, life stage), exposure parameters (chemical, concentration/dose, duration, route), experimental design, control details, and quantitative outcome measures (e.g., LC50, EC10, mean effect size) [32]. Dual independent extraction by two reviewers is a mandatory best practice to minimize error and bias [32].

Quality assessment (or risk of bias evaluation) is conducted on included studies using domain-based tools. For animal and in vitro studies, tools like the SYRCLE's risk of bias tool or OHAT's approach are relevant. For ecological field studies, adaptations of the Newcastle-Ottawa Scale may be used. The goal is to evaluate internal validity (e.g., randomization, blinding, confounding) and reporting clarity [33].

Table 3: Comparison of Data Extraction and Synthesis Tools

Tool / Method	Primary Benefits	Primary Limitations	Best Suited For
Systematic Review Software (e.g., Covidence, Rayyan)	Integrated workflow (screening, extraction, consensus); automatically highlights discrepancies; supports collaboration [32].	Subscription cost; learning curve for form customization [32].	Teams conducting full systematic reviews, especially with large numbers of studies.
Spreadsheet Software (e.g., Excel, Google Sheets)	Highly customizable; easy to learn and access; flexible for diverse data types [32].	Manual discrepancy checking; prone to versioning errors; less rigorous blinding [32].	Smaller reviews, pilot projects, or extracting complex, non-standard data.
Narrative Synthesis	Integrates quantitative and qualitative findings; useful for exploring heterogeneity and generating theory [34].	Less structured; can be subjective without clear protocols (e.g., thematic analysis, conceptual mapping) [34].	Reviews with diverse study designs (e.g., mixed-methods) or where meta-analysis is not feasible [34].
Meta-Analysis	Provides quantitative summary effect estimate; increases statistical power; allows exploration of heterogeneity [31].	Requires comparable effect measures across studies; can be misleading with high heterogeneity or bias [31].	Reviews with sufficient, statistically combinable data from studies with similar PECO elements.

Systematic Evidence Mapping as a Preliminary Step

For broad or emerging topics, a Systematic Evidence Map (SEM) is a powerful precursor to a full review. An SEM aims to "map out and categorize existing literature" to identify key clusters of evidence and critical data gaps [35] [1]. In ecotoxicity, PECO criteria for an SEM are kept broad to capture the full scope of available evidence (e.g., all mammalian and non-mammalian test species, all relevant outcomes) [1]. The output is a searchable, visual database of studies, which can directly inform the development of a focused PECO question for a subsequent deep-dive systematic review or risk assessment [1].

Detailed Experimental Protocols for PECO Scenario Implementation

Protocol for Scenarios 1 & 2 (Dose-Response and Data-Derived Cut-offs)

Objective: To quantify the relationship between exposure intensity and ecological response and/or to compare effects across empirical exposure ranges.

• Problem Formulation: Define the ecological population and outcome of interest. The Exposure is defined as a continuous variable (Scenario 1) or a to-be-determined quantile (Scenario 2).
• Search & Screening: Execute comprehensive search. Screen studies for those reporting quantitative exposure concentrations/doses and a measurable, continuous or dichotomous outcome.
• Data Extraction: Extract raw data where possible: individual or group mean exposure levels, outcome measures, sample sizes, variances. Note study design (e.g., controlled lab, mesocosm).
• Dose-Response Analysis (Scenario 1): Fit appropriate statistical models (e.g., linear, log-linear, logistic) to the extracted data. Use meta-regression if multiple studies are combinable to derive a summary dose-response curve.
• Quantile Analysis (Scenario 2): Pool exposure data from all included studies. Determine overall distribution and define cut-offs (e.g., median, quartiles). Categorize study groups based on these cut-offs and calculate summary effect estimates (e.g., risk ratio, mean difference) for high vs. low exposure groups.

Protocol for Scenarios 3, 4 & 5 (Fixed and Intervention Cut-offs)

Objective: To assess the effect of exceeding a specific, pre-defined threshold (regulatory, health-based, or achievable through intervention).

• Problem Formulation: Precisely define the fixed cut-off value (C) and its source (e.g., EPA Aquatic Life Benchmark, EC50 from standard test, technically achievable reduction target).
• PECO Finalization: The Exposure (E) is explicitly defined in relation to the Comparator (C) (e.g., > vs. ≤ benchmark; post- vs. pre-intervention concentration).
• Study Eligibility: Inclusion criteria require studies to report data that can be classified relative to the fixed cut-off. For intervention studies (Scenario 5), include primary evaluations of the mitigation technique.
• Effect Quantification: For each study, calculate the effect size (e.g., standardized mean difference, relative risk) comparing the groups defined by (E) and (C).
• Evidence Integration: Synthesize effect sizes across studies using meta-analysis if homogeneous, or narrative synthesis following a framework like SYRINA (Systematic Review and Integrated Assessment) [24]. SYRINA is particularly relevant for integrating multiple evidence streams (e.g., in vitro, animal, ecological field data) to assess chemicals like endocrine disruptors [24].

Protocol for Integrated Assessment Across Evidence Streams (SYRINA)

For complex assessments (e.g., identifying endocrine disrupting chemicals), a protocol for integrating heterogeneous data is required [24].

• Formulate Problem & PECO: Use the IPCS/WHO EDC definition as a guide: link exposure, endocrine activity, and adverse outcome [24].
• Develop Stream-Specific Protocols: Create tailored eligibility and appraisal criteria for each evidence stream (epidemiology/wildlife, in vivo lab, in vitro, in silico).
• Evaluate Individual Studies: Assess risk of bias and relevance for each study within its stream.
• Summarize Streams: Synthesize findings within each evidence stream (e.g., meta-analysis for human data, narrative summary for mechanistic data).
• Integrate Across Streams: Weigh and combine evidence across all streams using pre-defined criteria (e.g., strength, consistency, biological plausibility, coherence) to draw a conclusion about the chemical's hazard potential [24].

Table 4: Key Research Reagent Solutions for PECO-Driven Ecotoxicity Reviews

Tool / Resource Name	Category	Primary Function in Review Process	Application Note
ECOTOX Knowledgebase [22]	Curated Database	Provides systematically extracted single-chemical ecotoxicity test results for aquatic and terrestrial species.	Ideal for scoping, problem formulation, and as a primary data source for reviews of established chemicals. Must verify against original studies for critical appraisal.
Covidence / Rayyan [32] [31]	Systematic Review Software	Manages the screening of titles/abstracts and full-text articles, dual-reviewer conflict resolution, and data extraction.	Streamlines the review process, ensures protocol adherence, and maintains an audit trail. Essential for team-based reviews.
Cochrane Risk of Bias / SYRCLE's RoB Tool	Quality Assessment Tool	Provides a structured framework to assess the internal validity (risk of bias) of individual studies.	Modifying these tools for ecotoxicity contexts (e.g., for field studies or laboratory bioassays) is often necessary to capture relevant bias domains.
R Statistical Software (metafor, robvis packages)	Statistical Analysis & Visualization	Conducts meta-analysis, meta-regression, creates forest plots, funnel plots, and risk-of-bias visualizations.	The open-source standard for advanced statistical synthesis and generating publication-ready graphics.
SYRINA Framework [24]	Integrated Assessment Methodology	Provides a 7-step protocol for systematically reviewing and integrating multiple evidence streams (e.g., in vitro, animal, human, ecological).	Critical for complex hazard identifications (e.g., endocrine disruptors) where evidence must be weighed across different study types.
EPA CompTox Chemicals Dashboard	Chemistry Database	Provides access to chemical properties, identifiers, and linkages to bioassay and exposure data.	Used in the problem formulation and introduction to characterize the chemical(s) of interest and identify related compounds [1].

Integrating Mechanistic Data and Toxicokinetics into the PECO Framework

Introduction Within the broader thesis on advancing PECO (Population, Exposure, Comparator, Outcome) statement development for ecotoxicity systematic reviews, a critical evolution lies in the integration of mechanistic biological data and toxicokinetics (TK). Traditional PECO frameworks often rely on apical in vivo endpoints, which can create challenges for synthesizing evidence from New Approach Methodologies (NAMs) that provide rich mechanistic insights but lack direct concordance with whole-organism outcomes [23]. This document provides application notes and detailed protocols for formally embedding mechanistic and TK data into the PECO framework. This integration enhances the relevance, specificity, and predictive power of systematic reviews, enabling more confident use of in vitro, in silico, and targeted in vivo data in human health and ecological risk assessment [23] [36].

1. The PECO Framework for Mechanistic Integration The standard PECO framework is adapted to structure questions that explicitly interrogate mechanistic pathways and internal dose. A key advancement is the development of "parallel" or "nested" PECO statements [23].

• Parallel PECO Statements: For a given review, two interlinked PECO statements are formulated: one for the target organism (e.g., humans, a fish species) and one for the test system (e.g., a human hepatocyte model, a fish embryo assay). This forces explicit consideration of biological concordance between the test method outcome and the ecological or human health outcome of interest [23].
• Refining the "E" and "C" with TK: The Exposure (E) and Comparator (C) elements are refined to consider both external concentration and internal target-site dose. The comparator may shift from "no exposure" to "exposure below a mechanistic perturbation threshold" [9].
• Redefining the "O" for Key Events: The Outcome (O) can be defined as a Key Event within an established adverse outcome pathway (AOP), such as receptor activation, protein oxidation, or specific cellular stress responses, moving beyond traditional apical endpoints [23].

Table 1: PECO Formulation Scenarios Integrating Mechanistic & TK Data [9]

Scenario	Core Question	Adapted PECO Element Focus	Example (Chemical: Hepatotoxicant)
1. Dose-Response for a Key Event	What is the relationship between exposure concentration and the magnitude of an early key event?	E: Concentration range. C: Incremental increase. O: Quantitative change in KE (e.g., CYP450 induction) [9].	Among human HepaRG cells, what is the effect of a 10 μM incremental increase in chemical X exposure on CYP3A4 mRNA expression?
2. Benchmark Dose for Mechanistic Perturbation	What exposure level causes a defined, biologically significant change in a mechanistic endpoint?	E: Dose achieving BMD. C: Dose at background/vehicle level. O: Pre-defined % change in biomarker [9].	Among rainbow trout hepatocytes, what is the exposure concentration of chemical X that induces a 20% increase in oxidative stress (ROS) compared to vehicle control?
3. Cross-Species Concordance	Does a key event observed in a test system predict the apical outcome in the target population?	P (Test): In vitro model. P (Target): Wild species. O (Test): Key Event. O (Target): Apical Outcome [23].	Does chemical X-induced mitochondrial dysfunction in zebrafish embryos (test system) predict reduced larval survival in fathead minnows (target population)?
4. TK-Informed Comparator	What is the effect of an exposure yielding a relevant internal dose compared to a no-effect internal dose?	E: External dose yielding target tissue concentration > POD. C: External dose yielding target tissue concentration < POD. O: Apical or key event outcome.	Among rats, what is the effect of oral exposure to chemical X achieving a liver concentration of 50 nM compared to exposure achieving 1 nM on the incidence of hepatocellular hypertrophy?

Workflow for Integrating Mechanistic Data into PECO

2. Application Notes

• Note 1: Framing the Question for NAMs. The primary challenge is moving from a PECO question about an apical outcome in a population to one about a key event in a test system. The "parallel PECO" approach directly addresses this by linking the two [23]. The question should specify the biological plausibility linking the test system outcome to the apical outcome.
• Note 2: Defining Mechanistic Comparators. The comparator (C) is crucial. For mechanistic data, an appropriate comparator may not be "no exposure," but exposure at a level that does not perturb the measured pathway (a "biological zero"). This requires dose-response data to identify a threshold or benchmark dose (BMD) for the mechanistic endpoint [9].
• Note 3: Quantifying Exposure for Integration. To integrate across study types, exposure must be expressed in a common metric. This often requires using TK modeling to convert administered doses in animal studies (mg/kg) and concentrations in vitro (μM) to estimated target-site concentrations (e.g., μM in liver). This forms the basis for a unified dose-response assessment across diverse evidence streams.
• Note 4: Assessing Confidence. Confidence in conclusions drawn from integrated PECO reviews depends on: 1) Internal Validity of each study (e.g., assay reliability), 2) External Validity (relevance of the test system to the target), 3) Biological Variability, and 4) Experimental Variability [23]. A transparent confidence rating for each evidence stream and the integrated body of evidence is essential [36].

Table 2: Mapping Test System Endpoints to PECO Outcomes for a Hepatotoxicant AOP

AOP Key Event (KE)	Example Test System	Measurable Endpoint (Test System Outcome)	Linked Apical Outcome (Target Population Outcome)
KE1: Nuclear Receptor Activation	Human PPARγ Reporter Gene Assay	Luminescence / Fold activation over control	Steatosis (lipid accumulation)
KE2: Mitochondrial Dysfunction	Rat Hepatocyte, High-Content Imaging	MMP loss (% cells), ATP depletion	Hepatocyte ballooning, necrosis
KE3: Oxidative Stress	Zebrafish Embryo	ROS fluorescence intensity, GST expression	Apoptosis, developmental delay
KE4: Inflammation	Kupffer Cell (in vitro) Model	Cytokine secretion (TNF-α, IL-1β pg/mL)	Immune cell infiltration, fibrosis

3. Detailed Experimental Protocols Protocol 1: Generating TK Data for PECO Comparator Definition

• Objective: To determine the in vitro concentration range that yields internal target-organ doses equivalent to in vivo no-observed-effect-levels (NOELs) and lowest-observed-effect-levels (LOELs).
• Methodology:
  • In Vivo TK Study: Administer the test chemical at the NOEL and LOEL doses to the model organism (e.g., rat). Collect serial blood and target tissue (e.g., liver) samples over time.
  • Bioanalysis: Quantify chemical and metabolite concentrations in plasma and tissue homogenates using LC-MS/MS.
  • TK Modeling: Develop a physiologically based toxicokinetic (PBTK) model. Calibrate and validate the model using the in vivo concentration-time data.
  • In Vitro Extrapolation: Use the validated PBTK model to simulate the steady-state plasma (Cssplasma) and target tissue (Csstissue) concentrations resulting from the in vivo NOEL/LOEL.
  • Define Comparator Range: The simulated Css_tissue for the NOEL becomes the upper bound for the "no mechanistic perturbation" comparator in parallel in vitro studies.

Protocol 2: High-Content Screening for Quantitative Key Event Data

• Objective: To generate quantitative, dose-response data for a specific Key Event to populate the Outcome (O) element of a mechanistic PECO statement.
• Methodology:
  • Cell Model Selection: Use a relevant cell line (e.g., primary hepatocytes, stellate cells).
  • Dosing Strategy: Treat cells with the test chemical across a minimum of 8 concentrations, plus vehicle and positive controls, in triplicate. Include concentrations bracketing the Css_tissue estimated from Protocol 1.
  • Endpoint Staining: At assay endpoint, fix cells and stain for the KE (e.g., for oxidative stress: stain with DCFDA for ROS and Hoechst for nuclei).
  • Image Acquisition & Analysis: Use a high-content imager to capture multiple fields per well. Use analysis software to quantify per-cell fluorescence intensity (for DCFDA) and cell count.
  • Dose-Response Analysis: Calculate the average response per well. Fit the concentration-response data using a 4-parameter logistic curve. Calculate the BMD10 (benchmark dose for a 10% change) and its confidence interval.

Protocol 3: Systematic Review with Integrated Evidence Streams

• Objective: To conduct a systematic review that synthesizes in vivo apical, in vitro mechanistic, and TK data under a unified PECO framework [36].
• Methodology:
  • Problem Formulation & Parallel PECO: Define the target organism PECO (Population, Exposure, Comparator, Apical Outcome) and the test system PECO (Test System, Exposure, Comparator, Key Event Outcome) [23] [36].
  • Structured Search: Execute separate, tailored search strategies for each evidence stream (in vivo, in vitro, TK).
  • Data Extraction: Use standardized forms. For all studies, extract data to model target-site dose (administered dose, route, duration, measured concentrations). For in vivo studies, extract apical endpoint data. For in vitro studies, extract key event endpoint data and assay conditions.
  • Evidence Integration: Plot all extracted dose-response data (apical and key event) on a common x-axis of estimated target-site concentration (derived from PBTK modeling or direct measurement). Assess concordance, data gaps, and overall pattern.
  • Confidence Rating: Rate confidence in the body of evidence for each stream and the integrated assessment based on pre-defined criteria for internal/external validity and variability [23] [36].

The Scientist's Toolkit: Essential Research Reagents & Materials Table 3: Key Reagents for Mechanistic & TK-Integrated PECO Research

Item/Category	Function in Protocol	Example/Specification
Physiologically Based Toxicokinetic (PBTK) Modeling Software	Simulates internal dose metrics from external exposure for cross-species and in vitro/in vivo extrapolation.	GastroPlus, Simcyp, Berkeley Madonna, or open-source tools.
LC-MS/MS System	Quantifies parent compound and metabolite concentrations in biological matrices (plasma, tissue, cell media) for TK analysis.	Triple quadrupole mass spectrometer with UPLC.
Relevant In Vitro Cell Models	Provides human- or species-relevant biological system for measuring Key Events.	Primary hepatocytes (human/rat), HepaRG cells, iPSC-derived cells, gill cell lines.
High-Content Screening (HCS) Imager & Analysis Software	Automates quantitative imaging of fluorescent biomarkers for Key Events in dose-response format.	Instruments: ImageXpress, Operetta. Software: CellProfiler, Harmony.
Key Event-Specific Assay Kits	Measures specific biochemical endpoints aligned with AOP Key Events.	Kits for: Caspase-3/7 activity (apoptosis), CYP450 induction (reporter gene), Glutathione depletion, Phospho-kinase arrays.
Reference Chemicals	Positive and negative controls for assay validation and dose-response calibration.	Well-characterized agonists/antagonists for specific targets (e.g., Rifampicin for CYP3A4 induction, Rotenone for mitochondrial inhibition).
Systematic Review Management Software	Manages the review process: deduplication, screening, data extraction.	DistillerSR, Rayyan, Covidence.

Developing Assessment-Specific Protocols and Finalizing the PECO for Systematic Review

Systematic reviews represent the highest standard of evidence synthesis in environmental health and ecotoxicology. Within the context of a broader thesis on PECO (Population, Exposure, Comparator, Outcome) statement development for ecotoxicity research, this document establishes detailed application notes and experimental protocols. The development of assessment-specific protocols is not a generic exercise but a critical, front-loaded investment that determines the scientific rigor, transparency, and reproducibility of the entire review [37] [38]. A well-constructed protocol mitigates bias, enhances team coordination, and fulfills the growing mandate from journals and funding bodies for registered review plans [38].

This guidance synthesizes established systematic review methodologies [31] with advanced frameworks specifically designed for environmental health assessments, such as the Systematic Evidence Map (SEM) template used by the U.S. Environmental Protection Agency [1]. The core thesis posits that a meticulously finalized PECO statement, embedded within a robust public protocol, is the foundational pillar for reliable hazard identification and characterization in ecotoxicology.

Methodology: Core Protocols for Protocol Development

Phase I: Formulating the Research Question and PECO Framework

The PECO framework structures the research question into searchable, actionable components and directly informs inclusion/exclusion criteria [31] [1].

• Protocol Objective: To define and document a precise, actionable PECO statement.
• Detailed Procedure:
  • Population (P): Define the biological system(s) of interest. In ecotoxicity, this includes specifying test organisms (e.g., Daphnia magna, fathead minnow), life stages, and relevant population descriptors.
  • Exposure (E): Characterize the chemical/stressor, including its form, route of exposure (e.g., aqueous, dietary), duration (acute, chronic), and measured concentrations.
  • Comparator (C): Define the appropriate control or reference condition. This is typically an unexposed control group but may include a group exposed to a reference toxicant or an alternative treatment for comparative risk.
  • Outcome (O): Specify the measurable health or ecological endpoints. These should be categorized (e.g., mortality, growth, reproduction, genotoxicity, biochemical markers) and defined with accepted metrics (e.g., LC50, NOEC, biomarker fold-change).
• Assessment-Specific Adaptation: For a systematic evidence map intended for problem formulation, PECO criteria are typically kept broad to capture all potentially informative mammalian and epidemiological studies [1]. In contrast, a meta-analysis protocol will require a highly precise PECO to ensure homogeneity for quantitative synthesis [31].

Diagram 1: PECO Informs Systematic Review Criteria (77 characters)

Phase II: Designing the Comprehensive Search Strategy

A pre-defined, reproducible search strategy is essential to minimize selection bias [31].

• Protocol Objective: To identify all relevant published and unpublished evidence.
• Detailed Procedure:
  • Database Selection: Search at minimum two core databases. Standard choices include PubMed/MEDLINE, Embase, and Web of Science [31]. For ecotoxicity, specialized databases like ECOTOX (EPA) must be included.
  • Search String Development:
    • Deconstruct the PECO into key concepts.
    • For each concept, identify relevant controlled vocabulary (e.g., MeSH in PubMed) and free-text terms.
    • Combine concepts using Boolean operators (AND, OR).
    • Validate the search string via a "test set" of known key papers.
  • Grey Literature Search: Plan to search for unpublished studies, theses, government reports, and conference abstracts in sources like regulatory agency websites and dissertation databases to mitigate publication bias [31].
  • Search Documentation: Record the exact search string, dates, database interfaces, and number of records retrieved for each database.

Table 1: Core Bibliographic Databases for Ecotoxicity Systematic Reviews

Database	Primary Focus & Utility	Key Characteristics [31]
PubMed/MEDLINE	Biomedical and life sciences literature.	Uses Medical Subject Headings (MeSH). Free access.
Embase	Biomedical and pharmacological literature, strong European coverage.	Robust indexing of drugs and chemicals.
Web of Science	Multidisciplinary science citation indexing.	Powerful for forward/backward citation searching.
ECOTOX (U.S. EPA)	Ecotoxicology data for chemicals.	Curated data on effects of chemicals to aquatic and terrestrial life.
Google Scholar	Broad scholarly literature search engine.	Useful for grey literature and cross-checking. Free access.

Phase III: Establishing Screening, Data Extraction, and Quality Assessment

This phase translates the PECO into actionable workflows for study selection and analysis [1] [37].

• Protocol Objective: To implement transparent, reproducible processes for managing evidence.
• Detailed Procedure for Study Screening:
  • Use reference management software (e.g., EndNote, Zotero) to deduplicate records [31].
  • Conduct screening in two stages (title/abstract, then full-text) using two independent reviewers.
  • Use collaborative screening tools (e.g., Rayyan, Covidence) to manage the process and resolve conflicts via consensus or a third reviewer [31].
• Detailed Procedure for Data Extraction:
  • Develop and pilot a standardized data extraction form.
  • Extract key data: study identifiers, PECO details, study design, sample size, results (effect sizes, variance metrics), and funding source.
  • Perform extraction in duplicate to ensure accuracy.
• Detailed Procedure for Risk of Bias/Study Evaluation:
  • Select an appropriate tool a priori (e.g., Cochrane Risk of Bias for clinical trials, ECOTOX assessment criteria for ecological studies).
  • Assess domains such as randomization, blinding, selective reporting, and exposure characterization.
  • Document how risk of bias assessments will be used to inform data synthesis (e.g., sensitivity analysis).

Diagram 2: Systematic Review Screening & Extraction Workflow (78 characters)

Phase IV: Protocol Registration and Public Archiving

Public registration of the protocol prior to conducting the review is a cornerstone of transparency [37] [38].

• Protocol Objective: To lock in the review plan, prevent duplication of effort, and reduce reporting bias.
• Detailed Procedure:
  • Finalize the protocol document incorporating all elements above.
  • Select a registration platform:
    • PROSPERO: International register for health-related systematic reviews [38].
    • Open Science Framework (OSF): Flexible repository for any review type; suitable for scoping reviews and ecotoxicity protocols [37] [38].
    • Journal Submission: Some journals (e.g., BMJ Open, Environmental International) publish peer-reviewed protocols [38].
  • Submit the protocol, ensuring alignment with the platform's requirements (e.g., PRISMA-P checklist items for PROSPERO) [37].

Application Note: The Systematic Evidence Map (SEM) for Ecotoxicity Problem Formulation

An SEM is a powerful assessment-specific protocol to visualize the breadth and distribution of evidence [1].

• Context: Used early in assessment development (e.g., for IRIS or PPRTV assessments) to identify data-rich and data-poor areas, inform the scope of a full systematic review, and prioritize research needs [1].
• Key Protocol Deviation from Standard SR:
  • PECO Criteria: Deliberately broad to capture a wide landscape of evidence [1].
  • Supplemental Content Tracking: Beyond core PECO studies, the protocol mandates tracking of supplemental evidence streams (e.g., in vitro studies, toxicokinetic data, new approach methodologies - NAMs) [1].
  • Output: The primary output is an interactive visual inventory (map) of the evidence base, often with structured summaries, rather than a quantitative synthesis or graded conclusion [1].

Table 2: Core vs. Supplemental Content in an Ecotoxicity SEM Protocol [1]

Content Category	Description	Purpose in SEM
Core PECO Studies	In vivo mammalian bioassays & human epidemiological studies meeting the (broad) PECO.	Form the central evidence base for hazard identification.
Mechanistic Studies	In vitro, ex vivo, or in silico studies informing mode of action.	Provide biological plausibility context.
Toxicokinetic Data	ADME (Absorption, Distribution, Metabolism, Excretion) and PBPK models.	Inform cross-species and dose extrapolation.
New Approach Methodologies (NAMs)	High-throughput screening, transcriptomic data, etc.	Identify modern, alternative evidence streams.
Ecological Toxicity Data	Studies on non-mammalian wildlife and model organisms (fish, invertebrates, plants).	Core for ecological risk assessment.

The Scientist's Toolkit: Essential Research Reagents and Materials

Table 3: Key Reagent Solutions for Conducting a Systematic Review

Item	Function/Description	Example Tools & Resources
Protocol & Reporting Guidelines	Provide structured checklists to ensure methodological completeness and transparent reporting.	PRISMA-P [37], PRISMA for Preclinical Animal Studies [25], SEM Template [1]
Reference Management Software	Stores search results, removes duplicates, and manages citations.	EndNote, Zotero, Mendeley [31]
Screening & Data Extraction Platform	Online tool for collaborative title/abstract/full-text screening, conflict resolution, and data extraction.	Covidence, Rayyan [31] [37]
Systematic Review Registry	Public repository to prospectively register a review protocol to reduce bias and duplication.	PROSPERO [38], Open Science Framework (OSF) [37]
Risk of Bias Assessment Tool	Standardized instrument to evaluate the methodological quality and potential biases of included studies.	Cochrane RoB Tool, ECOTOX Risk of Bias Tool, agency-specific guides [1]
Data Synthesis & Visualization Software	Statistical software for meta-analysis and generation of forest plots, funnel plots, and evidence maps.	R (metafor, ggplot2), RevMan [31], visualization libraries for SEMs [1]

Visualization Protocol: Adherence to Accessibility and Color Standards

All diagrams and evidence maps generated as part of the systematic review output must follow accessibility guidelines.

• Color Palette Rule: Use only the specified palette: #4285F4 (blue), #EA4335 (red), #FBBC05 (yellow), #34A853 (green), #FFFFFF (white), #F1F3F4 (light grey), #202124 (dark grey), #5F6368 (grey) [39].
• Contrast Requirements:
  • Non-text elements (graphical objects, bars, lines): Minimum 3:1 contrast ratio against adjacent colors [39] [40].
  • Text elements: Minimum 4.5:1 contrast ratio against background (or 3:1 for large, bold text) [40] [41].
• Implementation Protocol:
  • For Categorical Data (Qualitative Schemes): Use distinct hues from the palette (blue, red, yellow, green) to represent different study types or outcomes. Avoid using color as the only discriminator; add patterns, labels, or direct annotations [40] [42].
  • For Sequential Data: Use light-to-dark shades of a single hue (e.g., #F1F3F4 to #5F6368) to represent a continuum of values like dose or effect size [42].
  • Validation: Use a color contrast checker (e.g., WebAIM) to verify all ratios before publication [40] [41]. Check visualizations in greyscale to ensure interpretability without color [40].

Overcoming Common Pitfalls in PECO Development for Ecotoxicity

In the field of ecotoxicology and systematic review methodology, a well-formulated PECO (Population, Exposure, Comparator, Outcome) statement serves as the foundational scaffold for the entire evidence synthesis process [9]. It defines the research question, establishes inclusion and exclusion criteria, and guides the interpretation of findings. Within the context of a broader thesis on PECO statement development for ecotoxicity research, this article addresses a pervasive and critical risk: the inappropriate exclusion of relevant health outcomes. Such exclusion can stem from overly narrow outcome definitions, inconsistent application of criteria, or a failure to consider sensitive, non-apical endpoints. This bias can systematically skew risk evaluations, leading to conclusions that underestimate the true hazard of chemical exposures [43]. This document provides detailed application notes and experimental protocols designed to equip researchers, scientists, and drug development professionals with the tools to develop robust, inclusive PECO statements that faithfully capture the full spectrum of potential health effects, thereby strengthening the scientific basis for environmental and public health decisions.

Application Notes: Frameworks, Pitfalls, and Quantitative Insights

PECO Development Scenarios for Ecotoxicity Research

The approach to formulating a PECO statement must be matched to the specific research or decision-making context. Research by the National Institutes of Health outlines five paradigmatic scenarios, which can be adapted to ecotoxicity questions [9]. The following table translates these scenarios with examples relevant to chemical risk assessment.

Table 1: PECO Development Scenarios Adapted for Ecotoxicity Systematic Reviews

Systematic Review Context	Recommended PECO Approach	Ecotoxicity Example (Chemical: Bisphenol A)
1. Characterizing the dose-effect relationship	Explore the shape/distribution of the exposure-outcome relationship across the observed range.	Among rodent models, what is the effect of incremental increases in oral BPA exposure (e.g., per 0.1 mg/kg/day) on sperm concentration?
2. Evaluating effects using data-derived exposure contrasts	Define comparator groups (e.g., high vs. low exposure) based on distributions (tertiles, quartiles) in the identified literature.	Among epidemiological studies, what is the effect of the highest quartile of urinary BPA concentration compared to the lowest quartile on child neurodevelopmental scores?
3. Evaluating effects using externally defined exposure cut-offs	Use cut-offs (thresholds, regulatory limits) established from other populations or authoritative sources.	Among occupational cohorts, what is the effect of airborne BPA exposure above the REL (Recommended Exposure Limit) compared to below the REL on respiratory function?
4. Identifying an exposure level that ameliorates health effects	Use an existing health-based benchmark (e.g., a toxicity reference value) as the cut-off for the comparator.	In aquatic toxicity studies, what is the effect of BPA water concentrations below the established No Observed Adverse Effect Level (NOAEL) compared to above the NOAEL on fish reproductive success?
5. Evaluating the effect of an intervention to reduce exposure	Select the comparator based on exposure levels achievable through a specific intervention.	Among a general population, what is the effect of an intervention that replaces BPA-containing food packaging compared to no intervention on biomonitored BPA levels?

Source: Adapted from [9].

A critical analysis of regulatory practices reveals systematic patterns in how outcome definitions can lead to the exclusion of pertinent evidence. A review of the U.S. Environmental Protection Agency's (EPA) Toxic Substances Control Act (TSCA) systematic review protocols identified specific, recurring issues [43].

Table 2: Common Pitfalls in Outcome Definition and Proposed Solutions

Pitfall	Description	Consequence	Recommended Solution
Excluding Cellular/Subcellular Outcomes	Limiting inclusion to "apical" outcomes (effects at the organ level or higher), thereby excluding mechanistic or biomarker data (e.g., hormone level changes, genotoxicity) [43].	Excludes sensitive early indicators of toxicity, potentially dismissing entire studies and biasing the evidence base toward less sensitive, often industry-funded, guideline studies [43].	Define outcomes broadly. Include "all biological effects," specifying that molecular, cellular, tissue, organ, and systemic outcomes are all of interest. Mechanistic data informs biological plausibility.
Post-Protocol Modification of PECO	Changing the PECO eligibility criteria after the systematic review has begun, often during the transition from abstract to full-text screening [43].	Introduces selection bias and violates predefined protocol standards, as criticized by the National Academies. Inclusion becomes arbitrary [43].	Predefine and lock the PECO in a publicly available protocol. Any deviation must be documented and justified as a protocol amendment.
Unexplained Inconsistencies Across Chemical Assessments	Applying different outcome inclusion rules to chemically similar substances without scientific justification [43].	Undermines the consistency and transparency of the risk evaluation process, making comparisons across chemicals unreliable.	Apply a standardized outcome framework across all assessments within a program. Document any chemical-specific justifications for deviation.
Overly Narrow Composite Outcomes	Focusing only on broad composite endpoints (e.g., "morbidity/mortality") or non-specific health service use (e.g., hospitalization) while excluding specific, informative health effects [44].	Fails to identify the specific health outcomes linked to an exposure, reducing the utility of the review for causal inference and risk management.	Pre-specify and include relevant specific health outcomes. Exclude vague composite endpoints only if they cannot be disaggregated into specific effects of interest [44].

Quantitative Impact of Inconsistent PECO Application

The practical impact of inconsistent PECO statements is evident in recent regulatory work. An analysis of the U.S. EPA's TSCA risk evaluations for 23 industrial chemicals revealed widespread use of exclusionary language [43].

Table 3: Analysis of Outcome Scope in EPA TSCA PECO Statements

PECO Outcome Scope Category	Number of Chemicals (out of 23)	Percentage	Example Health Outcomes Likely Excluded
All apical biological effects (organ-level and higher)	20	87%	Reduced thyroid hormone levels (cellular), altered immune cell counts (cellular), reduced sperm quality (tissue/organ) [43].
All health outcomes / All biological effects (inclusive)	3	13%	None specified; intended to be comprehensive.
PECO statements changed mid-review	21	91%	Varies; creates potential for inconsistent application of any of the above criteria [43].

Source: Data derived from [43]. This analysis illustrates that a majority of assessments employed a PECO structure that systematically excluded mechanistic and many toxicological endpoints from consideration.

Experimental Protocols for Inclusive PECO Development

Protocol for a Scoping Review to Inform PECO Development

Objective: To conduct a preliminary scoping review that maps the available evidence on a given exposure, specifically to identify the range of health outcomes reported across all evidence streams (human, animal, in vitro). This directly informs a comprehensive "Outcomes" element for the definitive systematic review PECO.

Methodology (Adapted from NTP OHAT Framework [44]):

• Problem Formulation & Protocol:
  • Develop a draft, broadly inclusive PECO. For the Population, specify all relevant models (e.g., human, mammalian animal, non-mammalian animal, in vitro systems). For Exposure, define the chemical or stressor class. For Comparator, state "varying levels, including unexposed controls." For Outcomes, state "any biological or health effect."
  • Document the search strategy for at least two major databases (e.g., PubMed, Web of Science), using exposure terms combined with broad health filters. Impose no restrictions based on study design or publication year [44].
• Literature Search & Screening:
  • Execute the search. Use machine-learning assisted screening tools (e.g., SWIFT-Active Screener) to efficiently handle large result sets. The software prioritizes references based on relevance training from initial manual screening [44].
  • Title/Abstract Screening: Two independent screeners assess references against the broad PECO. The goal is sensitivity (to capture all possible outcomes), not specificity. Continue screening until the tool predicts ~95% of relevant references are identified [44].
  • Full-Text Review & Data Extraction: Retrieve potentially relevant full texts. Extract data into a standardized form capturing: evidence stream, study design, exposure details, and—critically—every health or biological outcome reported, categorizing them (e.g., molecular, cellular, organ, systemic, ecological).
• Analysis & PECO Refinement:
  • Create an evidence map (e.g., using Tableau software) visualizing the frequency of studied outcomes across evidence streams [44].
  • Analyze the map to identify: a) Consistently reported apical outcomes, b) Frequently reported mechanistic or biomarker outcomes that may be early indicators, and c) Gaps in the evidence.
  • Use this evidence map to refine the Outcomes element for the definitive systematic review PECO. The final list should be specific but inclusive, covering major apical endpoints and key mechanistic outcomes that inform hazard characterization.

Diagram: Scoping Review Workflow for PECO Development

Protocol for Integrating Diverse Evidence Streams into a Single PECO

Objective: To construct a PECO statement that coherently integrates human epidemiological, whole-animal toxicology, and in vitro mechanistic data, ensuring no relevant outcome stream is excluded due to framework incompatibility.

Methodology:

• Define Translatable Population Domains:
  • Population (P): Articulate the P for each stream in a complementary way. For example: "P (Human): General or occupational populations; P (Animal): Mammalian models (e.g., rodents); P (In Vitro): Human or mammalian cell lines." This specifies the domains of evidence without forcing incongruent definitions.
• Harmonize Exposure and Comparator:
  • Exposure (E): Define the stressor consistently (e.g., "Chemical X and its major metabolites"). For in vitro studies, specify "direct treatment of cells."
  • Comparator (C): Define a consistent principle: "unexposed or vehicle controls" for experimental studies, and "lower exposure levels or background levels" for observational human studies.
• Develop a Tiered, Hierarchical Outcome Structure:
  • Outcomes (O): Avoid a single list. Instead, develop a tiered outcome hierarchy.
  • Tier 1 - Apical/Health Outcomes: List the primary health endpoints of regulatory concern (e.g., cancer, reproductive organ weight, offspring neurodevelopment).
  • Tier 2 - Supporting Intermediate Outcomes: List measurable biomarkers, pathological changes, or functional deficits that are recognized precursors to Tier 1 outcomes (e.g., serum hormone alteration, histopathological lesion in target tissue, genomic instability).
  • Tier 3 - Mechanistic/Key Events: List molecular initiating events and cellular responses established in the AOP (Adverse Outcome Pathway) framework (e.g., receptor binding, oxidative stress, specific gene expression changes).
  • The PECO should state that studies reporting outcomes in any tier are eligible for inclusion. This structure allows for data synthesis that links mechanistic events to apical outcomes, fulfilling the requirement to include cellular-level data [43].

Diagram: Tiered Outcome Hierarchy for PECO Integration

The Scientist's Toolkit: Essential Reagents & Materials

Table 4: Key Research Reagent Solutions for Ecotoxicity Assays Informing PECO Outcomes

Reagent/Material	Function in Ecotoxicity Research	Relevance to PECO Outcome Definition
Cell Line Panels (e.g., HepG2, MCF-7, primary hepatocytes)	In vitro model systems for assessing cytotoxicity, genotoxicity, and specific mechanistic endpoints (e.g., receptor activation, gene expression).	Studies using these reagents generate data on Tier 3 (Mechanistic) outcomes. Their inclusion in reviews is critical for understanding biological plausibility and early key events [43].
Enzyme-Linked Immunosorbent Assay (ELISA) Kits	Quantitative measurement of specific proteins in serum, tissue homogenates, or cell culture media (e.g., hormones, cytokines, stress response proteins).	Enables measurement of Tier 2 (Intermediate) outcomes like biomarker changes. PECO statements must include these biochemical alterations to capture sensitive toxicity signals [43].
Histopathology Stains & Reagents (e.g., H&E, special stains)	Used to prepare and evaluate tissue slides for morphological changes, inflammation, necrosis, and pre-neoplastic lesions.	The gold standard for identifying Tier 1 & 2 outcomes in animal studies (organ pathology). A core methodology for defining apical outcomes in the PECO.
Specific Chemical Analytes & Reference Standards	High-purity samples of the stressor of interest and its metabolites for use in dosing solutions, analytical calibration, and biomonitoring assay development.	Essential for accurately defining and quantifying the Exposure (E) element. Ensures studies measure the relevant agent, a prerequisite for correct inclusion under PECO.
AOP (Adverse Outcome Pathway)-Linked Assay Kits	Commercial kits designed to measure specific Key Events in established AOPs (e.g., assays for mitochondrial membrane potential, specific DNA adducts).	Directly link experimental results to a structured toxicity pathway. Including these Tier 3 outcomes in the PECO ensures the review can contribute to AOP-based assessment frameworks.

Within the framework of ecotoxicity systematic reviews (SRs), the accurate assessment and classification of exposure is a paramount challenge that directly influences the validity, reliability, and utility of the synthesized evidence. Misclassification of exposure—whether due to imprecise measurement tools, inappropriate surrogates, or poor study design—introduces significant bias, obscures true effect estimates, and undermines the foundation of evidence-based risk assessment [45]. The development and rigorous application of a structured PECO (Population, Exposure, Comparator, Outcome) statement is therefore critical [46]. This protocol provides detailed application notes and experimental methodologies for integrating robust exposure assessment into the SR process, with the overarching goal of minimizing misclassification and enhancing the transparency and reproducibility of ecological and human health risk evaluations [31] [47].

Foundational Protocol: Developing the PECO Statement

The PECO framework operationalizes the SR question into discrete, searchable components, providing the logical structure for all subsequent review stages [46] [48]. A precisely defined Exposure ("E") element is the primary defense against misclassification.

Protocol 2.1: Formulating the Exposure Component of the PECO Statement

• Objective: To define the exposure of interest with sufficient specificity to guide literature search, study selection, and data extraction, while minimizing the inclusion of studies with irrelevant or poorly characterized exposure metrics.
• Materials: Systematic review protocol template, access to chemical or stressor databases (e.g., EPA CompTox, PubChem), preliminary scoping search results.
• Methodology:
  • Exposure Agent Specification: Clearly identify the specific chemical agent (e.g., "acrolein" [46]), chemical class (e.g., "volatile organic compounds (VOCs)" [48]), or environmental stressor. For mixtures, define the components and rationale.
  • Exposure Metric Definition: Specify the quantitative or qualitative metrics required for study inclusion. This may include:
    • Measured Internal Dose: Biomonitoring data (e.g., plasma PFOS concentration [45]).
    • Estimated External Exposure: Air concentration (µg/m³), water concentration (mg/L), dietary intake (µg/kg-day) [45].
    • Surrogate Measures: Job title (e.g., "agricultural worker" [49]), proximity to pollution source. Note: Use of surrogates requires justification and must be addressed in risk of bias assessment.
  • Route, Duration, and Timing: Define the relevant routes of exposure (inhalation, oral, dermal), duration categories (acute, subchronic, chronic) [46], and, for human studies, critical life stages (e.g., prenatal [47]).
  • Comparator Definition: Explicitly define the comparator condition (e.g., "low or no exposure," "exposure below a specified threshold," "placebo treatment") [48].
  • Piloting and Refinement: Test the drafted PECO statement against a sample of known key studies. Refine the criteria to ensure they capture all relevant studies without being overly broad [31].

Table 1: PECO Framework Components and Examples from Ecotoxicity Research

PECO Element	Definition	Example 1: Air Toxics [46]	Example 2: Occupational Health [48]
Population	The organisms or systems under study.	Laboratory rats (Rattus norvegicus); Human populations.	Adult workers in industrial settings.
Exposure	The specific agent, metric, route, and duration.	Inhalation exposure to acrolein at quantifiable concentrations (ppm).	Occupational inhalation exposure to volatile organic compounds (VOCs).
Comparator	The alternative against which exposure is compared.	Clean air or exposure below the limit of detection.	Workers with low or no occupational VOC exposure.
Outcome	The measured health or ecological endpoint.	Histopathological lesions in nasal respiratory epithelium; Decreased respiratory rate.	Sleep problems (insomnia, poor sleep quality, disorders).

Core Application Notes & Experimental Protocols

Protocol for Systematic Extraction of Exposure Assessment Data

A standardized data extraction form is essential for consistent capture and later comparison of exposure data across studies [32] [50].

Protocol 3.1.1: Exposure-Specific Data Extraction

• Objective: To systematically collect all exposure-related information from included studies to enable classification, comparison, and bias assessment.
• Materials: Pre-piloted data extraction form (electronic recommended, e.g., in Covidence, Excel [32]), full-text articles, instruction manual for extractors.
• Methodology:
  • Dual Independent Extraction: Two reviewers independently extract data from each study to minimize error [32]. Discrepancies are resolved by consensus or a third reviewer.
  • Extract Core Study Information: Author, year, DOI, study design (e.g., cohort, case-control, experimental) [48] [50].
  • Extract Population Details: Species, strain, sample size, age, sex, relevant demographics (for human studies) [32].
  • Extract Exposure-Specific Data: Populate fields as defined in Table 2.
  • Extract Outcome Data: Record outcome measures, effect estimates (e.g., odds ratio, mean difference), confidence intervals, and sample sizes [47] [48].

Table 2: Key Exposure Data Extraction Fields

Data Field	Description & Options	Purpose in Misclassification Analysis
Exposure Assessment Method	Biomonitoring [45] [49], environmental monitoring, modeled estimates, self-report, job title surrogate [48].	To categorize study precision; direct biomonitoring is typically less prone to misclassification than surrogates.
Analytical Technique	e.g., UHPLC-ESI-MS/MS [45], GC-MS, immunoassay.	To assess the reliability and sensitivity of exposure quantification.
Biological/Environmental Matrix	Plasma, urine, air, water, soil, diet.	To understand the exposure pathway and pharmacokinetics.
Temporal Detail	Exposure timing relative to outcome, number of sampling events, period over which exposure is integrated.	To assess temporal alignment between exposure and biological effect, a source of misclassification.
Quantification Metrics	Mean/median concentration, range, dose, LOD/LOQ, units.	For quantitative synthesis and comparison across studies.
Exposure Classification	How categories (e.g., quartiles, high/low) were derived from continuous data.	To identify potential misclassification from arbitrary or non-biologically based category cut-points.

Protocol for Assessing Risk of Bias in Exposure Assessment

The Risk of Bias (RoB) assessment must specifically evaluate the exposure measurement component [47] [48].

Protocol 3.2.1: Evaluating Exposure Measurement Bias

• Objective: To appraise the methodological quality of exposure assessment in each included study and identify the potential direction and magnitude of resulting bias.
• Materials: RoB assessment tool (e.g., ROBINS-E [48]), completed exposure data extraction forms.
• Methodology:
  • Select Appropriate Tool: For non-randomized studies of exposures, use ROBINS-E or similar [48]. For experimental animal studies, adapt tools like the SYRCLE's RoB tool.
  • Focus on Exposure Domains:
    • Bias due to Confounding: Did the study control for key confounders related to both exposure and outcome?
    • Bias in Selection of Participants: Could selection procedures be related to both exposure and outcome?
    • Bias in Classification of Exposures: This is the core domain for misclassification. Evaluate:
      • Was exposure assessed in a way that likely produced correct classification? (e.g., validated biomonitoring vs. recall [45])
      • Was exposure assessment consistent for all participants?
      • Were exposure assessors blinded to outcome status (or vice versa)?
  • Judgment and Signaling: For each domain, judge RoB as "Low," "Moderate," "Serious," or "Critical." Support judgments with direct quotes or details from the study [48].
  • Sensitivity Analysis Plan: Use the RoB judgments to plan analyses testing how excluding studies with "Serious" or "Critical" RoB in exposure classification affects the overall results [47].

The Scientist's Toolkit: Research Reagent Solutions

Table 3: Essential Materials for Advanced Exposure Assessment

Item / Reagent	Function in Exposure Assessment	Application Notes
Certified Reference Materials (CRMs)	Calibrants for analytical equipment to ensure accurate quantification of target analytes in biological or environmental samples [45].	Essential for biomonitoring studies. Use matrix-matched CRMs when possible.
Stable Isotope-Labeled Internal Standards	Added to samples prior to extraction to correct for analyte loss during sample preparation and instrument variability [45].	Crucial for high-precision methods like UHPLC-MS/MS for PFAS, pesticides [45] [49].
Passive Sampling Devices	Time-integrated collection of environmental contaminants (e.g., in air, water) for a more representative exposure estimate than grab samples.	Reduces misclassification from temporal variability in environmental concentrations.
Multiplex Assay Kits	Simultaneous measurement of multiple biomarkers of effect (e.g., oxidative stress, inflammation) from a single sample [49].	Links internal exposure to early biological effects, strengthening causal inference.
DNA/RNA Stabilization Reagents	Preserve genetic material for analysis of epigenetic or transcriptomic biomarkers of exposure and effect [49].	Enables investigation of novel molecular biomarkers for sensitive exposure assessment.
Software for Physiologically Based Toxicokinetic (PBTK) Modeling	Simulates the absorption, distribution, metabolism, and excretion of chemicals to relate external exposure to internal dose.	Used to reconcile different exposure metrics across studies and reduce misclassification in cross-study synthesis.

Strategies for Evaluating Study Sensitivity and Utility Within the PECO Framework

The PECO framework (Population, Exposure, Comparator, Outcome) is the foundational structure for formulating precise research questions in environmental health and ecotoxicity systematic reviews [9]. A well-constructed PECO statement defines the review's objectives, guides the search for evidence, and establishes criteria for study inclusion [9]. Beyond this organizational role, the specific formulation of the PECO question directly influences the subsequent evaluation of the evidence base, particularly the assessment of a study's ability to detect a true effect—a concept known as study sensitivity [9] [51].

In the context of a broader thesis on PECO development for ecotoxicity reviews, evaluating sensitivity and utility is not an ancillary step but a critical, protocol-driven process. It moves beyond traditional risk of bias assessment (which focuses on internal validity and systematic error) to ask: "Is this study capable of detecting a true hazard, if one exists?" [51] [52]. An insensitive study may yield false-negative results, erroneously suggesting an exposure is safe. Therefore, integrating sensitivity assessment with PECO ensures that the review question is answered by the most informative evidence, distinguishing between a true lack of effect and a failure to detect one [51].

This document provides detailed application notes and protocols for integrating the evaluation of study sensitivity and utility into the systematic review workflow, framed explicitly by the PECO framework.

Foundational Framework: How PECO Informs Sensitivity and Utility Evaluation

The PECO statement is not a static starting point but a dynamic guide that shapes the evaluation phase. The formulation of the 'E' (Exposure) and 'C' (Comparator) components is especially critical for defining what constitutes a sensitive and useful study [9].

Different PECO scenarios necessitate different evaluation criteria for sensitivity. The literature outlines paradigmatic PECO question types relevant to environmental health [9]:

Table 1: PECO Scenarios and Corresponding Sensitivity Evaluation Priorities

PECO Scenario & Objective	Example (Hearing Impairment)	Key Sensitivity Evaluation Focus
1. Explore dose-effect relationship [9]	Among newborns, what is the incremental effect of a 10 dB increase in gestational noise exposure on postnatal hearing impairment?	Adequate range and gradation of exposure levels within the study population. Precision in exposure quantification.
2. Evaluate effect of data-driven exposure cut-offs [9]	Among newborns, what is the effect of the highest vs. lowest dB exposure (e.g., top vs. bottom quartile) during pregnancy?	Whether the study population's exposure distribution provides sufficient spread to meaningfully compare defined groups.
3. Evaluate association using externally defined cut-offs [9]	Among pilots, what is the effect of occupational noise exposure vs. exposure in other occupations?	Relevance of the study's exposure classification to the external comparator. Appropriateness of the referent group.
4. Identify exposure level that ameliorates effects [9]	Among workers, what is the effect of exposure to <80 dB vs. ≥80 dB on hearing impairment?	Proximity of study exposure levels to the threshold of interest (e.g., 80 dB). Sufficient sample size around the cut-point.
5. Evaluate effect of an intervention to reduce exposure [9]	Among the public, what is the effect of an intervention reducing noise by 20 dB vs. no intervention?	Ability of the study design to isolate the intervention's effect and measure the change in exposure accurately.

This relationship between PECO development and subsequent sensitivity assessment forms a logical workflow, illustrated below.

Diagram 1: From PECO to Evidence Evaluation Workflow

Defining and Evaluating Study Sensitivity

The Concept of Study Sensitivity

Study sensitivity is defined as the measure of a study's ability to detect a true effect or hazard if it exists [51]. It is analogous to the sensitivity of a diagnostic test. An insensitive study, due to limitations in design, exposure assessment, or population, may fail to show a difference that truly exists, leading to potentially false-negative conclusions [51]. This concept is distinct from, though complementary to, risk of bias (which concerns systematic error leading to inaccurate effect estimates) [52].

Core Domains for Sensitivity Evaluation

The evaluation of sensitivity should be systematic and domain-based. The specific domains differ slightly for human epidemiological studies and animal toxicology studies, reflecting the nature of the research [51] [52].

Table 2: Domains for Evaluating Study Sensitivity

Domain	Description & Relevance to Sensitivity	Application Notes for Ecotoxicity Reviews
Exposure Characterization	Adequacy of exposure level, timing, duration, and frequency relative to the etiologically relevant window [51].	For ecotoxicity, consider: chemical speciation, bioavailability in the test medium (e.g., water hardness, sediment organic carbon), and exposure route fidelity (dietary, waterborne, dermal).
Exposure Contrast	Sufficient range or gradient of exposure within the study to detect a dose-response [51].	Evaluate the magnitude of difference between comparator groups. A study comparing two high, supra-environmental doses may lack sensitivity to detect low-dose effects relevant to real-world scenarios.
Outcome Assessment	Use of sensitive, specific, and biologically relevant endpoints [51].	Assess if endpoints are apical (e.g., mortality, reproduction) or sub-organismal (e.g., enzyme activity, gene expression). Earlier, more sensitive biomarkers may detect effects at lower exposures but require validation.
Temporal Relationships	Appropriate latency between exposure and outcome measurement [51].	For chronic ecotoxicity, was the exposure duration and post-exposure observation period sufficient for delayed effects (e.g., carcinogenicity, multi-generational impacts) to manifest?
Statistical Power & Precision	Sample size adequate to detect a biologically meaningful effect size [51].	Small sample sizes are common in animal toxicology. Evaluate if the study had adequate power or if confidence intervals around the null effect are wide, indicating imprecision.
Model/System Relevance	(Primarily for animal studies) Appropriateness of the animal model, test species, or in vitro system to the PECO population [51].	Does the test species share relevant toxicokinetic or metabolic pathways with the ecosystem receptor of interest? Is the life stage tested (e.g., larval, adult) appropriate?

Protocol for Sensitivity Evaluation: A Stepwise Approach

The following protocol should be specified a priori in the systematic review protocol.

• Define Sensitivity Criteria: Based on the PECO question, explicitly list the factors that would make a study sensitive or insensitive for your review. For example: "For the PECO examining the effect of chronic low-dose Chemical X on fish reproduction, sensitive studies will be those with exposure durations covering at least one full reproductive cycle, measured aqueous concentrations below 1 mg/L, and endpoints such as fecundity or gonadosomatic index."
• Develop an Evaluation Tool: Adapt an existing risk of bias/study evaluation tool (e.g., SciRAP, OHAT approach) to include domains for sensitivity [52]. Use a structured rubric (e.g., "Critically Deficient," "Deficient," "Adequate," "Good") for each domain.
• Conduct Independent Dual Review: At least two reviewers should independently apply the evaluation tool to each included study [52] [32]. Discrepancies should be resolved by consensus or third-party adjudication.
• Generate an Overall Confidence Rating: Combine judgments from risk of bias and sensitivity domains to arrive at an overall study confidence rating (e.g., High, Medium, Low, Uninformative) [52]. The handbook for the U.S. EPA's IRIS program notes that studies rated as "uninformative" due to critical deficiencies in sensitivity or bias are often excluded from further synthesis [52]. This decision must be transparently documented.
• Use Ratings to Inform Synthesis: High-confidence studies should carry more weight in evidence synthesis. The pattern of sensitivity limitations across studies should be used to explain heterogeneity and interpret null findings [51].

Protocols for Quantitative Synthesis (Meta-Analysis) and Sensitivity

When studies are sufficiently homogeneous, meta-analysis provides a quantitative consensus of effect size [53]. The choice of meta-analytic model is crucial and depends on the assessment of heterogeneity, which is influenced by variations in study sensitivity and design.

Key Meta-Analysis Models and Selection Criteria

Table 3: Meta-Analysis Model Selection Protocol

Model	Core Assumption	When to Use	Consideration for Sensitivity
Fixed-Effect Model [53]	The true effect size is identical (fixed) across all studies. Observed variance is due solely to sampling error within studies.	When studies are methodologically uniform (e.g., same test guideline, species, endpoint) and statistical heterogeneity is low (I² < 25-30%).	Caution: This model gives more weight to larger, more precise studies. If larger studies have systematic sensitivity flaws (e.g., poor exposure control), the pooled estimate may be biased.
Random-Effects Model [53]	The true effect size varies across studies (due to real differences in populations, exposures, etc.). It estimates the mean of a distribution of effects.	When clinical or methodological diversity is expected, or when statistical heterogeneity is present (I² > 30%). This is common in ecotoxicity reviews.	More appropriate when sensitivity factors (e.g., exposure concentration, test species) vary across studies. It inherently accounts for this variance, producing wider confidence intervals.
Quality-Effect Model [53]	Extends the random-effects model by incorporating a quality score (e.g., from risk of bias/sensitivity assessment) as an additional weight.	When study quality/confidence varies significantly and the goal is to explicitly down-weight less reliable studies in the pooled estimate.	Directly integrates sensitivity evaluation. Allows studies with higher overall confidence (low bias, high sensitivity) to contribute more to the summary effect.

Stepwise Meta-Analysis Protocol for Ecotoxicity Data

• Calculate Effect Sizes: For continuous data (e.g., growth, enzyme activity), calculate the standardized mean difference (SMD) or response ratio. For binary data (e.g., mortality, incidence), calculate the risk ratio or odds ratio.
• Assess Heterogeneity: Compute Cochran's Q statistic and the I² statistic. I² values of 25%, 50%, and 75% are typically interpreted as low, moderate, and high heterogeneity, respectively [53].
• Select Model: Based on I² and qualitative judgment of study similarity (guided by PECO), choose between fixed- and random-effects models. Pre-specify the use of a quality-effect model if intended.
• Execute Analysis & Generate Forest Plot: Perform the meta-analysis to produce a weighted summary effect estimate with a confidence interval. Visualize individual study effects and the summary effect in a forest plot.
• Conduct Sensitivity Analyses: Re-run the meta-analysis excluding studies rated as "Low" confidence or those with specific sensitivity flaws (e.g., all studies using a less relevant test species). This tests the robustness of the pooled result.

The decision pathway for model selection is visualized below.

Diagram 2: Meta-Analysis Model Selection Protocol

The Scientist's Toolkit: Essential Research Reagent Solutions

Implementing the above protocols requires specific tools and materials. The following table details key "research reagent solutions" for conducting systematic reviews with integrated sensitivity evaluation.

Table 4: Essential Toolkit for PECO-Driven Sensitivity Evaluation

Tool / Resource Category	Specific Item or Platform	Function in Sensitivity/Utility Evaluation
Systematic Review Management [32]	Covidence, Rayyan, DistillerSR	Platforms to manage screening, dual independent data extraction, and consensus resolution. Essential for applying sensitivity evaluation rubrics consistently across reviewers.
Study Evaluation Frameworks	SciRAP (Science in Risk Assessment and Policy) tool, OHAT (Office of Health Assessment and Translation) tool, IRIS Handbook methods [52]	Provide structured domains and criteria for evaluating risk of bias, sensitivity, and reporting quality in animal and human studies. Can be adapted for ecotoxicity.
Data Extraction Tools [32]	Custom forms in Covidence, Microsoft Excel, Google Sheets, REDCap	Enable standardized collection of study details critical for sensitivity judgment (e.g., exposure metrics, sample size, endpoint details). Spreadsheets allow for pilot testing and revision of extraction forms.
Meta-Analysis Software	R (with metafor, meta packages), RevMan, Comprehensive Meta-Analysis	Perform statistical synthesis, calculate heterogeneity metrics (I²), implement fixed-, random-, and quality-effect models, and generate forest plots.
Exposure/ECOTOX Database	ECOTOXicology knowledgebase (EPA), EnviroTox	Curated databases of ecotoxicity test results. Useful for understanding typical exposure ranges, sensitive species, and common endpoints to inform sensitivity criteria during PECO development.
Reporting Guidelines	PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses), ROSES (RepOrting standards for Systematic Evidence Syntheses)	Checklists to ensure transparent reporting of the review process, including how study evaluation (sensitivity/bias) was conducted and how it influenced synthesis.

This document provides detailed application notes and protocols for integrating traditional animal model data with evidence generated from New Approach Methodologies (NAMs) within ecotoxicity systematic reviews. Framed within the imperative to develop robust PECO (Population, Exposure, Comparator, Outcome) statements, the content addresses the methodological bridge required for a modern, evidence-based safety assessment paradigm. NAMs—encompassing in vitro, in chemico, and in silico methods—offer human-relevant, mechanistic data but are often validated against traditional animal studies, which themselves show variable predictivity for human outcomes (40-65% true positive rate) [54] [55]. Successful integration, as demonstrated in Defined Approaches for skin sensitization or eye irritation [54], requires transparent frameworks. This guide details protocols for generating and synthesizing multi-source evidence, anchored by precise PECO formulation, to support Next Generation Risk Assessment (NGRA) and fulfill the 3Rs (Replacement, Reduction, Refinement) principles in ecotoxicology [54] [56].

Comparative Analysis of Evidence Streams for Ecotoxicity Assessment

The integration of diverse evidence streams requires an understanding of their respective strengths, limitations, and roles within a systematic review. The following table summarizes key characteristics of data derived from animal models and various NAM categories.

Table 1: Characteristics of Evidence Streams for Ecotoxicity Systematic Reviews

Evidence Stream	Typical Data Outputs	Key Strengths	Inherent Limitations	Primary Role in PECO-Based Review
Traditional Animal Models (e.g., fish, rodent, avian tests) [22] [55]	Apical endpoints (mortality, growth, reproduction), LO(A)EL, NO(A)EL, dose-response curves.	Whole-organism systemic responses; historical regulatory acceptance; extensive curated databases (e.g., ECOTOX) [22].	Species extrapolation uncertainty; high cost & time; ethical concerns; mechanistic opacity; inter-study variability [54] [55].	Often defines the Outcome (O) in PECO; provides benchmark data for validating NAMs [55].
In Vitro & In Chemico NAMs (2D/3D cultures, organoids, MPS) [54] [56]	Cell viability, gene/protein expression (omics), functional assay readouts, pathway perturbation.	Human/environmental species-relevant cells; high-throughput; mechanistic insight (MIEs, KEs); supports 3Rs [54] [57].	Limited metabolic complexity; may not capture systemic toxicity or organism-level adaptation [54].	Informs Exposure (E) bioactivity and mechanism; can refine Population (P) to specific taxonomic systems.
In Silico NAMs (QSAR, read-across, PBPK, ML/AI models) [57] [58]	Predicted toxicity values, physicochemical properties, metabolic fate, analogue identification.	Rapid, low-cost screening; handles data-poor chemicals; enables in vitro to in vivo extrapolation (IVIVE) [58].	Dependent on quality/quantity of input data; validation challenges for novel chemistries [57].	Supports Exposure (E) characterization and grouping; identifies data gaps for Comparator (C) levels.
Integrated Approaches (IATA, AOP-based DAs) [54] [24]	Weight-of-evidence conclusions, risk-based classifications, integrated testing strategies.	Structured, transparent synthesis of multiple lines of evidence; tailored to specific regulatory questions [54].	Require predefined data interpretation procedures (DIPs); regulatory acceptance still evolving [57].	Provides the logical framework for integrating all PECO elements into a coherent assessment.

PECO Framework for Evidence Integration in Systematic Reviews

A well-formulated PECO statement is the critical first step in a systematic review, defining the boundaries for evidence search, inclusion, and synthesis [9]. When integrating animal and NAM data, the PECO must be constructed to accommodate diverse study designs.

Formulating PECO for Multi-Source Evidence Synthesis

The formulation must move beyond a simple association question to one that guides evidence integration [9]. For ecotoxicity reviews, this involves explicit definitions.

• Population (P): Define the organism of regulatory concern (e.g., Danio rerio). The PECO must also specify if in vitro systems (e.g., zebrafish liver (ZFL) cell line) derived from that organism are considered as proxy evidence for mechanistic events within the same taxonomic P [24].
• Exposure (E): Specify the chemical agent, its form, and the exposure metric. For animal studies, this is typically administered dose (e.g., mg/kg). For in vitro NAMs, it is the concentration in the medium (e.g., µM). For in silico models, it may be a predicted physicochemical property (e.g., log K_ow) [58]. The PECO must explicitly state if different exposure metrics across study types are to be reconciled (e.g., via IVIVE/PBPK modeling).
• Comparator (C): This is often the most challenging element. It can be a true negative control (vehicle), a low/background exposure level, or a relevant benchmark chemical [9]. When integrating NAMs and animal data, the C may involve comparing the effect of a test chemical to the effect of a "tool" compound with a known mechanism in the same assay system.
• Outcome (O): Define the adverse effect. In animal studies, this is typically an apical endpoint (e.g., reduced fecundity). In NAMs, this is a key event (KE) within an Adverse Outcome Pathway (AOP) (e.g., activation of the aryl hydrocarbon receptor, a molecular initiating event linked to reproductive toxicity) [24]. The PECO should articulate the hypothesized biological or logical link between the NAM-based KE and the apical O.

PECO Scenarios for Integrating Animal Models and NAMs

Adapting the framework from [9], here are targeted PECO scenarios for integrated reviews:

Scenario 1: Exploring an Association & Mechanistic Link

• Context: Initial review of a data-poor chemical.
• Integrated PECO Example: "In freshwater fish (P), does exposure to Chemical X (E), compared to unexposed controls (C), lead to impaired embryonic development (O), and is this outcome associated with the activation of the retinoid signaling pathway as measured in relevant fish in vitro models?"

Scenario 2: Evaluating a Defined Approach for Hazard Identification

• Context: Validating a NAM-based testing strategy against traditional animal data.
• Integrated PECO Example: "For the purpose of classifying skin sensitization hazard, does a Defined Approach (OECD TG 497) integrating in chemico and in vitro NAMs (E), compared to the murine Local Lymph Node Assay (C), correctly identify the hazard potential for a suite of organic chemicals in the context of human health risk assessment (O) [54]?"

Scenario 3: Identifying a Point of Departure (POD) using Integrated Evidence

• Context: Deriving a protective POD for risk assessment using all available evidence.
• Integrated PECO Example: "For human health risk assessment of Compound Y, what is the POD (O) derived from an integrated assessment of high-throughput transcriptomic data in human hepatocytes, in silico toxicity predictions, and traditional 28-day rat oral toxicity studies, considering all relevant exposure durations and routes (E) and compared to estimated human internal exposures (C)?"

Detailed Experimental Protocols for Evidence Generation

Protocol: Conducting a Standard Fish Embryo Acute Toxicity (FET) Test (OECD 236)

This traditional ecotoxicity assay provides apical endpoint data to anchor an integrated assessment [22].

1. Objective: To determine the lethal and sublethal effects of a chemical substance on embryonic stages of zebrafish (Danio rerio). 2. Materials: * Zebrafish embryos (< 5 hours post-fertilization, hpf). * Test chemical solution of known concentration. * Standard reconstituted water (ISO or ASTM). * 24-well microplates. * Stereomicroscope with digital imaging. * Temperature-controlled incubator (26 ± 1°C). 3. Procedure: * Exposure Setup: Randomly place 20 healthy embryos per well (one embryo per well) in 2 mL of test solution or control medium. Prepare at least five concentrations in a geometric series and a minimum of four replicates per concentration. * Incubation: Maintain plates in darkness at 26 ± 1°C for 96 hours. * Observations: At 24, 48, 72, and 96 hpf, microscopically observe and record: a) Lethality: Coagulation, lack of somite formation, non-detachment of the tail. b) Sublethal Endpoints: Lack of heartbeat, failure to hatch, pericardial edema, yolk sac edema, spinal malformations. * Data Analysis: Calculate the LC₅₀ (median lethal concentration) and EC₅₀ for significant sublethal effects using probit or non-linear regression. Report the No Observed Effect Concentration (NOEC) and Lowest Observed Effect Concentration (LOEC) where applicable.

Protocol: High-Content Screening (HCS) for Developmental Neurotoxicity (DNT) in a 3D Human Neural Sphere Model

This NAM protocol provides mechanistic, human-relevant data on a complex systemic endpoint [56].

1. Objective: To identify chemicals that disrupt key neurodevelopmental processes (neurite outgrowth, cell migration, synaptogenesis) in a high-throughput, human in vitro model. 2. Materials: * Human induced pluripotent stem cell (iPSC)-derived neural progenitor cells (NPCs). * Matrigel or similar extracellular matrix. * ​​96-well ultra-low attachment spheroid microplates. * Neural differentiation media. * Test chemical library prepared in DMSO. * Automated liquid handler. * High-content imaging system (confocal or spinning disk). * Live-cell fluorescent dyes (e.g., Calcein-AM for viability, antibodies for βIII-tubulin/Tuj1, MAP2, Synapsin). * Image analysis software (e.g., CellProfiler, Harmony). 3. Procedure: * Sphere Formation: Seed NPCs into spheroid microplates at 5,000 cells/well in differentiation media. Centrifuge briefly to aggregate cells and form spheres. Culture for 7 days. * Chemical Exposure: On day 7, using an automated liquid handler, transfer spheres to Matrigel-coated imaging plates and treat with test chemicals across a 6-point concentration range (n=6 spheres per concentration). Include vehicle (DMSO) and positive control (e.g., valproic acid) wells. * Endpoint Staining & Fixation: At assay endpoint (e.g., day 14), stain live spheres with Calcein-AM, then fix, permeabilize, and immunostain for neuronal and synaptic markers. * Image Acquisition & Analysis: Automatically acquire z-stack images for each well. Use analysis pipelines to quantify: a) Sphere Viability: Sphere volume and intensity of Calcein-AM signal. b) Neurite Outgrowth: Total neurite length per sphere and number of neurite branches. c) Synapse Density: Puncta count of synapsin signal colocalized with neuronal markers. * Data Analysis: Generate concentration-response curves for each endpoint. Calculate benchmark concentrations (BMCs) for a defined level of effect (e.g., 10% decrease in neurite length) using appropriate models. Data can be integrated into an AOP network for DNT [24].

Protocol:In SilicoRead-Across and QSAR Prediction for Ecotoxicity Endpoints

This protocol fills data gaps and groups chemicals for assessment [58].

1. Objective: To predict the acute aquatic toxicity of a target chemical with no empirical data using read-across and QSAR models. 2. Materials: * Target chemical structure (SMILES or CAS number). * QSAR software (e.g., OECD QSAR Toolbox, VEGA, EPA T.E.S.T.). * Access to curated ecotoxicity databases (e.g., ECOTOX [22]). * Chemical category definition criteria (e.g., common functional group, mode of action). 3. Procedure: * Data Gap Identification: Confirm the absence of reliable experimental fish acute toxicity data (e.g., 96h LC₅₀) for the target chemical. * Analogue Identification: a) Use the QSAR Toolbox to profile the target chemical for its likely mechanism of toxicity (e.g., narcosis, electrophilicity). b) Perform a similarity search based on structural fingerprints and physicochemical properties (e.g., log K_ow, molecular weight). c) Identify 3-5 candidate analogues with high structural similarity and reliable experimental fish LC₅₀ data. * Justification and Categorization: Document the scientific rationale for the category (shared functional group, metabolic pathway, and hypothesized common Mode of Action (MoA)). Assess and address any key differences between target and source analogues. * Toxicity Prediction: a) Read-Across: Propose a predicted toxicity value for the target chemical based on the experimental data of the analogues (e.g., geometric mean, most conservative value). Provide an assessment of uncertainty. b) QSAR: Run the target chemical structure through multiple, validated QSAR models for fish acute toxicity. Apply the models within their defined applicability domains. * Weight-of-Evidence Conclusion: Synthesize predictions from read-across and multiple QSAR models into a final, justified prediction with a clear statement of confidence and uncertainty for use in the integrated assessment.

Visualization of Methodological and Conceptual Frameworks

Diagram: Workflow for PECO-Driven Systematic Review with Integrated Evidence

Title: Systematic Review Workflow with Integrated Evidence

Diagram: Conceptual Integration via the Adverse Outcome Pathway (AOP) Framework

Title: Evidence Integration via the AOP Framework

This table details key materials and resources for executing the integrated protocols described.

Table 2: Research Reagent Solutions for Integrated Ecotoxicity Studies

Item/Category	Example(s) / Supplier	Primary Function in Integrated Protocols
Reference Ecotoxicity Database	ECOTOX Knowledgebase (US EPA) [22]	Provides curated in vivo toxicity data for benchmarking NAMs, identifying analogues for read-across, and contextualizing findings within existing literature.
Standard Test Organisms	Zebrafish (Danio rerio) embryos, Daphnids (Ceriodaphnia dubia), Fathead minnow (Pimephales promelas).	Provide apical endpoint data from standardized tests (e.g., OECD, ASTM) for PECO Outcome (O) and validation of NAM predictions.
Validated Cell Lines & iPSCs	ZFL (Zebrafish Liver) cell line, RTgill-W1 (Rainbow trout gill), Human iPSC-derived neural progenitors [56].	Enable species-specific or human-relevant in vitro testing for mechanistic key events, supporting Exposure (E) bioactivity assessment.
Extracellular Matrix for 3D Models	Matrigel, Geltrex, synthetic PEG-based hydrogels.	Supports formation of complex 3D cultures (spheroids, organoids) that better mimic tissue physiology for NAM assays.
High-Content Screening Assay Kits	Multiplex viability/cytotoxicity kits, fluorescent dyes for calcium flux, mitochondrial membrane potential.	Allow simultaneous measurement of multiple mechanistic endpoints in NAMs, generating rich datasets for pathway analysis.
QSAR & Read-Across Software	OECD QSAR Toolbox, VEGA, EPA T.E.S.T., Leadscope Model Applier [58].	Facilitate in silico prediction of toxicity and grouping of chemicals for assessment, identifying data gaps and informing testing strategies.
AOP Knowledgebase	AOP-Wiki (OECD)	Provides the structured, mechanistic framework for linking NAM data (MIEs, KEs) to apical Outcomes (O) of regulatory concern.
Systematic Review Management Software	DistillerSR, Rayyan, Covidence	Supports transparent and efficient management of the review process, from literature screening to data extraction, as per PECO protocol.

Within the context of a thesis on PECO (Population, Exposure, Comparator, Outcome) statement development for ecotoxicity systematic reviews, the process of iterative refinement is not merely a procedural adjustment but a scientific necessity. Systematic review methodologies, originally developed for clinical medicine, often require adaptation to address the complex, exposure-driven questions central to environmental health and chemical risk assessment [7]. An iterative approach, where the initial PECO criteria and review protocol are deliberately revisited and updated based on insights gained from evidence mapping, ensures that the final review is both scientifically rigorous and efficiently targeted to answer the most relevant risk assessment questions [5] [59].

Evidence mapping, or systematic evidence mapping (SEM), serves as the critical feedback mechanism in this process. It is a methodology for systematically searching, cataloging, and characterizing the breadth of available evidence on a broad topic [60] [61]. Unlike a full systematic review focused on synthesis, an SEM visualizes the distribution, quantity, and key features of research (e.g., study designs, exposures, outcomes) [60]. For ecotoxicity reviews, this early visualization can reveal that the initial PECO criteria may be too broad (yielding an unmanageable volume of low-relevance studies), too narrow (excluding relevant evidence streams), or misaligned with the actual patterns in the literature [59]. For instance, an initial screen may show a preponderance of studies using a chemical as a high-dose positive control for a specific disease model, which adds little value for a low-dose point-of-departure assessment and justifies a protocol refinement to exclude such studies [59].

This document provides detailed application notes and protocols for implementing this iterative refinement, drawing from established frameworks in regulatory toxicology and contemporary discussions on "right-sizing" systematic reviews [5] [59] [7].

Methodological Framework and Comparative Analysis

The integration of iterative refinement into the systematic review workflow is best guided by a structured framework. The following Integrated Framework for Iterative Evidence Synthesis in Risk Assessment adapts established models to emphasize the cyclical relationship between problem formulation, evidence mapping, and protocol development [5] [7].

Iterative Evidence Synthesis for Risk Assessment

Diagram 1: Workflow for iterative refinement based on evidence mapping.

The decision to refine (Step 4) is informed by a quantitative and qualitative analysis of the SEM results. Key indicators for refinement are summarized in the table below.

Table 1: Indicators for PECO and Protocol Refinement Based on Evidence Mapping Analysis

Indicator from SEM Analysis	Potential Implication for PECO/Protocol	Recommended Refinement Action
Volume & Manageability: An order of magnitude more references than anticipated are retrieved for a specific PECO element [59].	Scope is too broad, risking resource exhaustion and loss of focus.	Narrow the Population (e.g., specific life stage), Exposure (e.g., specific relevant route), or Outcome (e.g., critical apical endpoint only).
Evidence Gaps: Little to no literature exists for a key exposure scenario or comparator in the initial PECO.	Review may not be feasible or would yield an inconclusive answer.	Broaden the Exposure definition (e.g., include analog chemicals) or adjust the Comparator (e.g., compare to background instead of a specific control).
Evidence Clusters & Relevance: A high density of studies is found on a specific, narrow model (e.g., high-dose disease induction) that is not directly relevant to the risk assessment objective [59].	Included studies may bias or dilute the analysis without adding insight.	Modify Exposure (e.g., add dose-range filter) or Study Design eligibility criteria in the protocol to explicitly exclude tangential research.
Stream Imbalance: Vast majority of evidence is from a single evidence stream (e.g., in vitro), with limited in vivo or epidemiological data.	The review's applicability to hazard identification may be limited.	Stratify the approach: Plan separate synthesis/analysis for different evidence streams and explicitly characterize confidence accordingly.
Terminology Evolution: SEM reveals that key outcomes are reported using heterogeneous or outdated terminology.	Relevant studies will be missed during screening.	Update search strategy and Outcome definition in PECO to include synonymous terms identified in the SEM.

The practical application of this framework varies based on the specific review context. The following table compares two prominent approaches for environmental health reviews.

Table 2: Comparison of Iterative Evidence Synthesis Frameworks for Ecotoxicity Reviews

Feature	EPA IRIS Assessment Handbook Approach [5]	Adaptive Risk Assessment Framework [7]	Application in Iterative Refinement
Primary Goal	Develop human health hazard and dose-response assessments for chemicals.	Facilitate chemical risk assessment using evidence-based methods.	Both provide a structured rationale for updating protocols based on evidence mapping.
Role of SEM	Called a "systematic evidence map" or "literature inventory"; a key milestone for scoping and informing hazard identification [5].	A central step to "identify and categorize available evidence" before committing to full systematic review [7].	The SEM is the primary source of data driving the refinement decision.
Key Strength	Employs sophisticated, state-of-the-art methods and is a model for systematic review within EPA [5].	Explicitly incorporates exposure considerations (e.g., dose-relevance, route) into study selection and evaluation [7].	Ensures PECO refinement is grounded in both evidence availability and risk assessment relevance.
Iterative Emphasis	Notes the iterative nature of steps but recommends handbook improvements to better depict this flow [5].	Proposes a stepwise but adaptive process where problem formulation may be revisited [7].	Directly supports the concept of an "iterative problem formulation based on results in initial screens" [59].
Output for Refinement	Informs the development and refinement of the "draft assessment protocol" [5].	Directly guides the selection of studies for quantitative risk characterization [7].	The refined PECO becomes the stable foundation for the definitive systematic review.

Detailed Experimental Protocols

Protocol for Conducting a Systematic Evidence Map (SEM) to Inform Refinement

This protocol is adapted from established methods for SEM in environmental health [60] [61].

Objective: To systematically identify, categorize, and visualize the available literature on a broad chemical/outcome question to inform the refinement of a subsequent systematic review's PECO criteria and protocol.

Methods:

• Pre-SEM Planning:
  • Form a team including a subject-matter expert, information specialist, and data analyst.
  • Draft a broad initial PECO to guide the SEM search.
  • Register the SEM protocol in a public repository (e.g., Open Science Framework) to ensure transparency [5].

• Search Strategy:

  • Databases: Search multiple relevant databases (e.g., PubMed, Web of Science, Scopus, Embase, specialized toxicology databases).
  • Search String: Develop a sensitive search string using terms for the chemical/exposure class and broad outcome domains (e.g., "neurotoxicity," "hepatic effects"). Do not apply stringent study design filters at this stage.
  • Grey Literature: Include sources of grey literature (e.g., government reports, thesis databases) as appropriate [5].

• Screening & Categorization:

  • Use distillerSR or similar systematic review software for managing references.
  • Title/Abstract Screening: Screen against minimal eligibility criteria (e.g., original research, relevant subject). A pilot screen (e.g., 200 references) is used to calibrate understanding among reviewers.
  • Full-Text Categorization: Retrieve and categorize included studies based on a predefined coding taxonomy. Key categories include:
    • Evidence Stream: Human (epidemiological, biomonitoring), in vivo mammalian, in vivo non-mammalian, in vitro.
    • Study Design: Cohort, case-control, controlled exposure, etc.
    • Exposure Specifics: Chemical(s), dose/conc, duration, route.
    • Outcome Specifics: Organ system, endpoint type (apical, mechanistic).
    • Population: Species, strain, age, sex.
  • Data Extraction: Use semi-automated tools (e.g., DEXTR) or manual forms to extract key metadata into a structured database [60].

• Analysis & Visualization:

  • Generate evidence maps using visualization software (e.g., Tableau, R) to display the distribution of studies across the coded categories [60].
  • Quantify evidence clusters and gaps (see Table 1).
  • Document observations on study relevance, quality indicators, and terminology used.

• Refinement Workshop:

  • Convene the review team to discuss SEM findings.
  • Systematically evaluate each indicator from Table 1 against the initial PECO.
  • Make explicit, documented decisions on whether and how to refine each PECO element and the associated protocol steps (e.g., search strategy, risk of bias tools).
  • Document all changes and justifications in a protocol amendment report.

Protocol for Implementing the Refinement Decision: The "Human-in-the-Loop" Screening Pilot

A targeted screening pilot after refinement validates the updated PECO and optimizes the human-AI workflow [59].

Objective: To calibrate the screening process, estimate screening workload, and finalize the protocol before full-scale review implementation.

Methods:

• Sample: Draw a random sample of 500-1000 references from the search results generated by the refined search strategy.
• Dual Independent Screening: Two experienced reviewers screen the sample at title/abstract level against the refined PECO criteria.
• Consensus & Data Collection:
  • Reviewers resolve conflicts through discussion.
  • For each conflict, record the reason (e.g., ambiguous PECO criterion, unfamiliar terminology).
  • Calculate inter-rater reliability (e.g., Cohen's Kappa).
• Protocol Finalization:
  • Based on conflict analysis, further clarify PECO definitions or screening instructions.
  • If using AI-assisted screening, use the pilot results as the training set. The pilot helps determine the optimal "human-in-the-loop" ratio, balancing efficiency and accuracy [59].
  • Finalize the screening and data extraction forms.
• Workflow Estimation: Use the inclusion rate from the pilot to forecast the number of full-text retrievals and the required team resources.

The relationship between the full SEM and the targeted screening pilot in the iterative workflow is shown below.

SEM and Screening in the Refinement Workflow

Diagram 2: Integration of SEM and screening pilot in the protocol refinement process.

The Scientist's Toolkit: Research Reagent Solutions

Table 3: Essential Tools and Resources for Iterative Protocol Refinement

Item	Category	Function/Application in Iterative Refinement	Example/Note
DistillerSR	Software	A primary platform for managing the entire systematic review lifecycle. Facilitates the SEM screening, categorization, and data extraction processes with audit trails [60].	Alternative: Covidence, Rayyan.
HAWC (Health Assessment Workspace Collaborative)	Software/Platform	An open-source modular platform developed by EPA and others to support systematic reviews and dose-response analyses. It can be used to create interactive evidence maps and store structured data [5].	Highlighted by the National Academies as an example tool for improving handbook clarity [5].
DEXTR (Data Extraction Tool)	Software	A web-based semi-automated tool for extracting study metadata and results into a structured format from PDFs, significantly speeding up the data curation phase of an SEM [60].	Reduces resource burden during the evidence mapping stage.
Tableau / R (ggplot2, urbnthemes)	Visualization Tool	Creates interactive, queryable evidence maps and visualizations from the coded SEM database to clearly identify clusters and gaps [60] [62]. The urbnthemes R package applies consistent, accessible styling [62].	Critical for Step 3 (SEM Analysis) in Diagram 1.
PECO Statement Template	Methodological Tool	A structured template (with definitions) for drafting and revising the review's foundational question. Ensures all team members share a precise understanding of each element before and after refinement.	Should be aligned with the review's problem formulation [59] [7].
Protocol Registry	Governance Tool	A time-stamped, public repository (e.g., PROSPERO, Open Science Framework) for registering the initial and refined systematic review protocol. Mitigates bias and fulfills mandates for transparency [5].	The National Academies emphasizes clarifying what constitutes the "protocol" and its registration [5].
Bias Assessment Tools	Methodological Tool	Checklists and tools (e.g., for funding bias, publication bias) to apply during SEM analysis. Helps evaluate whether evidence clusters/gaps may be artifactual due to bias, informing refinement decisions [5].	The handbook should describe how to assess these biases [5].

Evaluating and Validating PECO Frameworks in Regulatory and Research Contexts

The development of systematic reviews for ecotoxicity research represents a critical methodology for achieving transparent, objective, and evidence-based conclusions in environmental risk assessment [63]. This process is foundational for regulatory decision-making, chemical safety evaluations, and the protection of human and ecological health. Central to a rigorous systematic review is the initial formulation of a precise and answerable research question, most effectively structured through a PECO statement—defining the Population, Exposure, Comparator, and Outcomes [9]. The quality of the PECO framework directly dictates the scope, direction, and reliability of the entire review. This article presents application notes and detailed protocols for PECO development and systematic review execution, benchmarked against the established best practices of authoritative bodies including the U.S. Environmental Protection Agency's Integrated Risk Information System (IRIS), the Texas Commission on Environmental Quality (TCEQ), and guidance from the National Academies of Sciences, Engineering, and Medicine (NASEM). By synthesizing these approaches, we provide a consolidated, actionable guide for researchers conducting ecotoxicity systematic reviews.

Application Note: Framing the Research Question with PECO

A well-constructed PECO statement is the cornerstone of a reproducible and focused systematic review. It minimizes bias by predefining the evidence selection criteria before the review begins [9] [64].

Core Guidance for PECO Component Definition:

• Population (P): Precisely specify the subjects of interest. In ecotoxicity, this includes the species (e.g., Daphnia magna), life stage, sex, and health status. For human health assessments, it includes demographic groups and sensitive sub-populations [9].
• Exposure (E): Define the chemical agent, its form, the route of administration (oral, inhalation, dermal), duration (acute, chronic), and magnitude or concentration. Exposure quantification is critical for dose-response assessment [65] [9].
• Comparator (C): Clearly state the control or reference condition. This is often an unexposed group, a group exposed to a background level, or a group exposed to a different, specified dose. The comparator is essential for calculating the effect size [9].
• Outcome (O): Identify the specific health or ecological endpoints measured. These should be clinically or biologically relevant and may include mortality, reproductive success, specific histopathological findings, or biomarker changes [65] [9].

Paradigmatic PECO Scenarios: Research contexts vary, and the PECO framework must adapt. The following table outlines five common scenarios, moving from exploratory research to decision-informing analysis [9].

Table 1: PECO Formulation Scenarios for Systematic Reviews in Environmental Health

Scenario & Context	Systematic Review Approach	Example PECO Question
1. Explore a dose-effect relationship. Initial investigation of an exposure-outcome association.	Explore the shape and distribution of the relationship across all available exposure levels.	Among fathead minnows (P), what is the effect of a 10 µg/L incremental increase in chemical X concentration (E) compared to the next lowest concentration (C) on egg production (O)?
2. Evaluate a data-derived exposure cut-off. When no pre-defined regulatory threshold exists.	Use cut-offs (e.g., tertiles, quartiles) defined by the distribution of exposures in the identified studies.	Among freshwater mollusks (P), what is the effect of exposure to concentrations in the highest quartile (E) compared to the lowest quartile (C) on embryonic survival (O)?
3. Evaluate a known external exposure cut-off. Using thresholds established by other research or populations.	Apply mean or median exposure levels from external sources (e.g., other species, occupational settings).	Among juvenile rainbow trout (P), what is the effect of exposure at the median concentration found in impacted watersheds (E) compared to background environmental concentrations (C) on gill histopathology (O)?
4. Identify a protective exposure cut-off. To define a level that ameliorates adverse effects.	Use an existing health-based guidance value (e.g., a reference dose) or toxicity threshold as the cut-off.	Among adult zebrafish (P), what is the effect of exposure to concentrations below the aquatic life benchmark (E) compared to concentrations at or above that benchmark (C) on locomotor behavior (O)?
5. Evaluate an intervention-based cut-off. To assess the potential benefit of a risk management action.	Select the comparator based on what exposure reduction is achievable through a specific intervention.	In a benthic community (P), what is the effect of a sediment remediation intervention that reduces chemical concentration by 50% (E) compared to no intervention (C) on macroinvertebrate diversity (O)?

Protocol I: The Systematic Review Workflow for Ecotoxicity

The systematic review process is a multi-step, protocol-driven activity designed to minimize error and bias. The following workflow synthesizes the core steps from EPA IRIS, TCEQ, and NASEM recommendations [36] [64] [63].

Step 1: Problem Formulation & Protocol Development

• Objective: Define the scope and develop a written, peer-reviewed protocol.
• Actions: Formulate the PECO question[s]. Conduct a broad, preliminary literature scan to identify potential health outcomes and inform the scope [64]. Develop a detailed protocol specifying the search strategy, study inclusion/exclusion criteria aligned with PECO, data extraction methods, and risk-of-bias assessment tools. The protocol should be made public and registered [66] [64].

Step 2: Systematic Literature Search & Study Selection

• Objective: Identify and select all potentially relevant evidence.
• Actions: Execute a comprehensive, reproducible search across multiple databases (e.g., PubMed, Web of Science, specialized toxicology databases). Use controlled vocabulary and free-text terms for all PECO elements. Search strategies should be documented line-by-line [64]. Screening (title/abstract, then full-text) should be performed by at least two independent reviewers using pre-defined forms. Disagreements are resolved by consensus or a third reviewer [64].

Step 3: Data Extraction & Study Quality Assessment

• Objective: Systematically extract data and evaluate the risk of bias in individual studies.
• Actions: Extract data on study design, population, exposure details, outcomes, results, and key confounders into standardized tables or systems like EPA's Health and Environmental Research Online (HERO) database [65]. Assess the internal validity (risk of bias) of each study using domain-based tools appropriate to the study type (e.g., experimental animal studies, in vitro assays, observational epidemiology) [36] [63]. This assessment informs the strength of evidence.

Step 4: Evidence Integration & Synthesis

• Objective: Weigh and synthesize evidence across studies to draw overall conclusions.
• Actions: This step, also called weight-of-evidence analysis, involves a structured causal analysis [64] [67]. Integrate findings across lines of evidence (human, animal, mechanistic). Evaluate the strength, consistency, and coherence of the data. Use frameworks (e.g., from IARC or OHAT) to grade the evidence for each outcome. Distinguish this qualitative/judgment-based integration from quantitative meta-analysis [64] [63].

Step 5: Dose-Response Analysis & Toxicity Value Derivation

• Objective: Quantify the relationship between exposure and effect.
• Actions: Identify points of departure (PODs) such as no-observed-adverse-effect-levels (NOAELs) or benchmark doses (BMD). EPA's Benchmark Dose Software (BMDS) is the preferred tool for modeling dose-response data to derive a BMD [65]. Apply uncertainty factors (e.g., for interspecies extrapolation, intraspecies variability) to the POD to derive toxicity values like a Reference Dose (RfD) or Reference Concentration (RfC) [65].

Step 6: Risk Characterization & Reporting

• Objective: Communicate the findings and their uncertainties for use in decision-making.
• Actions: Synthesize the hazard identification, dose-response assessment, and exposure context to characterize risk. The final report must transparently document all methods, data, judgments, and uncertainties [64]. Conclusions should be clearly linked to the evidence.

Protocol II: Evidence Integration and Weight-of-Evidence Analysis

Evidence integration is the critical, judgment-based process of synthesizing findings from disparate streams of evidence into a coherent conclusion about hazard and dose-response [64] [67].

A. Framework for Evidence Integration:

• Assemble the Body of Evidence: Create evidence tables sorted by line of evidence (human, animal, mechanistic) and outcome.
• Assess Individual Study Quality: Use the risk-of-bias evaluations from Protocol I, Step 3.
• Synthesize Evidence Within Lines: For each outcome (e.g., liver toxicity), evaluate the direction, magnitude, and consistency of effects within human studies, within animal studies, and within mechanistic studies.
• Assess Cross-Evidence Coherence: Determine if effects are consistent across different lines of evidence. Do animal models show the same critical effect? Do mechanistic data explain the biological plausibility of effects seen in vivo?
• Grade the Strength of Evidence: Use a predefined scale (e.g., "High," "Moderate," "Low," "Insufficient") to rate confidence in the conclusion that the exposure causes the outcome. Factors include study quality, consistency, coherence, and biological plausibility.
• Identify Data Gaps and Uncertainties: Explicitly document limitations in the evidence base that contribute to uncertainty in the assessment.

B. Utilizing Mechanistic Data: Mechanistic data (in vitro, in silico, -omics) are crucial for establishing biological plausibility and filling data gaps, especially when human evidence is limited [67] [63]. Systematic review of mechanistic data presents challenges but is increasingly formalized. It involves:

• Screening large volumes of diverse study types.
• Applying specific tools to assess the internal validity of in vitro and in silico studies.
• Using the data to support mode-of-action (MOA) analyses, which determine if a key biological event in animals is plausible in humans [68].

Benchmarking Authoritative Protocols

Different authoritative bodies have developed nuanced approaches to systematic review. The table below benchmarks key elements of their protocols.

Table 2: Benchmarking Systematic Review Protocols from Authoritative Bodies

Protocol Element	EPA IRIS Program [65] [66] [64]	Texas Commission on Environmental Quality (TCEQ) [36]	National Academies (NASEM) Recommendations [64] [67]
Core Process Steps	Problem Formulation, Evidence ID, Evidence Evaluation, Evidence Integration, Dose-Response, Documentation.	Problem Formulation, Lit. Review/Study Selection, Data Extraction, Study Quality/ROB, Evidence Integration, Confidence Rating.	Emphasizes a clear distinction between Systematic Review (protocol, ID, evaluation, summary) and Evidence Integration (judgment-based synthesis).
Key Guidance Document	ORD Staff Handbook for Developing IRIS Assessments (IRIS Handbook) [66].	Guidelines for performing systematic reviews in the development of toxicity factors [36].	Reviews and advises on EPA's methods; advocates for IOM standards for systematic review [64].
PECO/Problem Formulation	Conducts broad scan to identify outcomes, then formulates specific questions for systematic review [64].	Problem formulation is the critical first step to define the review scope [36].	Recommends a 3-step process: broad scan, table of health outcomes by evidence stream, decision on which outcomes warrant full review [64].
Evidence Identification	Mandates line-by-line search strategy in protocol; uses HERO database; two independent reviewers [65] [64].	Systematic literature review with pre-defined search and selection criteria [36].	Stresses replicability, use of information specialists, and independent duplicate screening [64].
Evidence Integration	Uses "evidence integration" term for weight-of-evidence; incorporates mechanistic data for MOA [64] [67].	Includes "Evidence Integration and Endpoint Determination" as a formal step [36].	Promotes structured causal analysis frameworks and transparent documentation of judgments [64] [67].
Peer Review & Transparency	Public protocol, draft, and final assessment; external peer review by NASEM; public comment periods [66] [68].	Framework aims to increase transparency in regulatory decision-making [36].	Strongly advocates for external peer review of both assessment drafts and methodological handbooks [64].

Table 3: Research Reagent Solutions for Ecotoxicity Systematic Reviews

Tool / Resource	Function in Systematic Review	Source/Body
HERO Database	A searchable database of >1.6 million scientific references used to support EPA assessments; enables transparent citation management [65].	U.S. EPA
Benchmark Dose Software (BMDS)	Statistical software for fitting mathematical models to dose-response data to derive a point of departure (BMD); preferred over NOAEL/LOAEL approach [65].	U.S. EPA
IRIS Handbook	The detailed staff handbook outlining procedures for developing IRIS assessments, including systematic review application [66].	U.S. EPA IRIS Program
PECO Framework	The foundational structure (Population, Exposure, Comparator, Outcome) for formulating a precise systematic review question [9].	Methodological Standard
Risk-of-Bias (ROB) Tools	Domain-based checklists (e.g., for animal studies, in vitro studies, epidemiological studies) to objectively assess the internal validity of individual studies [36] [63].	SYRCLE, OHAT, Cochrane
Evidence Integration Framework	A structured process (e.g., from IARC, OHAT, Navigation Guide) for grading the strength of evidence and reaching a hazard conclusion across data streams [64] [63].	Multiple International Bodies

The Role of PECO in Evidence Integration and Certainty Assessments (e.g., GRADE)

In the field of ecotoxicity and environmental health, the transition from narrative reviews to systematic, transparent evidence synthesis is paramount for credible risk assessment and decision-making [69]. A cornerstone of this rigorous approach is the precise formulation of the research question using the Population, Exposure, Comparator, Outcome (PECO) framework [9]. Unlike its clinical counterpart PICO (Population, Intervention, Comparator, Outcome), PECO is specifically adapted for environmental health questions, where the "E" denotes an Exposure of interest (e.g., a chemical, physical agent, or environmental condition) rather than a therapeutic intervention [9].

A well-constructed PECO statement is not merely an initial step but the structural foundation that guides every subsequent phase of a systematic review. It explicitly defines the scope, informing study eligibility criteria, search strategies, data extraction, and the assessment of how directly the identified evidence answers the question [9]. Most critically for this discussion, the PECO framework is indispensable for the integration of diverse evidence streams—including human epidemiological studies, controlled animal toxicology, in vitro assays, and New Approach Methodologies (NAMs)—and for conducting structured certainty assessments using systems like GRADE (Grading of Recommendations Assessment, Development and Evaluation) [69] [4].

This document provides detailed application notes and protocols for developing PECO statements within ecotoxicity systematic reviews and elucidates their integral role in facilitating evidence integration and transparent certainty evaluations, ultimately bridging the gap between environmental science and evidence-based policy.

Protocol for PECO Statement Development in Ecotoxicity Reviews

Core Principles and Formulation Guidance

Developing a precise PECO statement requires careful consideration of each component, with particular challenges in defining the Exposure and Comparator in environmental contexts [9]. The following protocol outlines the iterative process.

• Population (P): Define the organisms or ecosystems of interest. For human health, this includes demographics and susceptibility factors. For ecological reviews, specify the species (e.g., Daphnia magna), life stage, or ecological community. The population should be aligned with the decision-making context of the review [9].
• Exposure (E): Articulate the specific chemical, mixture, or environmental stressor. Crucially, detail the metrics of exposure, including route (e.g., oral, waterborne), duration (acute, chronic), timing (life stage-specific), and magnitude (dose or concentration). This quantification is essential for assessing dose-response and defining comparators [9].
• Comparator (C): Define the alternative exposure scenario against which the Exposure is compared. This is often the most complex element. The comparator can be a lower exposure level, background exposure, or a specific threshold (e.g., a regulatory limit). It may be defined incrementally (e.g., per unit increase) or as a categorical cut-off (e.g., exposed vs. unexposed groups) [9].
• Outcome (O): Specify the measurable health or ecological endpoints. These should be critical or important for decision-making [70]. Outcomes can include mortality, reproductive success, specific histopathological findings, biomarker changes, or population-level effects. Pre-specifying outcomes minimizes reporting bias.

Operational Scenarios for PECO Formulation

PECO questions are not uniform; their structure depends on the review's objective and the existing state of knowledge. Researchers must select the paradigmatic scenario that best fits their research context [9].

Table 1: PECO Formulation Scenarios for Ecotoxicity Systematic Reviews (Adapted from [9])

Scenario	Review Context & Objective	Approach to Defining Comparator (C)	Example PECO Question (Ecotoxicity Context)
1. Exploratory Association	Initial investigation of a potential hazard; characterizing the dose-effect relationship.	Explore the shape of the relationship across the entire range of observed exposures.	In freshwater zebrafish embryos, what is the effect of a 1 mg/L increase in waterborne microplastic concentration (E) compared to varying background levels (C) on embryonic mortality and teratogenicity (O)?
2. Comparative Risk (Data-Derived)	Evaluating the effect of high vs. low exposure, where cut-offs are informed by the distribution in the identified literature.	Define comparator groups based on distribution percentiles (e.g., top vs. bottom quartile) found in the evidence base.	In soil nematodes (C. elegans), what is the effect of exposure to pesticide residues (E) in the highest quartile of measured concentrations (C) compared to the lowest quartile (C) on reproductive capacity (O)?
3. Comparative Risk (External Standard)	Evaluating against a specific, pre-defined exposure benchmark from other populations or regulations.	Use a known cut-off from external sources (e.g., another species, a preliminary safety limit).	In honey bee colonies, what is the effect of field-level exposure to neonicotinoid (E) compared to an exposure limit derived from laboratory LD₅₀ studies (C) on foraging behavior and colony collapse (O)?
4. Safety Threshold Evaluation	Determining if exposure below a specific threshold ameliorates adverse outcomes.	Compare an exposure level below a suspected safety threshold to a level above it.	In juvenile salmon, what is the effect of waterborne copper (E) at concentrations below the EPA chronic criterion (C) compared to concentrations above that criterion (C) on olfactory function and predator avoidance (O)?
5. Intervention Impact	Assessing the potential benefit of an intervention to reduce exposure.	The comparator is defined by the reduction in exposure achievable through a mitigation strategy.	In a benthic invertebrate community, what is the effect of implementing a sediment remediation technology (which reduces PAH exposure) (E) compared to no intervention (C) on species biodiversity and abundance (O)?

Protocol: Stepwise Development and Validation

• Stakeholder Engagement: Consult with risk managers, regulators, and subject matter experts to align the PECO with the decision-making need [71].
• Preliminary Scoping Search: Conduct limited searches to understand the breadth and nature of available evidence, which helps refine feasible PECO components [60].
• Draft PECO Statement: Using Table 1, draft the statement according to the most appropriate scenario.
• PECO Element Refinement:
  • Population: Consider relevance (e.g., model organism to human/ecosystem extrapolation).
  • Exposure: Ensure it is measurable and consistently reported in the literature.
  • Comparator: Justify the choice of cut-off, increment, or alternative exposure. This is critical for GRADE's "indirectness" assessment.
  • Outcomes: Classify each as "critical" or "important" for decision-making [70].
• Peer Review & Protocol Registration: Submit the refined PECO and review protocol for peer review (e.g., using COSTER guidelines [71]) and register it in a public repository (e.g., PROSPERO, Open Science Framework) to ensure transparency and reduce bias.

Methodology for Integrating PECO with GRADE Certainty Assessments

The GRADE Framework: From Evidence to Certainty

The GRADE framework provides a systematic and transparent method to rate the certainty of evidence (also called confidence in evidence or quality of evidence) for each pre-specified outcome across a body of studies [69] [72]. The process begins with the PECO-defined question.

Table 2: Domains for Assessing Certainty of Evidence in GRADE [69] [73] [72]

Domain	Purpose	Rating Down Considerations	Ecotoxicity-Specific Challenges
Risk of Bias	Assesses flaws in study design/conduct that may systematically alter results.	Lack of blinding, improper randomization, high attrition, confounding.	Assessing confounding in observational field studies; blinding in animal behavior studies.
Inconsistency	Evaluates unexplained variability (heterogeneity) in results across studies.	Wide variance in point estimates, poor overlap of confidence intervals, high I² statistic.	Variability due to species/strain differences, exposure media, laboratory conditions.
Indirectness	Judges how directly the evidence answers the PECO question (P, E, C, O).	Differences in population, exposure, comparator, or surrogate vs. final outcome.	Extrapolating from in vitro to in vivo, from model organism to target species, from high to low dose.
Imprecision	Evaluates if evidence is sufficient to support a reliable conclusion.	Wide confidence intervals crossing the line of no effect or minimal important effect.	Small sample sizes common in animal toxicology; limited number of field studies.
Publication Bias	Assesses potential for missing studies (e.g., small, null, or unfavorable results).	Asymmetry in funnel plot, evidence of selective reporting.	Grey literature (industry reports, thesis) in ecotoxicity; bias against publishing null results.
Upgrading Domains (for Non-Randomized Studies)	Large Magnitude of Effect: A very large effect (e.g., RR >2 or <0.5) can increase confidence.
	Dose-Response Gradient: Presence of a monotonic exposure-response relationship.
	Plausible Confounding: Assessment that all plausible confounding would reduce the observed effect.

Experimental Protocol: Conducting a GRADE Assessment for an Ecotoxicity Outcome

Objective: To rate the certainty of evidence for a single critical outcome (e.g., "reduced fecundity") from studies identified via a PECO-guided systematic review.

Materials: Evidence tables, risk-of-bias assessments for each study, statistical summary (e.g., meta-analysis forest plot), funnel plot software.

Procedure:

• Study Design & Initial Rating:
  • Classify the body of evidence. For ecotoxicity, evidence typically starts as "low certainty" because it derives from non-randomized studies (observational ecology, controlled animal experiments) [73].
  • Exception: If using a rigorous tool like ROBINS-I for controlled animal studies that adequately addresses confounding and selection bias, an initial rating of "high" may be justified [73].
• Domain Evaluation (Rating Down):
  • Risk of Bias: Use a pre-specified tool (e.g., SYRCLE's RoB for animal studies, adapted tools for ecological studies). If most studies have serious limitations, rate down one level ("serious" = -1, "very serious" = -2) [72].
  • Inconsistency: Visually inspect forest plots and calculate I². Unexplained substantial heterogeneity (e.g., I² > 50%) typically leads to rating down one level [72].
  • Indirectness: Judge against the PECO. This is where PECO is crucial. For example, if the PECO specifies "chronic exposure" but most studies are "acute," rate down for indirectness. If the review question concerns a freshwater fish but key evidence is from a marine species, rate down [69].
  • Imprecision: Calculate the optimal information size (OIS). If the total sample size is less than OIS or the 95% confidence interval around the summary effect includes both meaningful harm and no harm, rate down.
  • Publication Bias: Generate a funnel plot if ≥10 studies. Suspected bias leads to rating down.
• Upgrading Considerations:
  • Evaluate for a dose-response gradient (e.g., increasing chemical concentration leads to progressively lower fecundity).
  • Evaluate if the effect size is large (e.g., relative risk > 2.0).
  • If present, each convincing factor can raise the certainty level by one (+1) [73] [72].
• Final Certainty Rating: Combine adjustments. The final rating is High, Moderate, Low, or Very Low [73]. Document reasons explicitly in a Summary of Findings or GRADE Evidence Profile table.

Application Notes: PECO-Driven Evidence Integration in Ecotoxicity

Integrating Multiple Evidence Streams

Modern environmental health assessments, such as those incorporating NAMs, require integrating data from human, animal, in vitro, and computational streams [69] [4]. A precisely defined PECO is the common anchor that makes this integration possible.

• Role of PECO: It creates a unified framework for evaluating indirectness across streams. For example, an in vitro assay on a human cell line (P) exposed to a chemical (E) with a vehicle control (C) measuring cytotoxicity (O) provides evidence that is indirect to a PECO on whole-organism fish toxicity. The PECO allows reviewers to systematically categorize and weigh this indirectness.
• Protocol for Integration: Evidence from each stream should be synthesized separately first (e.g., narrative or meta-analysis). The overall certainty for an outcome is then judged across streams, considering the coherence of findings. Consistent results across streams with complementary strengths (e.g., mechanistic clarity from in vitro, whole-organism relevance from in vivo) may increase confidence in the conclusion, despite indirectness in any single stream [4].

Case Application: Systematic Evidence Mapping (SEM)

Projects like the aWARE protocol for autism spectrum disorders and environment demonstrate advanced PECO application [60]. An ecotoxicity SEM would:

• Use a broad PECO to capture all relevant research.
• Employ interactive, queryable databases to map studies by PECO elements (e.g., filter by specific Population (species), Exposure (chemical class), and Outcome).
• Visually identify evidence clusters and gaps to inform future research and targeted systematic reviews [60].

Title: PECO to GRADE Workflow for Multi-Stream Evidence Integration

Visualizing Evidence Integration Logic

The relationship between PECO definition, evidence synthesis by stream, and final certainty assessment is a logical flow where PECO informs every judgment.

Title: PECO as Anchor for Evidence Integration in GRADE

Table 3: Key Research Reagent Solutions for PECO/GRADE-Driven Ecotoxicity Reviews

Item / Resource	Category	Function / Purpose	Example / Note
PECO Formulation Framework [9]	Methodology Guide	Provides structured scenarios and examples for defining the Exposure and Comparator in environmental health questions.	Essential for moving beyond basic PICO to exposure-specific questions.
COSTER Recommendations [71]	Reporting Standard	A set of consensus recommendations for conducting systematic reviews in toxicology and environmental health.	Guides protocol development, search, data extraction, and reporting to ensure rigor.
GRADE Handbook & Software [70]	Certainty Assessment Framework	Defines domains for rating evidence certainty and provides software (GRADEpro GDT) to create Summary of Findings tables.	Central to transparent evidence grading.
ROBINS-I / SYRCLE RoB Tools	Risk of Bias Tool	Assesses risk of bias in non-randomized studies of interventions (ROBINS-I) or animal studies (SYRCLE's RoB).	Critical for the "Risk of Bias" domain in GRADE.
DistillerSR [60]	Software	A web-based platform for managing the systematic review process, including screening, selection, and data extraction.	Enhances reproducibility and efficiency, especially for large evidence bases.
Systematic Evidence Map (SEM) Protocol [60]	Evidence Mapping Method	A protocol for identifying and characterizing a broad evidence base into an interactive, queryable resource.	Useful for scoping complex fields and identifying clusters for full review.
New Approach Methodologies (NAMs) Framework [4]	Emerging Evidence Stream	Incorporates data from in vitro, in silico, and other non-traditional methods into systematic reviews for risk assessment.	Requires explicit PECO definition for each NAM study to assess fit and indirectness.

Within the context of a broader thesis on PECO (Population, Exposure, Comparator, Outcome) statement development for ecotoxicity research, this analysis serves as a critical application guide. A well-framed PECO question is not merely procedural; it defines the review's objectives, inclusion criteria, and ultimately, the directness and utility of its findings for risk assessment and decision-making [9]. Unlike the PICO (Population, Intervention, Comparator, Outcome) framework designed for clinical interventions, PECO is specifically adapted for environmental, occupational, and public health questions concerning unintentional exposures [9]. This article provides detailed application notes and protocols for formulating PECO statements, illustrated with contemporary case studies from per- and polyfluoroalkyl substances (PFAS) research and ecotoxicology. The goal is to equip researchers and systematic review authors with a structured methodology to enhance the rigor, clarity, and relevance of their evidence syntheses in complex exposure science.

The PECO Framework: Components and Scenarios

The PECO framework decomposes a research question into four pillars. The Population specifies the subjects (e.g., human cohort, animal species, or ecological community). Exposure details the agent or stressor of interest (e.g., a chemical, noise level). The Comparator defines the reference exposure scenario against which effects are measured, which is often the most challenging element to specify in environmental studies [9]. Outcomes are the measured health or ecological endpoints. The formulation of these components is not one-size-fits-all but depends on the review's purpose and the existing knowledge base.

A seminal framework outlines five paradigmatic scenarios for PECO development, moving from exploratory analysis to decision-support [9]. These are summarized in Table 1, adapted with examples relevant to ecotoxicity.

Table 1: PECO Formulation Scenarios for Systematic Reviews in Exposure Science [9]

Scenario & Context	Approach	Example PECO Question (Ecotoxicity Focus)
1. Explore the exposure-outcome relationship	Analyze the shape/distribution of the relationship (e.g., linear, nonlinear).	In freshwater zebrafish (Danio rerio), what is the effect of incremental increases in waterborne perfluorooctanoic acid (PFOA) concentration on larval mortality?
2. Evaluate effect of an exposure cut-off (data-derived)	Use cut-offs (e.g., tertiles, quartiles) based on the distribution in identified studies.	In solitary bees (Osmia spp.), what is the effect of exposure to pesticides in the highest quartile of applied field dose compared to the lowest quartile on foraging success? [74]
3. Evaluate association with externally-defined cut-offs	Use cut-offs from regulations, other populations, or known thresholds.	In a human population, what is the effect of serum PFOA concentrations ≥ 20 ng/mL (a regulatory advisory level) compared to < 20 ng/mL on thyroid hormone levels?
4. Identify a protective exposure cut-off	Use an existing health-based benchmark as the comparator.	In juvenile fathead minnows (Pimephales promelas), what is the effect of exposure to copper concentrations below the EPA chronic aquatic life criterion compared to concentrations above it on reproductive output?
5. Evaluate the effect of an intervention	Select comparator based on exposure levels achievable via a mitigation intervention.	In agricultural soils, what is the effect of implementing a vegetative buffer strip (reducing pesticide runoff) compared to no buffer on earthworm (Lumbricus terrestris) abundance?

Case Study Application I: PFAS and Human Health Outcomes

3.1 PECO Statement and Rationale A published systematic review investigated the link between PFAS and fetal growth, employing a classic Scenario 1 PECO [9]:

• Population: Human mothers and their offspring.
• Exposure: Serum or plasma concentrations of perfluorooctanoic acid (PFOA) measured before or during pregnancy.
• Comparator: Incremental increase in PFOA concentration (e.g., per 1 ng/mL).
• Outcome: Birth weight (in grams).

This formulation is ideal for an exploratory phase where the primary question is the existence and direction of an association. It treats exposure as a continuous variable to model a dose-response relationship.

3.2 Data Synthesis and Visualization Protocol The review's quantitative finding—that a 1 ng/mL increase in maternal serum PFOA was associated with an 18.9 g decrease in birth weight—exemplifies the output of a Scenario 1 analysis [9]. To implement such a review, a detailed protocol is required:

• Search & Screening: Execute searches across multiple databases (e.g., PubMed, Web of Science, Embase) using controlled vocabulary and keywords for PFAS compounds and birth outcomes. Pre-defined inclusion/exclusion criteria, mirroring the PECO, are applied.
• Data Extraction: Design a structured form to capture: study population characteristics, exposure matrix and quantification method, comparator definition, outcome measure, effect estimate (e.g., beta-coefficient for birth weight), and measures of dispersion/confidence intervals.
• Quantitative Synthesis (Meta-Analysis): If studies are sufficiently homogeneous, pool continuous data using the generic inverse-variance method. The key quantitative data for a summary table would include: Table 2: Example Data Summary from a Meta-Analysis on PFOA and Birth Weight

  Study (Author, Year)	Population Description	Exposure Measure	Comparator	Beta-Coefficient (g per ng/mL)	95% CI	Weight in Meta-Analysis (%)
  Study A, 2020	National birth cohort, USA	Serum PFOA (2nd trimester)	1 ng/mL increase	-22.5	[-35.1, -9.9]	32.5
  Study B, 2018	Regional cohort, Norway	Plasma PFOA (1st trimester)	1 ng/mL increase	-15.3	[-28.0, -2.6]	30.1
  Study C, 2019	Hospital-based cohort, Japan	Serum PFOA (pre-pregnancy)	1 ng/mL increase	-19.0	[-31.5, -6.5]	37.4
  Random-Effects Model Pooled Estimate				-18.9	[-25.2, -12.6]	100

• Visualization: Generate a forest plot to display individual study estimates and the pooled result. Advanced, interactive visualizations using tools like Tableau can allow stakeholders to dynamically filter data by population subgroup or exposure timing, enhancing the usability of complex results [75].

Case Study Application II: Pesticide Ecotoxicity for Solitary Bees

4.1 PECO Statement for a Scoping Review A systematic scoping review on pesticide effects on solitary bees illustrates PECO's application in ecological risk assessment [74]. A relevant PECO could be:

• Population: Commercially relevant solitary bee species (e.g., Osmia lignaria, Megachile rotundata).
• Exposure: Oral, topical, or residual contact with a specified pesticide class (e.g., neonicotinoids).
• Comparator: Unexposed control or exposure to a solvent/vehicle control.
• Outcome: Lethal (mortality) and sublethal endpoints (foraging behavior, larval development, reproduction).

This PECO aligns with Scenario 2 or 3, aiming to characterize effects across a range of exposures and outcomes to map evidence and identify critical data gaps for risk assessment surrogate species [74].

4.2 Experimental Methodology from Primary Studies The review cataloged diverse experimental designs [74]. A standard protocol for a laboratory-based, acute oral toxicity test—a common study type—would involve:

• Test Organism: Adult female solitary bees (Osmia bicornis), freshly emerged from overwintering cocoons, acclimatized under controlled conditions (e.g., 25°C, 60% RH, continuous dark).
• Exposure Preparation: Prepare a stock solution of the pesticide (e.g., thiamethoxam) in a suitable solvent (e.g., acetone). Dilute to a range of test concentrations (e.g., 0.1, 1, 10, 100 ng/µL) in a 50% (w/v) sucrose solution. A control solution contains sucrose and solvent only.
• Dosing: Individually house bees. Using a micropipette, administer a single, measured volume (e.g., 10 µL) of the test solution directly to the bee's proboscis. Record the exact dose (ng/bee).
• Post-Exposure Monitoring: Transfer bees to containment cages with ad libitum access to clean sucrose solution and water. Observe and record mortality at specific intervals (e.g., 4, 24, 48, and 72 hours post-treatment). For sublethal assessment, video-record or manually assess behaviors like locomotion, grooming, and responsiveness to stimuli.
• Data Analysis: Calculate lethal concentration (LC50) values using probit or logit analysis. Compare sublethal behavioral scores across treatment groups using ANOVA or non-parametric equivalents.

Detailed Protocols for PECO Development and Systematic Review Execution

5.1 Protocol for Developing a PECO Statement

• Define the Decision Context: Determine if the review is exploratory (Scenario 1) or intended to inform a specific regulatory or intervention decision (Scenarios 3-5) [9].
• Iteratively Specify Components:
  • Population (P): Be specific about species, life stage, health status, and relevant demographics. For ecological reviews, specify the taxonomic group and ecosystem.
  • Exposure (E): Define the agent, its matrix (e.g., water, soil, serum), route of exposure, timing/duration, and, crucially, the metric (e.g., concentration, cumulative dose).
  • Comparator (C): This is the most critical step. Choose a comparator (e.g., low exposure, background level, a regulatory threshold) that makes the comparison scientifically meaningful and useful for the intended audience [9].
  • Outcome (O): Specify the primary and secondary outcomes. Use standardized, measurable endpoints (e.g., "reduction in fecundity rate" vs. "impaired reproduction").
• Align PECO with Search Strategy: Translate each PECO component into a set of keywords and database-specific subject headings to construct the comprehensive search string.

5.2 Protocol for Conducting the Systematic Review

• Registration: Register the review protocol in PROSPERO or another suitable registry.
• Search Execution: Run searches in at least two major databases. Document the full search strategy for each database.
• Study Selection: Use a two-stage (title/abstract, full-text) screening process performed independently by two reviewers, with conflicts resolved by consensus or a third reviewer. Follow PRISMA reporting guidelines [74].
• Risk of Bias/Study Quality Assessment: Use a appropriate tool (e.g., OHAT for animal studies, ROBINS-I for observational human studies) for each included study.
• Evidence Synthesis and Grading: For human health, follow GRADE or similar frameworks. For ecotoxicity, follow frameworks like the EPA's Integrated Risk Information System (IRIS) or the Navigation Guide [9].

Diagram 1: PECO-Driven Systematic Review Workflow. This diagram outlines the sequential and iterative process of developing a PECO statement and conducting the subsequent systematic review, highlighting the critical role of the comparator.

Table 3: Key Research Reagent Solutions and Materials for Ecotoxicity Systematic Reviews

Item / Resource	Function / Purpose	Application Notes
Bibliographic Databases (PubMed, Web of Science, Scopus)	Comprehensive literature retrieval for human, animal, and environmental studies.	Use database-specific syntax and controlled vocabulary (MeSH, Emtree) tailored to each PECO component.
Systematic Review Software (Covidence, Rayyan, DistillerSR)	Manages the review process: deduplication, screening, data extraction, and collaboration.	Essential for ensuring reproducible and auditable screening processes among multiple reviewers.
Risk of Bias / Study Quality Tools (OHAT, SYRCLE's RoB, ROBINS-I)	Assesses internal validity and potential for bias in individual studies.	The choice of tool must match the study design (in vivo animal, observational human, etc.).
Data Visualization & Analysis Tools (R with ggplot2, Tableau, Stata)	Performs meta-analysis, creates forest plots, and develops interactive evidence dashboards.	Interactive dashboards (e.g., in Tableau) allow dynamic exploration of results by stakeholders [75].
Color Palette Guidelines (Sequential, Diverging, Qualitative)	Ensures accessible and semantically appropriate color use in charts and diagrams.	Use sequential schemes for dose-response data, diverging for effects above/below a threshold, and qualitative for categorical data [76]. Adhere to WCAG 2.2 AA contrast standards (≥4.5:1 for normal text) [77].

Diagram 2: Data Visualization Selection and Accessibility Check Workflow. This diagram outlines the process of selecting an appropriate visualization based on the data and question type, followed by mandatory accessibility checks.

The development of precise Population, Exposure, Comparator, Outcome (PECO) statements constitutes the foundational step in conducting rigorous systematic reviews within ecotoxicology and environmental health research. These frameworks structure research questions by defining the Population (organisms or ecosystems studied), the Exposure (chemical or environmental agent), the Comparator (control or alternative exposure scenario), and the Outcome (measured biological or ecological effect) [31] [79]. In the context of a broader thesis on methodological rigor in ecotoxicology, this analysis focuses on the critical appraisal of published PECO statements, identifying recurrent shortcomings that compromise evidence synthesis.

The imperative for robust PECO development has intensified with the integration of New Approach Methodologies (NAMs) into regulatory toxicology. NAMs—encompassing in vitro assays, computational models, and fish embryo tests—offer human-relevant and mechanistic data but present unique challenges for traditional review frameworks [80] [4]. A recent National Academies of Sciences, Engineering, and Medicine report explicitly calls for defining relevant PECO statements for NAMs to facilitate their inclusion in systematic reviews for human health risk assessment [4]. This transition reveals gaps where existing PECO statements fail to specify the unique parameters of NAM-based studies, such as cell lines, exposure media, or computational model boundaries, thereby limiting the systematic review's ability to incorporate modern, non-animal evidence effectively [80].

Methodological Foundations and Shortcomings

A well-constructed PECO statement directly guides every subsequent phase of a systematic review: literature search strategy, study selection, data extraction, and evidence synthesis [31]. Common methodological frameworks include PICO (Population, Intervention, Comparator, Outcome) for clinical questions and its adaptation, PECO, where "Intervention" is replaced by "Exposure" for environmental and observational studies [79]. Other variants like SPICE (Setting, Population, Intervention, Comparison, Evaluation) or ECLIPSE (Expectation, Client, Location, Impact, Professionals, Service) serve specialized questions but are less prevalent in toxicology [31].

Critical appraisal of published PECO statements reveals several recurrent shortcomings:

• Vague Population Definitions: Overly broad (e.g., "aquatic organisms") or inadequately specified populations (e.g., neglecting life stage or sex) limit a review's precision and generalizability [31]. For NAMs, this translates to poorly defined biological systems (e.g., "liver cells" instead of a specific hepatocyte cell line and passage number).
• Imprecise Exposure Characterization: Failure to delineate exposure routes, durations, doses, and chemical speciation reduces the ability to compare studies meaningfully. This is acute for NAMs where exposure media composition can drastically influence results [4].
• Inappropriate or Missing Comparators: The choice of comparator is crucial for causal inference. Shortcomings include using inappropriate control groups or failing to define a comparator entirely, which is particularly problematic when integrating NAM data with traditional in vivo studies [81].
• Overly Broad or Mechanistically Disconnected Outcomes: Defining outcomes solely as apical endpoints (e.g., "mortality") without linking to key events in adverse outcome pathways (AOPs) limits the integrative potential of reviews that include mechanistic NAM data [80].
• Lack of Framework for NAM Integration: Many PECO statements are not designed to accommodate data from diverse NAMs, creating a barrier to including these relevant methodologies in systematic reviews intended for modern risk assessment [4].

The following table compares key framework elements and their associated risks of poor specification:

Table 1: Comparison of Systematic Review Frameworks and Associated Methodological Risks

Framework Element	Purpose in Systematic Review	Common Shortcoming in Published Statements	Impact on Review Quality
Population (P)	Defines the subjects (organisms, ecosystems, cell lines) to which the review question applies.	Vague taxonomic or biological system definition; omission of critical descriptors (life stage, health status).	Limits search accuracy, complicates study eligibility assessment, reduces generalizability of conclusions [31].
Exposure/Intervention (E/I)	Defines the agent, its form, route, duration, and intensity.	Incomplete dose/conc. ranges; poorly characterized chemical form; omission of exposure medium for NAMs.	Precludes meaningful exposure-response analysis and heterogeneous data synthesis [81].
Comparator (C)	Defines the reference scenario (e.g., control, placebo, alternative exposure).	Omission of comparator; use of an inappropriate or non-equivalent control group.	Undermines risk of bias assessment and compromises the validity of the synthesized effect estimate [81].
Outcome (O)	Defines the measured effects or endpoints of interest.	Overly broad clinical/apical endpoints; failure to align with AOP key events for NAM integration.	Leads to inconsistent data extraction and missed opportunities for mechanistic insight [80] [4].

Protocols for PECO Development and Appraisal

A robust protocol is essential to predefine and standardize the approach for developing and appraising PECO statements within a systematic review [79]. The following protocol is adapted from established systematic review guidance and the Navigation Guide methodology, a rigorous framework for environmental health questions [81] [79].

Protocol for Developing a PECO Statement

• Initial Scoping: Conduct preliminary searches in key databases (e.g., PubMed, Web of Science) to understand evidence base and refine topic [79].
• Stakeholder Consultation: Engage subject matter experts in toxicology, ecology, and risk assessment to identify critical variables for each PECO element.
• Draft PECO Elements:
  • Population: Specify biological system, taxonomic group, life stage, sex, health status, and relevant susceptibility factors. For NAMs, define in vitro model (cell line, primary culture, stem cell-derived), organism, or computational model specifics.
  • Exposure: Specify chemical agent(s), including metabolites and isomers; define exposure matrix (water, soil, media), route (oral, dermal, immersion), duration (acute, chronic), and a relevant range of doses/concentrations.
  • Comparator: Define the control condition (e.g., vehicle control, sham exposure, background exposure level) and any relevant active comparators.
  • Outcome: Define primary and secondary outcomes. Prioritize outcomes anchored to AOP key events to facilitate NAM integration. Specify measurement methods, timing, and units.
• Pilot Testing: Test the drafted PECO statement by using it to screen a random sample of known relevant and irrelevant studies. Refine elements based on performance.
• Protocol Registration: Finalize and register the review protocol, including the PECO statement, on a platform like PROSPERO to ensure transparency and reduce bias [79].

Protocol for Critically Appraising Published PECO Statements

This experimental protocol outlines a method to systematically identify shortcomings in PECO statements from existing reviews.

Table 2: PECO Statement Critical Appraisal Tool

Appraisal Dimension	Scoring Criteria (0-2)	Data Extraction Method
Completeness	0=Element missing; 1=Element present but vague; 2=Element present and precisely defined.	Independent extraction by two reviewers from the published systematic review's methods section.
NAM-Relevance	0=No consideration of NAMs; 1=NAM data allowed but not specified; 2=NAM-specific parameters defined in PECO.	Textual analysis for terms related to in vitro, in silico, alternative methods, and defined biological models.
Operationalizability for Search	0=PECO cannot be directly translated to search terms; 1=Partial translation possible; 2=Direct, unambiguous translation to Boolean search possible.	Attempt to translate PECO into a pilot PubMed/MEDLINE search string; assess yield of known key studies.
Risk of Bias Linkage	0=No link between PECO and bias domains; 1=Indirect link; 2=Explicit link between PECO specs and planned bias assessment (e.g., exposure measurement method).	Compare PECO elements to risk-of-bias tool domains (e.g., Cochrane ROB, Navigation Guide) [31] [81].

Experimental Procedure:

• Sample Identification: Identify a cohort of systematic reviews in ecotoxicology (e.g., via search in PubMed or environmental health journals).
• Blinded Appraisal: Two trained reviewers independently apply the appraisal tool (Table 2) to each review's PECO statement.
• Reliability Testing: Calculate inter-rater reliability (e.g., Cohen's kappa) for each dimension.
• Quantitative Analysis: Aggregate scores to identify the most frequent deficiencies across the cohort of reviews.
• Qualitative Analysis: Reviewers convene to discuss discordant scores and document exemplars of both strong and weak PECO formulations.

The application of a structured appraisal protocol, as demonstrated in a 2025 review on acetaminophen and neurodevelopment, allows for the quantification of PECO quality. That review explicitly defined its PECO (Population: offspring of pregnant women; Exposure: prenatal acetaminophen; Comparator: no exposure; Outcome: ADHD, ASD) and linked it directly to search strings and bias assessment, showcasing a high-quality application [81].

Table 3: Analysis of PECO Statement Quality from a Published Review [81]

PECO Element	As Defined in the Acetaminophen Review [81]	Appraisal Score (0-2)	Rationale for Score
Population	"offspring of pregnant women assessed for neurodevelopmental outcomes"	1	Specifies a human population but lacks detail on child's age at assessment or key susceptibility factors.
Exposure	"prenatal acetaminophen exposure, measured via maternal self-report, biomarkers, or medical records"	2	Precisely defines timing (prenatal), agent, and acceptable measurement methods, enabling clear study inclusion.
Comparator	"offspring of pregnant women not exposed to acetaminophen or exposed to alternative analgesics"	2	Clearly defines both a null and an active comparator, strengthening causal inference.
Outcome	"neurodevelopmental disorders, including ADHD, ASD, or related symptoms, diagnosed or assessed in childhood"	2	Specifies diagnostic and assessment criteria, though "related symptoms" introduces some breadth.
NAM-Relevance	Excluded non-human studies for primary analysis.	0	The PECO was not designed to incorporate relevant NAM data (e.g., mechanistic toxicology studies), limiting the review's mechanistic depth.

Data Synthesis and Visualization

The critical appraisal of PECO statements generates both quantitative scores and qualitative insights. Data synthesis involves aggregating scores across appraisal dimensions to identify systematic weaknesses in the field's practice. For instance, analysis might reveal that "NAM-Relevance" consistently scores lowest, highlighting a collective methodological gap as the field transitions toward integrating new methodologies [80] [4].

A key challenge is integrating diverse evidence streams. The following workflow diagram, generated using Graphviz DOT language, maps the process of developing a NAM-inclusive PECO statement and its role in evidence synthesis.

PECO Development and Review Workflow

The integration of NAMs into established systematic review frameworks necessitates an expanded conceptual model. The following diagram illustrates the pathway for integrating NAM data through a refined PECO framework.

Pathway for Integrating NAMs via PECO

The Scientist's Toolkit

Conducting a high-quality critical appraisal of PECO statements requires specific tools and resources. The following toolkit lists essential items for executing the protocols described in this article.

Table 4: Research Reagent Solutions for PECO Development and Appraisal

Tool/Resource	Function in PECO Development/Appraisal	Example/Notes
Protocol Registries	Ensures transparency, reduces duplication, and locks in PECO criteria before review begins to avoid bias.	PROSPERO is the leading international register for health-related reviews [79].
Reference Management Software	Manages citations identified during scoping and systematic searches; essential for de-duplication.	EndNote, Zotero, Mendeley [31].
Systematic Review Software Platforms	Streamlines screening, data extraction, and quality assessment by multiple reviewers.	Covidence, Rayyan [31].
Bibliographic Databases	Sources for identifying both primary studies and existing reviews for appraisal.	PubMed/MEDLINE, Embase, Web of Science, Google Scholar [31].
Risk of Bias (RoB) Assessment Tools	Provides structured domains to evaluate study quality; a well-specified PECO directly informs RoB judgments.	Cochrane RoB Tool (RCTs), Navigation Guide (observational studies) [31] [81].
Adverse Outcome Pathway (AOP) Knowledge	Conceptual frameworks to link mechanistic NAM data (Key Events) to apical outcomes in the PECO.	AOP-Wiki (aopwiki.org) provides a curated database of AOPs.
Standardized Data Extraction Forms	Ensures consistent capture of PECO-relevant data from included studies (e.g., exposure details, model system).	Custom forms based on PECO, often built within review platforms like Covidence [81].

Within the domain of ecotoxicology and environmental health, systematic reviews (SRs) are fundamental for synthesizing evidence to inform regulation, risk assessment, and policy. However, the credibility of an SR is contingent upon the transparency and reproducibility of its methods, beginning with its foundational research question [21]. A critical challenge identified in the field is the phenomenon of "dueling systematic reviews," where different teams reach conflicting conclusions on the same topic. Expert analysis attributes this primarily to differences in initial problem formulation and a lack of transparency in the PECO (Population, Exposure, Comparator, Outcome) criteria and screening methods [59].

This application note addresses this challenge by providing standardized protocols for developing, reporting, and registering explicit PECO statements. Transparent PECO reporting is not merely an administrative step; it is the cornerstone of review reproducibility, minimizing subjective interpretation, enabling critical appraisal, and facilitating the acceptance of review findings by the scientific and regulatory community [59] [21]. The guidance herein is framed within a broader thesis on advancing methodological rigor in ecotoxicity evidence synthesis.

Core Principles and Quantitative Benefits of Transparent PECO

Transparent PECO formulation and reporting mitigate key sources of bias and variability in systematic reviews. The quantitative and qualitative benefits are summarized below, drawing from analyses of review quality and expert consensus [59] [21].

Table 1: Documented Impacts of Transparent PECO Framework Application

Impact Area	Quantitative or Qualitative Benefit	Supporting Evidence / Mechanism
Review Reproducibility	Reduces ambiguity in study eligibility, allowing other teams to replicate the search and selection process precisely.	Explicit PECO criteria directly translate into Boolean search syntax and consistent screening decisions [21].
Screening Efficiency	Enables effective "human-in-the-loop" AI screening by providing a focused decision rule, reducing manual workload [59].	AI tools perform with higher accuracy when PECO criteria are unambiguous, minimizing false positives/negatives.
Stakeholder Acceptance	Mitigates the risk of "dueling reviews" by documenting the rationale for scope boundaries, making the review's limitations explicit [59].	Transparency builds trust in conclusions by allowing regulators and scientists to understand the basis for included/excluded evidence.
Methodological Rigor	Reviews using structured frameworks (e.g., PICO/PECO) score significantly higher on reporting quality metrics [21].	Adherence to a framework ensures critical elements (e.g., comparator, study design) are not overlooked during protocol development.
Resource Optimization	Supports an iterative, "right-sized" approach where PECO can be refined based on initial search yields to streamline the assessment [59].	Prevents the exhaustive but low-value inclusion of studies (e.g., high-dose positive controls) irrelevant to the core question.

Protocol: Developing and Documenting a PECO Statement for Ecotoxicity Reviews

This protocol provides a step-by-step methodology for formulating and reporting a PECO statement, ensuring it meets standards for transparency, completeness, and operational utility.

Table 2: Step-by-Step PECO Development Protocol

Step	Action	Detailed Instructions & Reporting Standards
1. Define the Review's Primary Objective	Articulate the broad goal in one sentence.	Example: "To synthesize evidence on the chronic aquatic toxicity of Chemical X to freshwater invertebrates."
2. Formulate Preliminary PECO Elements	Brainstorm components for each PECO letter.	P (Population): List all relevant organism groups, life stages, or ecosystems.E (Exposure): Define the chemical/stressor, routes, and exposure regimes.C (Comparator): Specify the control condition (e.g., solvent control, background exposure).O (Outcome): List all relevant toxicological endpoints (e.g., mortality, reproduction, growth).
3. Refine Elements into Operational Criteria	Apply specificity to ensure unambiguous screening.	Use the PICOTS heuristic (Population, Intervention/Exposure, Comparator, Outcome, Timeframe, Study Design) [21] to add critical detail. Document exact terminology, measurement units, and thresholds.
4. Document Rationale and Boundaries	Justify key decisions and explicit exclusions.	For each element, record why specific scopes were chosen (e.g., "Only adult stages included due to standardized testing guidelines"). This is crucial for transparency [59].
5. Pilot Test with Sample Studies	Validate the clarity and utility of the criteria.	Apply the draft PECO to a small set of known relevant and irrelevant studies. Refine wording if screening decisions between reviewers are inconsistent.
6. Finalize and Register the Protocol	Publish the full PECO statement within a registered review protocol.	Register the protocol with a public repository (e.g., PROSPERO, Open Science Framework - OSF) prior to beginning the review [38] [37]. This locks the primary plan and prevents bias.

Application Example: Ecotoxicity Review PECO Statement

Review Title: Systematic Review on the Effects of Nanosilver (AgNPs) on Reproductive Endpoints in Freshwater Fish.

• P (Population): Freshwater fish species (e.g., zebrafish Danio rerio, fathead minnow Pimephales promelas). Life Stage: Sexually mature adults and early life stages (embryo to juvenile). Exclusion: Marine and brackish water species.
• E (Exposure): Engineered silver nanoparticles (AgNPs; primary size 1-100 nm). Any surface coating or functionalization. Exposure Route: Waterborne. Concentration Range: 0.1 µg/L to 1000 µg/L.
• C (Comparator): Unexposed control groups, vehicle/solvent control groups (e.g., with stabilizing agents if used), or ionic silver (Ag⁺) control groups for mechanistic comparison.
• O (Outcome): Primary: Fecundity (egg number), fertilization success, hatchability. Secondary: Gonadosomatic index (GSI), histopathological changes in gonads, vitellogenin induction. Exclusion: Studies measuring only whole-body accumulation without a linked reproductive effect.
• Timeframe (T): Chronic exposure studies (≥21 days for fish) or studies covering critical windows of reproductive development.
• Study Design (S): Controlled laboratory experiments conducted in accordance with OECD, EPA, or other standardized test guidelines. Exclusion: Field studies without controlled exposure, reviews, and modeling papers.
• Rationale Note: The inclusion of ionic silver comparators is to help differentiate nanoparticle-specific effects from those caused by dissolved silver ions.

Experimental & Methodological Workflows

Workflow for a Transparent, PECO-Driven Systematic Review

The following diagram illustrates the integrated workflow, highlighting how a pre-registered and transparent PECO statement governs the entire systematic review process to enhance reproducibility.

Diagram 1: PECO-Driven Systematic Review Workflow

Protocol for Integrating PECO with 'Human-in-the-Loop' AI Screening

Artificial Intelligence (AI) tools are increasingly used to accelerate the screening phase. This protocol ensures AI-assisted screening remains systematic and transparent, as recommended to balance efficiency with accuracy [59].

Objective: To implement a reproducible, semi-automated study screening process where AI ranks or classifies references based on a human-defined PECO statement, with final eligibility determined by human reviewers.

Materials:

• Finalized PECO statement (from Section 3 Protocol).
• Bibliographic database output (e.g., .ris, .csv file).
• AI-for-screening software (e.g., ASReview, Rayyan AI, SWIFT-Active Screener).
• Dual human reviewers.

Procedure:

• AI Training & Calibration:
  • Upload the full unfiltered search results to the AI screening software.
  • A minimum of 50-100 studies should be screened independently by two human reviewers against the PECO criteria to establish a "ground truth" training set. Prioritize screening a random sample or studies published in key journals.
  • Input these human decisions (Include/Exclude) into the AI tool to train its prediction model.

• Iterative Screening Loop:

  • The AI software will prioritize the remaining uncategorized studies, presenting those it predicts as most relevant first.
  • Reviewers screen the AI-prioritized studies, making final Include/Exclude decisions based on the PECO criteria.
  • Each new decision is fed back into the AI model in real-time, continuously improving its prioritization for subsequent records.

• Stopping Rule & Validation:

  • Pre-define a stopping rule (e.g., stop after screening 100 consecutive studies without a new inclusion).
  • After the stopping rule is triggered, a random sample (e.g., 10%) of the AI-excluded records should be screened by a human to validate the AI's performance and estimate the recall rate.

• Documentation:

  • The final protocol and report must document: the AI tool used, the size and source of the initial training set, the stopping rule, and the results of the validation check [59]. This transparency is critical for acceptance.

Table 3: Key Research Reagent Solutions & Resources

Item / Resource	Function & Purpose	Application Notes
PRISMA 2020 Statement & Checklist	The definitive reporting guideline for systematic reviews and meta-analyses. Ensures all methodological and reporting elements, including PECO, are fully documented [21].	Use the PRISMA-P extension for writing the protocol [37]. The PRISMA 2020 flow diagram is mandatory for publication.
PROSPERO Registry	International prospective register of systematic reviews. Registration of a protocol, including the PECO statement, timestampes the plan, reduces bias, and avoids duplication [38].	Required for health-related reviews. Note: Scoping reviews and evidence maps are not currently eligible [38].
Open Science Framework (OSF)	An open-source platform for project management and preregistration. Can be used to register protocols for any type of SR, including scoping reviews and evidence maps [38] [37].	Offers greater flexibility than PROSPERO for non-intervention reviews. Useful for hosting supplemental files like search strategies.
PECO/PICO Framework	The conceptual framework for structuring a precise, answerable research question. The foundation for all subsequent review steps [21].	The PICOTS variant (adding Timeframe and Study Design) is highly recommended for ecotoxicity to ensure appropriate temporal and methodological scope [21].
Covidence, Rayyan, EPPI-Reviewer	Web-based software platforms for managing the screening, data extraction, and quality assessment phases of a review.	These tools enforce dual independent screening and resolution of conflicts, directly operationalizing the PECO criteria and improving reproducibility.
AI Screening Software (e.g., ASReview)	Implements "human-in-the-loop" active learning to prioritize studies for screening, significantly increasing efficiency [59].	Most effective when PECO criteria are highly specific. Performance and transparency must be documented in the review report [59].

Standardized Reporting and Protocol Registration

Clear reporting and public protocol registration are non-negotiable for reproducible science. Adherence to the following standards is critical for review acceptance.

Mandatory Reporting Checklist (PRISMA-P & PRISMA 2020)

The PECO statement and its development must be reported within the structure of PRISMA guidelines [37].

• In the Protocol (PRISMA-P): Report the PECO components as Item 7 (Eligibility Criteria). Item 6 (Rationale) should explain the reasoning behind the chosen PECO scope [37].
• In the Final Review (PRISMA 2020): Report the PECO components as Item 4 (Eligibility Criteria). Any changes to the PECO criteria after protocol registration must be declared and justified in Item 5 (Information Sources) or Item 24 (Protocol Registration).

Protocol Registration Procedure

Public registration is a cornerstone of transparency [38] [37].

• Choose a Registry: Select PROSPERO (for health-focused reviews) or OSF Registries (for all review types, including environmental evidence maps) [38] [37].
• Prepare Information: Have the following finalized: Review title, team details, PECO statement, search strategy, data extraction plan, and risk of bias/synthesis methods.
• Submit and Record: Complete the registry's form. PROSPERO provides a unique registration number (CRDXXXXX). OSF provides a permanent, time-stamped DOI.
• Cite and Link: The registration number/DOI must be cited in the abstract and methods section of the final review manuscript.

Advanced Application: PECO in Systematic Evidence Maps (SEMs)

Systematic Evidence Maps (SEMs) are a related evidence synthesis product that inventories and describes the breadth of literature on a broad topic. Transparent PECO use is equally vital here [82].

Adaptation of PECO for SEMs:

• Population, Exposure, Comparator: Often defined more broadly than in an SR to capture the full landscape.
• Outcome: May be inclusive of all measured outcomes or a wide range of predefined categories (e.g., all ecotoxicological endpoints).
• Key Difference: The goal is not to synthesize effect estimates for a specific outcome, but to categorize and visualize the availability of evidence. The PECO framework ensures this mapping is systematic and reproducible [82].

Protocol Integration: The SEM workflow follows the same PECO-driven process in Diagram 1, but the "Evidence Synthesis" phase is replaced by "Coding and Visualization" (e.g., creating interactive heatmaps of evidence density by PECO category) [82].

Conclusion

A meticulously developed PECO statement is the indispensable cornerstone of a rigorous, transparent, and policy-relevant ecotoxicity systematic review. This guide has synthesized the journey from foundational concepts through practical application, troubleshooting, and validation. The key takeaway is that a robust PECO is not a static starting point but an evolving guide shaped by iterative scoping, problem formulation, and engagement with the evidence base. For biomedical and clinical research, particularly in toxicology and drug safety assessment, adopting these structured approaches enhances the ability to synthesize complex evidence from human, animal, and New Approach Methodologies (NAM) data. Future directions must focus on further standardizing methods for assessing indirect evidence and biological plausibility within frameworks like GRADE, improving the integration of mechanistic data, and ensuring PECO frameworks remain adaptable to novel scientific and regulatory challenges. Ultimately, mastering PECO development empowers researchers to produce systematic reviews that can reliably inform risk assessment and protect public health[citation:1][citation:2][citation:5].

References

• 1. Systematic evidence map (SEM) template [https://pmc.ncbi.nlm.nih.gov/articles/PMC12044641/]
• 2. How to use the PICO Framework to Aid Critical Appraisal [https://casp-uk.net/pico-framework/]
• 3. Table A-1, Populations, Exposures, Comparators, and ... [https://www.ncbi.nlm.nih.gov/books/NBK601288/table/appa.tab1/?report=objectonly]
• 4. New report calls for expanding the risk assessment toolbox [https://www.niehs.nih.gov/news/factor/2023/9/science-highlights/guidelines-for-nams-risk-assessment]
• 5. Chapter: Summary [https://www.nationalacademies.org/read/26289/chapter/2]
• 6. Chapter: 3 Planning Assessments [https://www.nationalacademies.org/read/26289/chapter/5]
• 7. Facilitation of risk assessment with evidence-based methods [https://www.sciencedirect.com/science/article/pii/S0273230020302166]
• 8. Mapping the evidence of the effects of environmental ... [https://www.sciencedirect.com/science/article/pii/S0160412022006341]
• 9. Identifying the PECO: A framework for formulating good ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC6908441/]
• 10. Ten Steps to Conduct a Systematic Review - PMC [https://pmc.ncbi.nlm.nih.gov/articles/PMC10828625/]
• 11. Conducting a High-Quality Systematic Review [https://www.jrheum.org/content/52/7/636]
• 12. PICO vs PECO: Choosing the Right Framework for Your ... [https://www.linkedin.com/posts/adane-etore_publichealth-diseasesurveillance-emergencypreparedness-activity-7348942388247089152-Hg4m]
• 13. The impact of patient, intervention, comparison, outcome ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC6148624/]
• 14. The PICO Framework - Systematic Reviews - NTU LibGuides [https://libguides.ntu.edu.sg/c.php?g=936042&p=6768649]
• 15. Formulate Research Question Using PICO [https://libguides.lb.polyu.edu.hk/syst_review/PICO]
• 16. Development of a framework to structure decision-making ... [https://www.sciencedirect.com/science/article/pii/S0160412024007967]
• 17. Systematic Reviews: Research Question - MUSC Library [https://musc.libguides.com/systematicreviews/researchquestion]
• 18. Alternatives to PICO for Non-Clinical Research Questions [https://azhin.org/cummings/pico-alternatives]
• 19. Scoping and Problem Formulation - NCBI - NIH [https://www.ncbi.nlm.nih.gov/books/NBK552813/]
• 20. EPA must improve its TSCA systematic review method ... [https://prheucsf.blog/2022/07/28/epa-must-improve-its-tsca-systematic-review-method-scientific-review-says-again/]
• 21. Methodological Standards for Conducting High-Quality ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC12383630/]
• 22. A Curated Database of Ecologically Relevant Toxicity Tests to ... [https://academic.oup.com/etc/article/41/6/1520/7730623]
• 23. Issues in Developing a Scientific Confidence Framework for ... [https://www.ncbi.nlm.nih.gov/books/n/nap26906/ch5/]
• 24. A proposed framework for the systematic review and ... [https://ehjournal.biomedcentral.com/articles/10.1186/s12940-016-0156-6]
• 25. Reporting guidelines under development for systematic ... [https://www.equator-network.org/library/reporting-guidelines-under-development/reporting-guidelines-under-development-for-systematic-reviews/]
• 26. Identifying the PECO: A framework for formulating good ... [https://www.semanticscholar.org/paper/Identifying-the-PECO%3A-A-framework-for-formulating-Morgan-Whaley/f9d65204ca2da625dd3756a8c645a87be1c88511]
• 27. Exposure Definition and Measurement - NCBI - NIH [https://www.ncbi.nlm.nih.gov/books/NBK126191/]
• 28. Linking complex disease and exposure data—insights from ... [https://www.nature.com/articles/s41370-022-00428-7]
• 29. Comparator Selection - NCBI - NIH [https://www.ncbi.nlm.nih.gov/books/NBK126184/]
• 30. PCORI Methodology Standards [https://www.pcori.org/research-related-projects/about-our-research/research-methodology/pcori-methodology-standards]
• 31. A comprehensive guide to conduct a systematic review and ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC12366998/]
• 32. Systematic Reviews: Step 7: Extract Data from Included Studies [https://guides.lib.unc.edu/systematic-reviews/extract-data]
• 33. Good review practice: a researcher guide to systematic review ... [https://ifis.libguides.com/systematic_reviews/presenting-results]
• 34. Synthesising quantitative and qualitative evidence to ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC6350750/]
• 35. Types of Reviews - Systematic Reviews - Guides [https://guides.mclibrary.duke.edu/sysreview/types]
• 36. Guidelines for performing systematic reviews in the ... [https://www.sciencedirect.com/science/article/pii/S0273230017303100]
• 37. LibGuides: Systematic Reviews: Step 2: Develop a Protocol [https://guides.lib.unc.edu/systematic-reviews/protocol]
• 38. 3. Write and Register a Protocol - Systematic Reviews - Guides [https://guides.mclibrary.duke.edu/sysreview/protocol]
• 39. Color palettes and accessibility features for data ... - Medium [https://medium.com/carbondesign/color-palettes-and-accessibility-features-for-data-visualization-7869f4874fca]
• 40. Data visualisation: colours - Government Analysis Function [https://analysisfunction.civilservice.gov.uk/policy-store/data-visualisation-colours-in-charts/]
• 41. Colour contrast [https://goodpractices.design/articles/colour-contrast]
• 42. Types of Color Schemes | GEOG 486 - Dutton Institute [https://www.e-education.psu.edu/geog486/node/878]
• 43. EPA needs to fix its rules for identifying health effects under ... [https://prheucsf.blog/2022/04/08/epa-needs-to-fix-its-rules-for-identifying-health-effects-under-tsca/]
• 44. Methods - NTP Research Report on the Scoping Review of ... [https://www.ncbi.nlm.nih.gov/books/NBK564156/]
• 45. Validation of dietary assessment methods for PFOS ... [https://www.sciencedirect.com/science/article/pii/S0160412025003502]
• 46. Application of systematic evidence mapping to assess the ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC7917575/]
• 47. Application of the navigation guide systematic review ... [https://www.sciencedirect.com/science/article/pii/S0160412021000027]
• 48. Associations Between Occupational Exposures to Volatile ... [https://www.ssph-journal.org/journals/public-health-reviews/articles/10.3389/phrs.2025.1608224/full]
• 49. New Methodologies and Techniques for Biomonitoring ... [https://www.mdpi.com/2305-6304/13/2/104]
• 50. Data Extraction - Systematic Reviews in Health [https://canberra.libguides.com/systematic/extract]
• 51. Evaluating the ability to detect effects in systematic reviews ... [https://www.sciencedirect.com/science/article/abs/pii/S0160412016300988]
• 52. Chapter: 4 Study Evaluation [https://www.nationalacademies.org/read/26289/chapter/6]
• 53. Quantitative Consensus in Systematic Reviews [https://pmc.ncbi.nlm.nih.gov/articles/PMC5879943/]
• 54. New approach methodologies (NAMs): identifying and ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC10964841/]
• 55. Variability and Relevance of Current Laboratory ... [https://www.nationalacademies.org/projects/DELS-BEST-21-02/event/36442]
• 56. The dawn of animal-free safety: A comprehensive review ... [https://www.sciencedirect.com/science/article/pii/S305047592500853X]
• 57. New approach methodologies in human regulatory ... [https://www.sciencedirect.com/science/article/pii/S0160412023003550]
• 58. New Approach Methods (NAMs) and Alternatives to Animal ... [https://toxstrategies.com/services/new-approach-methods-nams-and-alternatives-to-animal-testing/]
• 59. 2025 Annual Meeting Report: Transparency and AI ... [https://toxchange.toxicology.org/blogs/kel-deshong/2025/05/01/2025-annual-meeting-report-transparency-and-ai-and]
• 60. Protocol for a systematic evidence map of environmental ... [https://www.sciencedirect.com/science/article/pii/S0160412025005902]
• 61. and poly-fluoroalkyl substances (PFAS) - RSC Publishing [https://pubs.rsc.org/en/content/articlehtml/2025/em/d4em00696h]
• 62. Urban Institute Data Visualization style guide - GitHub Pages [http://urbaninstitute.github.io/graphics-styleguide/]
• 63. Implementing systematic review techniques in chemical risk ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC4881816/]
• 64. Summary - Review of EPA's Integrated Risk Information ... [https://www.ncbi.nlm.nih.gov/books/NBK230060/]
• 65. Basic Information about the Integrated Risk ... [https://www.epa.gov/iris/basic-information-about-integrated-risk-information-system]
• 66. EPA Publishes IRIS Handbook and Final IRIS Assessment ... [https://www.epa.gov/newsreleases/epa-publishes-iris-handbook-and-final-iris-assessment-perfluorobutanoic-acid-pfba-and]
• 67. IRIS and the National Academies of Sciences (NAS) [https://www.epa.gov/iris/iris-and-national-academies-sciences-nas]
• 68. Looking at EPA's IRIS: The Manufactured Toxic Toxicity ... [https://frey.wordpress.ncsu.edu/2025/06/12/looking-at-epas-iris-the-manufactured-toxic-toxicity-controversy-that-shouldnt-be/]
• 69. GRADE: Assessing the quality of evidence in ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC4902742/]
• 70. GRADE handbook [https://gradepro.org/handbook]
• 71. Recommendations for the conduct of systematic reviews in ... [https://www.sciencedirect.com/science/article/pii/S016041202031881X]
• 72. The GRADE approach, Part 1: how to assess the certainty ... [https://www.medwave.cl/revisiones/metodinvestreport/8109.html?lang=en]
• 73. Chapter 7: GRADE Criteria Determining Certainty of ... [https://www.cdc.gov/acip-grade-handbook/hcp/chapter-7-grade-criteria-determining-certainty-of-evidence/index.html]
• 74. A systematic scoping review of the methodological ... [https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0251197]
• 75. Visual Evidence: Increasing Usability of Systematic ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC6774757/]
• 76. Color Use Guidelines for Mapping and Visualization [https://web.natur.cuni.cz/~langhamr/lectures/vtfg1/mapinfo_2/barvy/colors.html]
• 77. Contrast requirements for WCAG 2.2 Level AA [https://www.makethingsaccessible.com/guides/contrast-requirements-for-wcag-2-2-level-aa/]
• 78. Text has enhanced contrast | ACT Rule | WAI [https://www.w3.org/WAI/standards-guidelines/act/rules/09o5cg/]
• 79. Doing a systematic review: Step 1: creating a protocol ... [https://libguides.reading.ac.uk/systematic-review/protocol]
• 80. A call to action: Advancing new approach methodologies ... [https://www.sciencedirect.com/science/article/pii/S0273230025001345]
• 81. Evaluation of the evidence on acetaminophen use and ... [https://pmc.ncbi.nlm.nih.gov/articles/PMC12351903/]
• 82. Guidance to undertaking systematic evidence maps [https://www.sciencedirect.com/science/article/pii/S0160412025005781]