How do we ensure that ENHANCE tools deliver reliable, usable, and actionable One Health information?
Deliverable D4.1 – Evaluation Methodology & Test Scenarios defines the framework that will guide the assessment of ENHANCE services across the three case studies . It establishes how technical performance, user experience, and socio-economic impact will be measured throughout the pilot phases.
The document translates the One Health framework into concrete evaluation scenarios for:
- Barcelona urban beaches (CS1-A)
- Ebro Delta (CS1-B)
- Pagasitikos Gulf (CS2)
For each case study, D4.1 specifies:
- The selected One Health indicators (human, animal, environmental health)
- The associated data sources (Copernicus EO, citizen science, in-situ monitoring, laboratory analysis)
- The user profiles involved through Living Labs
- The expected ENHANCE products, from turbidity and chlorophyll-a maps to biodiversity indicators and composite risk indices
Beyond defining what will be tested, the deliverable structures how performance will be assessed.
A multi-dimensional evaluation framework
D4.1 introduces a comprehensive evaluation model built on three pillars:
1. Technical performance
Verification of satellite-derived products, AI-assisted classification tools, and composite indices such as:
- The Human Health Outcome Index (HHOI)
- The Aquatic Animal Health Risk Index (AAHRI)
- The Environmental Ecosystem Quality Index (EEQI)
- A Coastal One Health Assessment Index
2. User experience (UX)
Structured task-based testing sessions in each pilot site assess:
- Usability and clarity of maps and dashboards
- Ability to interpret indicators
- Likelihood of future use
3. Socio-economic and stakeholder adoption
A dedicated KPI framework evaluates:
- Living Lab process satisfaction
- Adoption intention rates
- Policy relevance
- Sectoral uptake (aquaculture, tourism, coastal planning)
- Replication and scaling potential
The evaluation workflow is iterative, supporting two pilot waves and continuous refinement of tools between M20 and M27 .
D4.1 ensures that ENHANCE is not only technically robust, but also operationally relevant and socially embedded. It provides the methodological backbone that will validate the project’s impact in real coastal contexts and prepare the ground for replication beyond the pilot regions.