Geneva, 10 December 2024
Evaluation of ALIPH-funded projects focusing on the production of digital heritage (3D digitization & satellite imagery analysis)
Terms of Reference
As part of its evaluation policy, ALIPH is seeking a reviewer to evaluate a series of ALIPH-funded projects that produced digital data, notably in the context of 3D digitization and satellite imagery analysis projects
To date, the ALIPH Foundation has supported 11 projects that have produced and relied on the analysis of 3D models and satellite imagery. The usage of this category of data is relatively new in the field of cultural heritage. It raises important questions, regarding context of production, standard and interoperability of the data, storage, access, usage, intellectual property, privacy and security, etc.
For these reasons, the Foundation is reviewing projects in its portfolio that produced digital assets. The selected evaluator will be required to propose the following:
1. Technical evaluation of a selection of projects, including an assessment of how the data were produced, managed, and used;
2. Production of practical standards to ensure the quality (accuracy, precision, geographic coordinate system) and interoperability of the data produced and facilitate its use by the largest quantity of operators;
3. Recommendations to the Foundation regarding the conditions under which ALIPH should keep supporting these projects.
I – Target of the evaluation
Out of the 11 projects funded, ALIPH will select for the evaluator:
• two satellite imagery projects, each from a different operator;
• six 3D scanning projects from at least three different operators, with no more than 20 scanned structures total to assess.
II – Objectives of the evaluation
The evaluation will focus on the following issues:
A - Technical Evaluation
a. Technical quality of the data production and management:
• How was the raw data produced in the course of the project?
• Did the raw and processed data comply with international standards in terms of quality, accuracy, and interoperability?
• Overall quality and sustainability of the data management plan (including long-term storage solutions, data protection, etc.)
b. Scientific quality of the data produced and project outcome:
• Impact and use of the data in the protection of the targeted cultural heritage;
• Quality of the secondary data produced during the project (i.e., plans, reports, models, etc.);
• Ability of other third-party partners to access and use the data for heritage conservation projects;
• Quality of the delivery to the Foundation
c. Integration of local actors and institutions:
• Integration of local actors and institutions in the preparation of the project and the production of the data. Efficiency of the transfer of competence during the project;
• Assessment of the number and quality of job opportunities generated;
• Access by the community to the data produced (including access to software necessary to process and analyze the data);
• Status of the data intellectual property and discussion with local institutions regarding right to use and show the data.
B - Standards
As ALIPH aims to maximize the use of its data, it needs to propose a set of practical standards for its operators in the production and analysis of digital data, both 3D and satellite imagery. These standards can be based on existing studies (such as the “Study on Quality in 3D digitisation of tangible cultural heritage”) but will need to account for the operators complex operational environment. These standards will especially need to address:
• Data accuracy and precision: standards for the level of detail and measurement accuracy for digitization of cultural heritage;
• Geographic coordinate system and georeferencing: guidelines for ensuring data is properly georeferenced;
• File format and data interoperability: standards file formats (OBJ, STL, LAS) and metadata schemas to ensure compatibility and ease of sharing across different platforms and software;
• Data integrity and quality control: procedures for verifying the integrity and consistency of datasets.
C – Recommendations
Following the assessments of the digital assets, the evaluator will produce a series of recommendations to help ALIPH target its funding more effectively and ensure the long-term impact of its digital projects. Notably, these recommendations should propose selection variables such as:
• Minimum technical specifications;
• Interoperability plan;
• Sustainability of the outputs;
• Application of the outputs;
• Engagement with local communities
III – Methodology of the evaluation
The evaluation will need to define a clear methodological framework and analyze the main learning components to identify lessons learned and provide clear recommendations. See the list below:
a. Create a methodological framework that identifies the standards of reference for the evaluation. The reviewer may employ any appropriate quantitative or qualitative method as needed.
b. Carry out a comprehensive desk review of relevant documents related to ALIPH’s projects and international standards in digital data production and management.
c. Carry out a comprehensive assessment of selected 3D and satellite data received by the ALIPH foundation. If justified, carry out assessments of raw data on the servers of the organizations funded by ALIPH.
d. Carry out interviews with members of the ALIPH-funded organizations, and, if necessary, relevant ALIPH’s staff, as well as local community representatives involved in the projects
e. Identify the main lessons learned. Identify the strengths of each approach and provide a series of standards and good practices for ALIPH operators (including format of deliverables and storage solutions for the ALIPH Foundation).
f. Propose recommendations regarding ALIPH’s management strategy of this type of datasets as well as funding strategy for future similar projects.
IV – Proposal
a. Required experience.
• Proven technical expertise in the production and/or evaluation of digital heritage projects, including 3D digitization and satellite imagery analysis;
• Evaluation of cultural heritage projects;
• Creation and implementation of an evaluation methodology relying on quantitative and qualitative data;
• Demonstrated ability to carry out interviews with a diversity of stakeholders;
• Compilation and analysis of the collected data into a coherent report;
• If required, ability to travel to the location of data production and storage.
b. Elements of the proposal
• Description of the applicant’s approach and methodology tailored to the project and the needs of the evaluation;
• Brief description of the applicant’s track record in relevant projects, with writing sample;
• CV of the lead applicant;
• Budget with daily fees and tentative planned travel expenses.
V – Administration
a. Timeline
The timeline will be as follows:
• 11 December 2024: publication of the RFP
• 15 January 2025: deadline for submission of proposals
• 7 February 2025: attribution of evaluation by ALIPH
• Mid-February 2025: signing of the review contract, beginning of work
• June 2025: submission of a draft final report, feedback from ALIPH and online meetings with ALIPH’s staff
• 4 July 2025: final report
b. Budget
ALIPH estimates a total of 25 to 30 days to carry out this project. The budget of this evaluation can be up to 19,000 USD, inclusive of taxes and tentative travel expenses, and be paid in two instalments (50% at signature, 50% at approval of the final report).
c. Deliverables
A final report draft will be presented in June 2025 and will need to be approved by ALIPH. A final report will integrate this feedback and be presented to the Foundation to share the main lessons learned by July 4th, 2025.
d. Language
The report will be written in English.
VI – The organization
ALIPH was founded in 2017 as a private-public partnership. Based in Geneva, this Swiss foundation has the privileges and immunities of an international organization.
Since 2018, ALIPH has supported more than 500 projects in 41 countries on 4 continents. Wherever possible, ALIPH strives to finance projects that are carried out on the ground. In all cases, ALIPH’s objective is to work hand in hand with local partners, authorities, and communities.
ALIPH offers grants through competitive calls for application and through a rolling emergency support mechanism.
For questions, please contact Bastien Varoutsikos
bastien.varoutsikos@aliph-foundation.org