Empowering ecological modellers with a PERFICT workflow: Seamlessly linking data, parameterisation, prediction, validation and visualisation

Section 1: Publication

Publication Type

Authorship

Barros, C., Luo, Y., Chubaty, A. M., Eddy, I. M. S., Micheletti, T., Boisvenue, C., Andison, D. W., Cumming, S. G., McIntire, E. J. B.

Title

Empowering ecological modellers with a PERFICT workflow: Seamlessly linking data, parameterisation, prediction, validation and visualisation

Year

2023

Publication Outlet

Methods in Ecology and Evolution, 14(1), 173-188

DOI

https://doi.org/10.1111/2041-210X.14034

ISBN

ISSN

Citation

Abstract

1.) Modelling is widely used in ecology and its utility continues to increase as scientists, managers and policy-makers face pressure to effectively manage ecosystems and meet conservation goals with limited resources. As the urgency to forecast ecosystem responses to global change grows, so do the number and complexity of predictive ecological models and the value of iterative prediction, both of which demand validation and cross-model comparisons. This challenges ecologists to provide predictive models that are reusable, interoperable, transparent and able to accommodate updates to both data and algorithms.
2.)We propose a practical solution to this challenge based on the PERFICT principles (frequent Predictions and Evaluations of Reusable, Freely accessible, Interoperable models, built within Continuous workflows that are routinely Tested), using a modular and integrated framework. We present its general implementation across seven common components of ecological model applications—(i) the modelling toolkit; (ii) data acquisition and treatment; (iii) model parameterisation and calibration; (iv) obtaining predictions; (v) model validation; (vi) analysing and presenting model outputs; and (vii) testing model code—and apply it to two approaches used to predict species distributions: (1) a static statistical model, and (2) a complex spatiotemporally dynamic model.
3.) Adopting a continuous workflow enabled us to reuse our models in new study areas, update predictions with new data, and re-parameterise with different interoperable modules using freely accessible data sources, all with minimal user input. This allowed repeating predictions and automatically evaluating their quality, while centralised inputs, parameters and outputs, facilitated ensemble forecasting and tracking uncertainty. Importantly, the integrated model validation promotes a continuous evaluation of the quality of more- or less-parsimonious models, which is valuable in predictive ecological modelling.
4.) By linking all stages of an ecological modelling exercise, it is possible to overcome common challenges faced by ecological modellers, such as changing study areas, choosing between different modelling approaches, and evaluating the appropriateness of the model. This ultimately creates a more equitable and robust playing field for both modellers and end users (e.g. managers), and contributes to position predictive ecology as a central contributor to global change forecasting.

Plain Language Summary