Workshop at the 20th AGILE International Conference on Geographic Information Science, Wageningen, The Netherlands
A small but productive group gathered in a half-day pre-conference workshop to discuss a huge and challenging topic: reproducible research (RR). The workshop started with a short history of and motivation for the workshop. The organizers (see below) reported on the original call for papers with public peer review and the realization that the topics reproducibility, computational reproducibility, replication, etc. are apparently not high on the AGILE community agenda. As a result, the workshop was re-oriented towards knowledge exchange and collaboration: learning more about the state of reproducibility at AGILE, and joining forces to contribute to AGILE with an exploration on how the conference could improve and extend on RR.
After the introduction, all participants shared their experiences and understanding of RR. Then an in-depth discussion on the relevance of reproducibility for research in general and for AGILE (member labs, conference) followed. A discussion of terms (reproduction, replication, openness, …) naturally had to be there, too, accompanied by references to most relevant meta-papers in the area and the aspects of education/skills and scientific culture.
The participants agreed early on to collaborate on a position paper to be submitted to next year’s AGILE conference. A number of questions will lead the research and paper writing. Here are a few examples.
The organizers want to thank the participants again for making the workshop a success! The workshop’s format was received well as a “hands-on discussion”, and not “just another round of presentations”. As for the content, the participants were happy to learn about “what’s happening in reproducible research”, got a “first insight into a new field”, and found the bits of links/papers shared during the discussion “educational”. More feedback is very welcome, please get in touch. A second edition of the workshop is of course on the agenda.
Next steps for the newly formed collaboration are first enjoying a well-organized AGILE conference and asking hard questions on reproducibility during all the diverse sessions. In a few weeks, we plan to meet online and share the progress on first actions taken for the position paper.
Reproducible research (RR) gains more attention each year with prominent papers, editorials and blog posts as journals, researchers and funders drive forward the agenda on open science. But still the majority of papers analysing data, including diverse and often unique spatio-temporal observations, are not accompanied by complete materials (data, code/methods, complete results) so that anyone can reproduce the findings. In this workshop we want to discuss in an informal setting if and how RR is relevant for the AGILE organization as well as conference. The workshop’s goal is to create an outline for a position paper “Reproducible Research for the future of AGILE” to be submitted to AGILE 2018.
If you are interested in putting RR on the map for the AGILE community we look forward to welcome your ideas at the workshop or via email.
Date & time: May 9 2017 @ 13:30-17:00 (see conference programme)