Thoughts and Recommendations from the ACM SIGCOMM 2017 Reproducibility Workshop

Description

Ensuring the reproducibility of results is an essential part of experimentalsciences, including computer networking. Unfortunately, as highlightedrecently, a large portion of research results are hardly, if not at all,reproducible, raising reasonable lack of conviction on the research carriedout around the world.Recent years have shown an increasing awareness about reproducibility ofresults as an essential part of research carried out by members of the ACMSIGCOMM community. To address this important issue, ACM has introduced a newpolicy on results and artifacts review and badging. The policy defines theterminology to be used to assess results and artifacts but does not specify thereview process or how to make research reproducible.During SIGCOMM'17 a side workshop has been organized with the specific purposeto tackle this issue. The objective being to trigger discussion and activity inorder to craft recommendations on how to introduce incentives for authors toshare their artifacts, and the details on how to use them, as well as definingthe process to be used.This editorial overviews the workshop activity and summarizes the maindiscussions and outcomes.

Additional details