ISCA 2023

Process

The authors of accepted papers at ISCA 2023 will be invited to submit their artifacts according to the established submission guidelines. Submission will be then reviewed according to the reviewing guidelines. Papers that successfully go through AE will receive a set of ACM badges of approval printed on the papers themselves and available as meta information in the ACM Digital Library (it is now possible to search for papers with specific badges in ACM DL). Authors of such papers will have an option to include a two-page-max artifact appendix to their camera-ready paper. The optional artifact appendix pages will be free of charge.

ACM Reproducibility Badges

Artifact Submission

An artifact submission consists of two parts:
1. The paper and a two-page appendix. Please prepare your appendi using the provided template. The appendix is expected to contain the following main sections:
   • an abstract
   • an itemized metainformation list
   • access to the artifact
   • system requirements and dependencies
   • experiment workflow
   • steps for evaluation
   • results
   Note that the paper does not need to be the final version, as the main goal of this submission is to let artifact reviewers reproduce your experiments.
2. The artifact. Please make your artifact accessible by the reviewing committee. We do not limit the way of code delivery. However, if you would like to apply for the "Artifact Available" badge, you will need to have your artifact available at a public archival repository (for more details, see the reviewing guide).
The artifact. Please submit your artifact on our submission site . When you submit, please provide details about the artifact's software and hardware requirements. This will be extremely helpful for the Artifact Evaluation Committee to find suitable reviewers.

Benefits

There are major benefits to introducing AE in our conferences.

1. Dissemination of Ideas: The goal of our research is to disseminate insights and encourage people to build upon that idea. Open-sourcing the artifacts and opening up the ideas to the whole community ensures that the community can work together towards solving an important problem.
2. Reproducibility of the Results: Artifact evaluation promotes reproducibility of experimental results and encourages code and data sharing to help the community quickly validate and compare alternative approaches.
3. Safeguarding the Review Process: AE incentivizes people to conduct research in an ethical manner. The recent example of misconduct in our conference reviewing process has greatly hurt the reputation of this community. Introducing AE can help to restore our integrity and commitment to reproducible and ethical research.