SIGIR 2013 will introduce a new review criterion, Reproducibility of Methods. These are the exact questions that the reviewers will see on the new review form: Reproducibility of Methods Are the descriptions of the methods used detailed and accurate? Given the resources used in the paper, or (if they are unavailable) similar resources, could researchers carry out similar experiments to verify the