Frequently Asked Questions

  1. Who are you?

    We are Christian Collberg and Todd Proebsting from the Department of Computer Science at the University of Arizona.

  2. Why are you doing this?

    In order to repeat, reproduce, or extend published computer science research, we need, at the very least, access to the code and data (the research artifacts) that were used in collecting the results of the original paper. Experience has shown that gaining access to research artifacts can be difficult, particularly when a few years have passed since publication. A related problem is being able to contact the authors of a paper to enquire about some issue, given that email addresses change over time. We want to encourage sharing in the computer science research community. Please read our CACM paper and technical report which describe our previous experience with sharing of research artifacts.

  3. What are the goals of this work?

    1. To be the go-to point where the public can locate the artifacts related to a paper they are reading;
    2. To encourage researchers to share their artifacts by showing how common sharing is in their communities;
    3. To collect longitudinal data of artifact sharing trends for the benefit of those with a vested interest in sharing, repeatability, and reproducibility, such as funding agencies and the tax-paying public.

  4. How can I help?

    If you are interested in your favorite conference being included on and you are willing to help, please get in touch with us at The major part of the manual work we have to do is verifying email addresses found in papers, and chasing down missing addresses. We have a system set up that makes this easy, albeit tedious, work, and we would love to get help doing this so that we can expand our coverage.

  5. How does your system work?

    1. When a new conference proceedings is published we semi-automatically extract bibliographical, funding, and artifact information for each paper;
    2. We contact each author by email, asking them to correct and complete the information (an author can also update this information at any later point in time);
    3. The information is added to our website;
    4. We compute and display statistical sharing trends as they evolve over time.

  6. How do you get access to your data?

    We use DBLP to get lists of published papers. We get email addresses of authors from a variety of sources, mainly through semi-automatic extraction from the paper PDFs themselves, but also by scanning NSF's database of funded grant abstracts, and, when all else fails, by searching for the authors online.

  7. Who is funding you?

    We have received a 5-year grant for $357,568 from a private foundation. If you like what we're doing, consider helping us out with additional funding.

  8. Do you have IRB approval?


  9. Do you share your code and data?

    We will be sharing both shortly.

  10. Can you please remove my paper from your website?

    No, we will not do that.

  11. I disagree with a particular comment in the discussion about my paper; can you please remove it?

    We will remove comments only if they are libelous.

  12. Why are some conferences and papers in gray text?

    We ask all authors to verify the information we have about their papers, in particular the location of any supporting artifacts. We send out emails to authors asking them to update or verify this information incrementally, one conference at a time. For conferences where these emails have yet to be sent out we present the information in gray text.