Conference Information
ISSTA 2021: International Symposium on Software Testing and Analysis
https://conf.researchr.org/home/issta-2021
Submission Date:
2021-01-29
Notification Date:
2021-03-24
Conference Date:
2021-07-12
Location:
Aarhus, Denmark
Years:
30
CCF: a   CORE: a   QUALIS: a2   Viewed: 31105   Tracked: 54   Attend: 3

Conference Location
Call For Papers
Technical Papers

Authors are invited to submit research papers describing original contributions in testing or analysis of computer software. Papers describing original theoretical or empirical research, new techniques, methods for emerging systems, in-depth case studies, infrastructures of testing and analysis, or tools are welcome.

Experience Papers

Authors are invited to submit experience papers describing a significant experience in applying software testing and analysis methods or tools and should carefully identify and discuss important lessons learned so that other researchers and/or practitioners can benefit from the experience. Of special interest are experience papers that report on industrial applications of software testing and analysis methods or tools.

Reproducibility Studies

ISSTA would like to encourage researchers to reproduce results from previous papers. A reproducibility study must go beyond simply re-implementing an algorithm and/or re-running the artifacts provided by the original paper. It should at the very least apply the approach to new, significantly broadened inputs. Particularly, reproducibility studies are encouraged to target techniques that previously were evaluated only on proprietary subject programs or inputs. A reproducibility study should clearly report on results that the authors were able to reproduce as well as on aspects of the work that were irreproducible. In the latter case, authors are encouraged to make an effort to communicate or collaborate with the original paper’s authors to determine the cause for any observed discrepancies and, if possible, address them (e.g., through minor implementation changes). We explicitly encourage authors to not focus on a single paper/artifact only, but instead to perform a comparative experiment of multiple related approaches. In particular, reproducibility studies should follow the ACM guidelines on reproducibility (different team, different experimental setup): The measurement can be obtained with stated precision by a different team, a different measuring system, in a different location on multiple trials. For computational experiments, this means that an independent group can obtain the same result using artifacts which they develop completely independently. This means that it is also insufficient to focus on repeatability (i.e., same experiment) alone. 

Reproducibility Studies will be evaluated according to the following standards:

    Depth and breadth of experiments
    Clarity of writing
    Appropriateness of conclusions
    Amount of useful, actionable insights
    Availability of artifacts

We expect reproducibility studies to clearly point out the artifacts the study is built on, and to submit those artifacts to artifact evaluation (see below). Artifacts evaluated positively will be eligible to obtain the highly prestigious badges Results Replicated or Results Reproduced.
Last updated by Dou Sun in 2020-06-07
Acceptance Ratio
YearSubmittedAcceptedAccepted(%)
20141283628.1%
20131243225.8%
20121083128.7%
20111213528.9%
20101052422.9%
2009932526.9%
20081003535%
20071032221.4%
2006842226.2%
2004932830.1%
2002972626.8%
2000732128.8%
1998471634%
1996692434.8%
Related Conferences
CCFCOREQUALISShortFull NameSubmissionNotificationConference
ab4ENASEInternational Conference on Evaluation of Novel Approaches to Software Engineering2019-02-212019-02-282019-05-04
b3MOBIWACInternational Symposium on Mobility Management and Wireless Access2020-08-152020-09-102020-11-16
RO-MANIEEE International Conference on Robot and Human Interactive Communication2018-03-19 2018-08-27
cICESSInternational Conference on Embedded Software and Systems2019-03-122019-04-022019-06-02
SarnoffIEEE Sarnoff Symposium2019-07-012019-08-192019-09-23
SecTechInternational Conference on Security Technology2015-10-102015-10-302015-11-25
CALDAMInternational Conference on Algorithms and Discrete Applied Mathematics2018-10-012018-11-112019-02-14
ICIICInternational Conference on Information and Intelligent Computing2014-10-052014-10-252014-12-26
ab1LPNMRInternational Conference on Logic Programming and Nonmonotonic Reasoning2013-04-172013-06-052013-09-15
ICHSAInternational Conference on Harmony Search, Soft Computing and Applications2019-05-162019-06-152019-07-20
Recommendation