Learning from Authoritative Security Experiment Results (LASER) Workshop 2020

Workshop Overview

The LASER workshop series focuses on learning from and improving cybersecurity experiment results. The workshop strives to provide a highly interactive, collegial environment for discussing and learning from experimental methodologies, execution, and results. Ultimately, the workshop seeks to foster a dramatic change in the experimental paradigm for cybersecurity research, improving the overall quality and reporting of practiced science.

Each year, the LASER committee chooses a slightly different focus and approach to help the community reach the overall goals of the effort. This year, the LASER workshop is gathering a group of authors of accepted NDSS papers to come together to explore and discuss the experimental aspects of their work amongst themselves and with other workshop participants. Conference papers all too often must focus on research results and contain limited discussion of the experimental aspects of the work. LASER will provide authors the opportunity to lead focused discussion on the experimental approaches and methodologies used to obtain their results.

We invite open participation by others interested in being part of and learning from such discussions. To participate, simply register for the workshop.

Workshop Format

The workshop will be structured as a true “workshop” in the sense that it will focus on discussion and interaction around the topic of experimental methodologies, execution, and results with the goal of encouraging improvements in experimental science in cybersecurity research. Authors will lead the group in a discussion of the experimental aspects of their work.

Areas of interest include, but are not limited to, the following:

• Research questions and/or hypothesis
• Experimental methodologies used and/or developed
• Experiment design
• Use of simulation, emulation, virtualization, and/or physical testbeds
• Use of specialized hardware including CPS and IoT devices
• Modeling of human-behavior characteristics
• Software tools used and/or developed to perform experimentation
• Approaches to experiment validation, monitoring, and data collection
• Datasets used and/or developed to perform experimentation
• Measurements and metrics
• Analytical techniques used and/or developed to evaluate experimental results

As a group, participants will discuss these areas and answer interesting questions such as:

• Did you use experimentation artifacts borrowed from the community?
• Did you attempt to replicate or reproduce results of earlier research as part of your work?
• What can be learned from your methodology and your experience using your methodology?
• What did you try that did not succeed before getting to the results you presented?
• Did you produce any intermediate results including possible unsuccessful tests or experiments?

Workshop Papers

Participants in the LASER Workshop are invited to write new papers on their experimental work. The papers will be published in post-workshop proceedings. The new papers will be driven and guided, in part, by the discussions and interactions, and possibly even new collaborations, forged at the workshop.

Draft papers will be due approximately two months after the workshop. The program committee will review papers and provide notifications and feedback one month after submission. Final camera-ready papers will be due approximately one month later.

Important Dates

• LASER Workshop @ NDSS: February 23, 2020
• Draft Papers Submitted: April 23, 2020
• Notifications and feedback: May 23, 2020
• Final Papers Submitted: June 23, 2020
• Papers Published: July 23, 2020

Organizers

• Jim Alves-Foss (University of Idaho)
• David Balenson (SRI International)
• Terry Benzel (USC-ISI)
• Laura S. Tinnel (SRI International)

Further Information

Please see www.laser-workshop.org for more information about the LASER Workshop Series and 2020.laser-workshop.org for more information about LASER 2020. Send questions to [email protected].