Workshop on Learning from Authoritative Security Experiment Results (LASER) 2022
Workshop Overview
The LASER workshop series focuses on learning from and improving cybersecurity experiment results. The workshop strives to provide a highly interactive, collegial environment for discussing and learning from experimental methodologies, execution, and results. Ultimately, the workshop seeks to foster a dramatic change in the experimental paradigm for cybersecurity research, improving the overall quality and reporting of practiced science.
The LASER workshop invites broad participation by the community, including (1) authors of accepted papers from major cybersecurity conferences to present and discuss the experimental aspects of their work, and (2) others interested in contributing to and learning from such discussions and interaction.
Conference papers all too often must focus on research results and contain limited discussion of the experimental aspects of the work (maybe a small section with a few paragraphs at the end of the paper). LASER provides an opportunity to focus on and explore the experimental approaches and methodologies used to obtain the research results.
The LASER workshop not only provides authors of accepted papers the opportunity to present and discuss the experimental aspects of their work with other workshop participants, but also the option to write new published papers that expand on the experimental aspects of their work.
Workshop Format
The workshop will be structured as a true “workshop” in the sense that it will focus on discussion and interaction around the topic of experimental methodologies, execution, and results with the goal of encouraging improvements in experimental science in cybersecurity research. Authors will lead the group in a discussion of the experimental aspects of their work.
Areas of interest include, but are not limited to, the following:
- Research questions and/or hypothesis
- Experimental methodologies used and/or developed
- Experiment design
- Use of simulation, emulation, virtualization, and/or physical testbeds
- Use of specialized hardware including CPS and IoT devices
- Modeling of human-behavior characteristics
- Software tools used and/or developed to perform experimentation
- Approaches to experiment validation, monitoring, and data collection
- Datasets used and/or developed to perform experimentation
- Measurements and metrics
- Analytical techniques used and/or developed to evaluate experimental results
As a group, participants will discuss these areas and answer interesting questions such as:
- Did you use experimentation artifacts borrowed from the community?
- Did you attempt to replicate or reproduce results of earlier research as part of your work?
- What can be learned from your methodology and your experience using your methodology?
- What did you try that did not succeed before getting to the results you presented?
- Did you produce any intermediate results including possible unsuccessful tests or experiments?
Workshop Agenda
Note: All times are in PDT (UTC-7) and all sessions are held in Aviary Ballroom
Thursday, April 28
8:15 am – 8:30 am
Gathering
8:30 am – 8:45 am
Welcome, Introductions, Workshop Goals and Agenda
8:45 am – 10:15 am
Session 1: Paper Discussions
DrawnApart: A Deep-Learning Enhanced GPU Fingerprinting Technique
Naif Mehanna (University of Lille, CNRS, Inria), Tomer Laor (Ben-Gurion University of the Negev)
How is Proto being Probed? The Experimental Aspects behind the Large-scale Measurement of Client-Side Prototype Pollution Vulnerabilities
Zifeng Kang (Johns Hopkins University)
10:15 am – 10:45 am
Morning Break
10:45 am – 12:15 pm
Session 2: Paper Discussions
Evaluating Euler: Experimental Results of Network Anomaly Detection Models
Isaiah J. King (The George Washington University)
Building the VPNalyzer System
Reethika Ramesh (University of Michigan), Leonid Evdokimov (Independent), Diwen Xue, Roya Ensafi (University of Michigan)
12:15 pm – 1:45 pm
Workshop Lunch
1:15 pm – 3:00 pm
Session 3: Invited Talk and Paper Discussions
Invited Talk: Reflections on Artifact Evaluation
Eric Eide (University of Utah)
Measuring Ambient Cellular Signals in High-mobility Conditions
Yanjun Pan (University of Arizona)
3:00 pm – 3:30 pm
Afternoon Break
3:30 pm – 5:00 pm
Session 4: Paper Discussions
“Mind your own cryptocurrency!”
Abbas Acar, Ege Tekiner, Selcuk Uluagac (Florida International University)
An In-Depth Analysis on Adoption of Attack Mitigations in Embedded Devices
Ruotong Yu (Stevens Institute of Technology, University of Utah), Yuchen Zhang, Shan Huang (Stevens Institute of Technology)
5:00 pm – 5:15 pm
Wrap-up
Workshop Papers
Participants in the LASER Workshop are invited to write new papers on their experimental work. The papers will be published in post-workshop proceedings. The new papers will be driven and guided, in part, by the discussions and interactions, and possibly even new collaborations, forged at the workshop.
Draft papers will be due approximately two months after the workshop. The program committee will review papers and provide notifications and feedback one month after submission. Final camera-ready papers will be due approximately one month later.
Important Dates (Tentative)
- LASER Workshop @ NDSS: 28 April 2022
- Draft Papers Submitted: 28 June 2022
- Notifications and feedback: 28 July 2022
- Final Papers Submitted: 28 August 2022
- Papers Published: 28 September 2022
Organizers
- David Balenson (SRI International)
- Terry Benzel (USC-ISI)
- Laura S. Tinnel (SRI International)
Further Information
Please find more information about the LASER Workshop Series and LASER 2022. Send questions to [email protected].