Data Assurance Lab

Contact

Erin Lanus, Ph.D.
Research Assistant Professor
Virginia Tech National Capital Region Research Center - Arlington
900 N. Glebe Rd., Arlington, VA 22203
571-858-3377 (o) | lanus (at) vt (dot) edu

About Me

I am a Research Assistant Professor in the Intelligent Systems Division at the Virginia Tech National Security Institute and affiliate faculty of Computer Science at Virginia Tech. My publications are below or on my Google Scholar page. You can view my branch in the Mathematics Genealogy Project and my ORCID iD. My Erdős number is 2.

My research centers on testing for trust and assurance of computer systems, especially systems employing artificial intelligence and machine learning. My current focus is combinatorial testing applications spanning anonymity to artificial intelligence to autonomy, designing metrics and computational search algorithms for building test sets with different coverage related properties, and test methods to address safety and security challenges presented by the deployment of AI/ML. My prior work in cyber security involved formal methods for cryptographic protocol analysis and combinatorial approaches to anonymity in attribute-based access control.

Curriculum Vitae

Education

Ph.D., Computer Science
Cybersecurity Concentration
Advisor: Professor Charles Colbourn
Dissertation: Interaction Testing, Fault Location, and Anonymous Attribute-Based Authorization
5/2019
Arizona State University
B.A. Psychology
Magna Cum Laude
12/2007
Arizona State University

Publications

Book Chapters

  1. A. T. Sherman, E. Lanus, M. Liskov, E. Zieglar, R. Chang, E. Golaszewski, R. Wnuk-Fink, C. J. Bonyadi, M. Yaksetig, and I. Blumenfeld, “Formal Methods Analysis of the Secure Remote Password Protocol,” in Logic, Language, and Security, Lecture Notes in Computer Science, Cham: Springer International Publishing, vol. 12300, 2020, pp. 103–126.

Refereed Journal Publications

  1. E. Lanus, C. J. Colbourn, and Gail-Joon Ahn, "Guaranteeing Anonymity in Attribute-Based Authorization," Journal of Information Security and Applications, vol. 87, 2024.
  2. J. Chandrasekaran, E. Lanus, T. Cody, L. Freeman, R. N. Kacker, M S Raunak, D. R. Kuhn, "Leveraging Combinatorial Coverage in ML Product Lifecycle," Computer, vol. 57, no. 7, pp. 16-26.
  3. D. R. Kuhn, M S Raunak, R. N. Kacker, J. Chandrasekaran, E. Lanus, T. Cody, L. Freeman, "Assured Autonomy through Combinatorial Methods," Computer, vol. 57, no. 5, pp. 86-90, 2024.
  4. N. McCarthy, T. Cody, J. Chandrasekaran, E. Lanus, L. Freeman, K. Alexander, and S. Hobson, "Key steps to Fielding Combat Credible AI-Enabled Systems," Naval Engineers Journal, vol. 136, no. 1-2, pp. 237-248, 2024.
  5. J. Chandrasekaran, T. Cody, N. McCarthy, E. Lanus, L. Freeman, and K. Alexander, "Testing Machine Learning: Best Practices for the Life Cycle," Naval Engineers Journal, vol. 136, no. 1-2, pp. 249-264, 2024. *2024 ITEA Publications Award
  6. C. J. Colbourn and E. Lanus, Subspace Restrictions and Affine Composition for Covering Perfect Hash Families, Art of Discrete and Applied Mathematics vol. 1, pp. 1-19, 2018.
  7. C. J. Colbourn, E. Lanus, and K. Sarkar, Asymptotic and Constructive Methods for Covering Perfect Hash Families and Covering Arrays, Designs, Codes and Cryptography vol. 86, pp.907-937, 2018.
  8. E. F. Lanus and E. V. Zieglar, Analysis of a Forced-Latency Defense Against Man-in-the-Middle Attacks, Journal of Information Warfare vol. 16, pp. 66-78, 2017.

Refereed Conference Publications

  1. E. Lanus and L. J. Freeman, "Combinatorial Testing Applications for Artificial Intelligence Metacognition," in 2nd Workshop on Metacognitive Prediction of AI Behavior at SDM (METACOG-25) , 2025, to appear. (Non-archival proceedings.)
  2. S. Mhatre, B. Lee, E. Lanus*, and L. J. Freeman, "Coverage Metrics for Detecting Bias in Facial Recognition Datasets," in 2025 IEEE Conference on Artificial Intelligence (CAI), 2025, to appear. (*Corresponding author.)
  3. E. Lanus, B. Lee, J. Chandrasekaran, L. J. Freeman, M S Raunak, R. N. Kacker, and D. R. Kuhn, "Data Frequency Coverage Impact on AI Performance," in 2025 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2025, pp. 258-267.
  4. J. Chandrasekaran, A. R. Patel, E. Lanus, and L. J. Freeman, "Evaluating Large Language Model Robustness using Combinatorial Testing," in 2025 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2025, pp. 300-309.
  5. E. Lanus, B. Lee, L. Pol, S. Sobien, J. Kauffman, and L. J. Freeman, "Coverage for Identifying Critical Metadata in Machine Learning Operating Envelopes," in 2024 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2024, pp. 217- 226.
  6. S. Travis, D. Gracanin, and E. Lanus, "Why Cyber Threat Modeling Needs Human Factors Expansion: A Position Paper," in 2023 Third Intelligent Cybersecurity Conference (ICSC), 2023, pp. 110-118. *Best Paper Award
  7. A. Molina-Markham, S. G. Ionescu, E. Lanus, D. Ng, S. Sommerer, J. J. Rushanan, “Evaluating the robustness of automated driving planners against adversarial influence,” in Workshop on Deception Against Planning Systems and Planning in Adversarial Conditions (DAPSPAC) at the 2022 International Conference on Automated Planning and Scheduling (ICAPS 2022).
  8. T. Cody, E. Lanus, D. D. Doyle, and L. J. Freeman, "Systematic training and testing for machine learning using combinatorial interaction testing," in 2022 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 102-109.
  9. S. F. Ahamed, P. Aggarwal, S. Shetty, E. Lanus and L. J. Freeman, "ATTL: An Automated Targeted Transfer Learning with Deep Neural Networks," in 2021 IEEE Global Communications Conference (GLOBECOM), pp. 1-7.
  10. S. Wood, E. Lanus, D. D. Doyle, J. Ogorzalek, C. T. Franck and L. J. Freeman, "Developing Hierarchies for Image Classification Model Evaluation," in 2021 4th International Conference on Artificial Intelligence for Industries (AI4I), pp. 34-37.
  11. E. Lanus, I. Hernandez, A. Dachowicz, L. J. Freeman, M. Grande, A. Lang, J. H. Panchal, A. Patrick, and S. Welch, "Test and Evaluation Framework for Multi-Agent Systems of Autonomous Intelligent Agents," in 2021 16th International Conference of System of Systems Engineering (SoSE), pp. 203-209.
  12. E. Lanus, L. J. Freeman, D. R. Kuhn and R. N. Kacker, "Combinatorial Testing Metrics for Machine Learning," in 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) pp. 81-84.
  13. E. Lanus and C. J. Colbourn, "Algorithms for Constructing Anonymizing Arrays, Proc. of the International Workshop on Combinatorial Algorithms," Bordeaux, France, Lecture Notes in Computer Science, vol. 12126, 2020, pp. 382-394.
  14. R. E. Dougherty, E. Lanus, C. J. Colbourn, and S. Forrest, "Genetic Algorithms for Affine Transformations to Existential t-Restrictions," in Proc. of GECCO, 2019, pp. 1707-1708.
  15. E. Lanus, C. J. Colbourn and D. C. Montgomery, "Partitioned Search with Column Resampling for Locating Array Construction," in 2019 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 214-223.

Abstracts

  1. R. Kuhn, M S Raunak, R. Kacker, J. Chandrasekaran, E. Lanus, T. Cody, and L. Freeman, “Measurements to Improve AI/ML Training Data Sets,” in High Confidence Software and Systems Conference, 2024.
  2. E. Lanus, A. T. Sherman, M. Liskov, E. Zieglar, R. Chang, E. Golaszewski, R. Wnuk-Fink, C. J. Bonyadi, M. Yaksetig, and I. Blumenfeld, “Analysis of the Secure Remote Password Protocol Using CPSA,” in High Confidence Software and Systems Conference, 2020.

Posters

  1. S. Travis, D. Gracanin, and E. Lanus, “Why Cyber Threat Modeling Needs Human Factors,” at Hume National Security Colloquium, Blacksburg, VA, 2023.
  2. L. Pol, B. Lee, A. Thatavarthy, E. Lanus, J. Kauffman, and J. Chandrasekaran, “Combinatorial Testing to Measure Machine Learning Dataset Differences,” at Hume National Security Colloquium, Blacksburg, VA, 2023.
  3. S. Osborn, T. Morrison, and E. Lanus, “To Perturb or not to Perturb: Striking the Balance Between Data Utility and Privacy,” at Hume National Security Colloquium, virtual, 2021.
  4. M. Gonley, M. Tran, M. Lionetti, A. Min, A. Owens, A. Shevalier, A. Vadicherla, J. Jiang, R. Murudkar, S. Kahn, S. Osborn, E. Lanus, and T. Morrison, “Utility-Privacy Tradeoff & the Netflix Challenge,” at Hume National Security Colloquium, virtual, 2021.
  5. E. Lanus and C.J. Colbourn, “Efficient Construction of Intermediate-size Covering Arrays,” at Computing Research Association Committee on the Status of Women in Computing Research (CRA-W) Grad Cohort, San Francisco, CA, 2015.

Other Publications

  1. B. Lee, L. Eisenbeiser, and E. Lanus*, “Training Generative Adversarial Networks on Small Datasets by way of Transfer Learning,” in The ITEA Journal of Test and Evaluation, vol. 44, no. 2, 2023. (*Corresponding author.)
  2. L.J. Freeman, J. Kauffman, D. Sobien, T. Cody, E. Lanus, “Best practices for addressing new challenges in testing and evaluating artificial intelligence-enabled systems,” ITEA Journal of Test and Evaluation, vol. 43, no. 3, pp. 174–180, 2022.

In Submission

  1. P. Roy, J. Chandrasekaran, E. Lanus, L. Freeman, J. Werner, "A Survey of Data Security: Practices from Cybersecurity and Challenges of Machine Learning," submitted to ACM September 2023..

Talks, Conferences, and Workshops

  1. Combinatorial Testing for AI-Enables Systems (CT4AIES). Organizer, presenter. Arlington, VA 9/2024. Slides and materials available.
  2. International Workshop on Combinatorial Testing. Talk: Coverage for Identifying Critical Metadata in Machine Learning Operating Envelopes. Toronto, VA, 5/2024.
  3. Graduate Research in AI T&E (GRAITE) Women Workshop . Organizer (PI), presenter. Arlington, VA 1/2024.
  4. 2nd Annual IEEE Workshop on Assured Autonomy, AI and Machine Learning (WAAM). Invited panelist. Atlanta, GA, 11/2023. Panel discussions captured in P. Laplante, J. F. DeFranco and R. Kuhn, "Assured Autonomy, Artificial Intelligence, and Machine Learning: A Roundtable Discussion" in Computer, vol. 57, no. 03, pp. 14-21, March 2024.
  5. Assured Autonomy: The Way Forward. Lightning talk: Data Assurance for Machine Learning. Virtual, 11/2022.
  6. Success Through Rewarding and Inclusive Virtual Experience Mathematics - Opportunities in Research and Education (STRIVE for MORE). Panelist. Virtual, 9/2021
  7. High Confidence Software and Systems Conference. Talk: Analysis of the Secure Remote Password Protocol Using CPSA. Maryland, USA, 9/2020. Virtual due to SARS-CoV-2.
  8. IWOCA 2020 : 31st International Workshop on Combinatorial Algorithms. Talk: Algorithms for Constructing Anonymizing Arrays. Bordeaux, France, 6/2020. Virtual due to SARS-CoV-2.
  9. Defense and Aerospace Test and Analysis (DATA) Workshop. Short Course: Software Testing. Virginia, USA, 3/2020. Cancelled due to SARS-CoV-2.
  10. Fall Technical Conference. Talk: Tuning Algorithmic Parameters for Locating Array Construction. Maryland, USA, 9/2019.
  11. UMBC Cyber Defense Lab invited talk. Talk: Analysis of the Secure Remote Password (SRP) Protocol Using CPSA. Maryland, USA, 9/2019.
  12. International Workshop on Combinatorial Testing. Talk: Partitioned Search with Column Resampling for Locating Array Construction. Xian, China, 4/2019.
  13. Defense and Aerospace Test and Analysis (DATA) Workshop. Talk: Constructing Designs for Fault Location. Virginia, USA, 4/2019.
  14. Conference on Combinatorics and its Applications in Celebration of Charlie Colbourn's 65th Birthday. Talk: Covering Perfect Hash Families and Covering Arrays. Singapore, 7/2018.
  15. Protocol eXchange. Talk: Analysis of a Forced-Latency Defense Against Man-in-the-Middle. Maryland, USA, 6/2015.
  16. CRA-W Grad Cohort 2015. Poster: Efficient Construction of Intermediate-size Covering Arrays, San Francisco, USA, 4/2015.

Students

Post-doctoral supervision: Jaganmohan Chandrasekaran (2023-2024)
Graduate committees: Sakshi Mhatre (MS 2024, co-supervised with Dr. Kurt Luther), Stephanie Travis (Ph.D., committee member)
Undergraduate research assistants supervised: M. Gonley, M. Tran, M. Lionetti, A. Min, A. Owens, A. Shevalier, A. Vadicherla, J. Jiang, R. Murudkar, S. Kahn, B. Lee, A. Thatavarthy, D. Kilnani
Graduate research assistants supervised: S. Osborn, P. Roy, L. Pol, S. Mhatre, D. Steburg

Teaching

GenCyber CyberGirls@VT Summer Camp: Cryptography Summer 2024
VT CMDA 4984 Data Security Spring 2024
VT Raytheon Fellows Program Lectures: Security Informatics Spring 2021
VT Raytheon Fellows Program Lectures: Topics in Cryptography Spring 2020, Fall 2020
VT Raytheon Fellows Program Lectures: Principles of Software Testing Fall 2020
ASU CSE555: Theory of Computation, Assistant Spring 2014
ASU CSE355: Introduction to the Theory of Computation, Assistant Spring 2013, Spring 2014
ASU CSE110: Principles of Programming with Java Fall 2013
ASU/Translational Genomics: Python Programming & MongoDB for Biologists Summer 2013
ASU CSE100: Principles of Programming with C++, Assistant Spring 2013
ASU ASU101-CSE: The ASU Experience Fall 2012

Fellowships, Awards, Acknowledgements

ITEA Publications Award 2024
Letter of Commendation, Director Developmental Test, Evaluation, and Assessments (DTE&A) 2023
Intelligent Cybersecurity Conference Best Paper Award 2023
GPSA Outstanding Research Award 2019
National Physical Science Consortium 2014-2019
Computer Science Diversity Fellowship 2012-2013
Graduate Fellowship 2012-2013
Norton Grant for Women's Studies in Religion 2005-2007
College of Liberal Arts and Sciences Alumni International Study Abroad Scholarship 2005-2006
Presidents Scholarship 2002-2006

Professional Organization and Society Membership

Association for Computing Machinery, Member 2023-Present
IEEE Computer Society, Member 2019-Present

Service

Program Committee Member: IEEE Intelligence Cybersecurity Conference (ICSC) 2024
Journal Reviewer: IEEE Computer Magazine 2024
Journal Reviewer: IEEE Reliability Magazine 2024
Proposal Reviewer: U.S. Army Corps of Engineers’ Engineer Research & Development Center 2023, 2024
Program Committee Member: IEEE Software Technology Conference (STC) 2023
Proposal Reviewer: Commonwealth Cyber Initiative Cybersecurity Research Collaboration 2020, 2023, 2024
Journal Reviewer: Optimization Methods and Software 2020, 2021
Journal Reviewer: Designs, Codes, and Cryptography 2020

Employment and Other Research Experience

Research Assistant Professor
National Security Insitute, Virginia Tech
7/2022-Present
Senior Trustworthy AI Researcher
The MITRE Corporation
5/2021-7/2022
Research Assistant Professor
Hume Center for National Security and Technology, Virginia Tech
10/2019-5/2021
Research Fellow
Protocol Analysis Lab, University of Maryland Baltimore County
4/2019-10/2019
High Confidence Software and Systems Researcher/NPSC
Federal Government, Department of Defense
5/2015-8/2015
Lab Manager
Center for BioIntelligence, Translational Genomics Research Institute (TGen)
5/2013-8/2013
Web Manager
The Music Store
4/2008-7/2012
Habilitation Provider
Guthrie Mainstream Services
5/2005-11/2006
Undergraduate Research Assistant
Psychology Department, Arizona State University
9/2004-5/2005