6th Cybersecurity Workshop | International Test and Evaluation Association
Cybersecurity continues to be at the forefront of the DoD acquisition community. As this contested environment brings new challenges at as accelerated rate, the T&E community must be prepared to meet new requirements.
This Workshop provides an opportunity to share ideas among experienced T&E professionals regarding threat ad requirements, test capabilities, autonomous systems, and evaluation methodologies. Our goal is to share ideas on how to better characterize cybersecurity threats, evaluate system performance when attacked by a cybersecurity threat, and assess risk of using the system in the presence of a cybersecurity threat.
Please join us in Belcamp, Maryland, as members of the T&E community from academia, industry, and government discuss the evolving discipline of Cybersecurity T&E. Come share your thoughts, connect with others, and learn from some of the leading experts at this Workshop. The cyber threat will only increase with time. See you there!
Pre-Workshop Tutorials require a separate fee from the Workshop. Single Tutorial – $205, Two Tutorials – $385.
Integrated Systems Engineering, Agile DevSecOps, and Test and Evaluation
Instructor: Dave Brown, PhD, CTEP – Consulting Engineer, Chesapeake Systems Engineering
With recent emphasis on Agile and DevSecOps development methodologies, many practitioners now believe that these new methodologies completely negate or replace the elements of program management, systems engineering, and independent test and evaluation. Nothing could be farther from the truth. In fact, Agile and DevSecOps incorporate many elements, often with only different names. For many programs, especially tightly coupled hardware and software programs, like almost all modern military systems, a hybrid systems engineering and Agile development approach is required. This approach must then be top level managed with program management techniques, and verified and validated with independent test and evaluation, especially for developmental test of integrated hardware-software, operational test, and cyber test and assessment.
This tutorial consists of a quick overview of systems engineering and test and evaluation. This is followed by a brief introduction to Agile and DevSecOps. Finally we will discuss techniques to effectively integrate the above when and where required.
Blockchain 101: Blockchain De-Mystified
Instructor: Mr. Duane Wilson, SURVICE Engineering
Why is the Blockchain such a technology phenomena in the today’s tech lingo? What are the current use cases of Blockchain? Can the Blockchain solve all of our problems? Is there any application to Test & Evaluation? Will it be here in the future? The aim of this tutorial is to attempt to answer all of these questions and provide a baseline understanding of what Blockchain technology is and what it is not – which is often even more important. We have broken our tutorial down into six distinct – yet related sections to attempt to appease a very diverse audience: Blockchain 101, Blockchain Components, Blockchain Applications, Blockchain Demo, Blockchain Development, and Blockchain Test & Evaluation.
Building Better Models Using Robust Machine Learning Methods
Introduction to Cybersecurity Test & Evaluation
Fundamentals of Distributed Testing (1 hour), and Identifying Requirements and Vulnerabilities for Cybersecurity (3 hours)
Identifying Requirements and Vulnerabilities for Cybersecurity
Mike Lilienthal, PhD, TRMC, and Mr. Patrick “Preacher” Lardieri, Lockheed Martin
There are two tutorials presented during the 4 hour block of time allocated. The first hour “Fundamentals” was developed to provide information and an approach for the DoD T&E community on how to use distributed methodologies to plan for, prepare, and execute distributed test events. The tutorial is intended to present executive level material on fundamental concepts of Distributed Testing, as well as generate a discussion on considerations and requirements that can be used for the design of Integrated Cyber Security T&E in a Joint mission environment. Desired outcome is to have attendees incorporate Distributed Testing methodologies into their own processes and guidelines.
The last three hours of the tutorial was developed for the many Service acquisition, System Engineering (SE), and Test and Evaluation (T&E) teams that are starting to move their programs from “checklist information assurance or compliance” cyber security approach to a proactive, iterative risk management process with the goal of ensuring personnel can still carry out their duties in a cyber contested environment. Many people are struggling to formulate a practical and effective approach to develop requirements and a plan to incorporate cyber security into their SE and T&E activities using the recent spate of cybersecurity policies and guidelines released by the Office of the Secretary of Defense.
The tutorial will:
The CTT (which has been adopted by the Navy and DT&E) is a rigorous, intellectually intensive and interactive data collection and analysis process that introduces and explores the potential effects of cyber offensive operations on the capability of a system to carry out its designed functions. It produces a prioritized list of actionable recommendations to support more informed decisions and tradeoffs in a fiscally constrained environment.
The National Cyber Range is an OSD TRMC capability that provides the ability to conduct cybersecurity test and evaluation of DoD systems in support of cyber risk assessments. It is capable of instantiating systems in classified close test range and enabling red and penetration test teams to conduct hands-on evaluation of cyber attacks on the systems under evaluation.
The tutorial is based on the lessons learned from using the CTT and NCR processes to support acquisition programs across the services.
Intended Audience: It is intended for attendance by Acquisition Program Management Offices, Systems Engineers, Chief Developmental Testers, and Lead Developmental Test and Evaluation (DT&E) Organizations.
How to Successfully Plan Test Strategy for Agile Development in a Gov Framework
This course provides a framework and guidance for programs transitioning to an agile construct or new programs established with an agile construct. The intended audience includes requirements managers, program managers and test managers executing DoD programs; however, the overall principles could apply to multiple agencies. This course is not a singular solution for agile testing; it acknowledges the different approaches needed for different programs and is intended to provide students with an understanding of concepts that can be tailored to their specific program.
This course will walk through characteristics of agile process and where it does and does not apply to help inform expectations. It will cover US code, OSD and service policy as it applies to agile testing and planned policy updates designed to allow greater flexibility. The core of the course covers upfront planning and strategy considerations for successful testing; requirements, contracting, infrastructure investments, automation and test execution. It concludes with how to translate that strategy into concise, timely, and relevant documentation from the TEMP, test plan, and test reporting.
Cyber Test and Training Solutions with TENA and JMETC
Planning and Executing Cyber Tables Tops, Facilitator Training
Mr. Mike Zwiebel – Director, Test Management, U.S. Army Test and Evaluation Command (ATEC)
Mitch Crosswait, PhD – Director, Operational Test & Evaluation (DOT&E)
Mr. Chip Ferguson – Deputy Executive Agent, DOD Cyber Test Ranges, Test Resource Management Center (TRMC)
Mr. Joe Bradley – Director, Cyber Resiliency Office for Weapons Systems, AFMC
Mr. Patrick Kastner – Deputy Director (Acting), National Preparedness Programs, DHS Office of Test and Evaluation
Ms. Kim Ploskonka – C5ISR Center
Mr. Bill Hughes – Institute for Defense Analysis (IDA)
Mr. Paul Johnson – Scientific Advisor, MCOTEA
|Cyber Test Range Panel|
|Moderator||Mr. Chip Ferguson||Deputy Executive Agent, DOD Cyber Test Ranges||Test Resource Management Center (TRMC)|
|Panelists||Jon Davis, PhD||Principle Investigator||RAND Corporation|
|Rob Tamburello, PhD||Deputy Director||National Climate-Computing Research Center (NCRC)|
|Ms. Sophia Paros||Defense Information Systems Agency (DISA)|
|LtCol Ben George, USAF||AFSP 346 TS/CC|
|Moderator||COL Jason Woodford, USA||Chief, Survivability Evaluation Directorate||U.S. Army Evaluation Center (AEC)|
|Panelists||Ms. Ellena Millar||Director, Cybersecurity OT&E (01D)||U.S. Navy Operational Test and Evaluation Force (OPTEVFOR)|
|Mr. Maurice Sanders||Chief, Cyber Division||Marine Corps Operational Test and Evaluation Activity (MCOTEA)|
|Mr. Matt Frandsen||Chief, Cyber Test Operations Division||Air Force Operational Test and Evaluation Center (AFOTEC)|
|Mr. Rob Aguilera||Senior Vice President, Garud Technology Services||DHS, FEMA, OTA|
Industry Cyber Range/Capabilities Panel
|Moderator||Mr. Pete Christensen||The MITRE Corporation|
|Panelists||Mr. Randy Smith||BOEING Test and Evaluation|
|Mr. Patrick Ladieri||Lockheed Martin Corporation (LMCO)|
|Mr. Mark Bradbury||Chief Engineer, Intelligence, Information and Services, Cyber Warfare Campaign||Raytheon|
Workforce Development Panel
|Moderator||Mr. Terry Murphy||Department of Homeland Security (DHS)|
|Panelists||Tom Meservy, PhD||Associate Professor||Brigham Young University|
|Diana Burley, PhD||Institute for Information Infrastructure Protection (I3P)|
|Portia Crowe, PhD||Chief, Cyber & Systems Engineering||U.S. Army Program Executive Office Command, Control and Communications-Tactical (PEO C3T)|
|Mr. Isidore Venetos||FAA|
Each of the 4-hour Pre-Workshop Tutorials provide 4 contact hours of instruction (4 CEUs) that are directly applicable to your professional development program, including the Certified Test and Evaluation Professional Credential (CTEP).
In addition to the Pre-Workshop Tutorials, the Workshop provides 4 contact hours of instruction (4 CEUs) for each half-day, 8 contact hours of instruction (8 CEUs) for each full-day, or 20 contact hours of instruction (20 CEUs) for attending the full Workshop, that are directly applicable to your professional development program, including the Certified Test and Evaluation Professional Credential (CTEP).
Water’s Edge Event Center
4687 Millennium Drive
Belcamp, MD 21017
ITEA is a 501(c)(3) professional education association dedicated to the education and advancement of the test and evaluation profession. Registration fees, membership dues, and sponsorships are tax deductible.
Your sponsorship dollars help defer the cost of the Symposium and support the ITEA scholarship fund, which assists deserving students in their pursuit of academic disciplines related to the test and evaluation profession. Sponsorship and related benefits will become effective on receipt of payment.
NOTE: This ITEA event is a non-competitive environment meant for a free exchange of ideas and information.
Early Bird Registration until February 25th
$645 – Regular Registration*
$495 – ITEA Member / Government Employee / Active Duty Military
Regular Registration February 26th to March 12th
$745 – Regular Registration*
$595 – ITEA Member / Government Employee / Active Duty Military
Late Registration after March 12th
$845 – Regular Registration*
$695 – ITEA Member / Government Employee / Active Duty Military
*Regular Registration rate includes one-year membership to ITEA.
New T&E Professional (less than 5 years of T&E experience) VERIFICATION REQUIRED – Includes two Lunches, the Networking Reception, and a one-year ITEA membership for Non-ITEA Member.
SUBSTITUTION AND CANCELLATION POLICY: Substitutions are permitted. Refunds are not available within ten (10) days prior to the start of the event. Requests for cancellation submitted between ten (10) to 45 days prior to start date of the event will be subject to a $250 cancellation fee. Requests for cancellation greater than 45 days prior to the start date of the event will be subject to a $100 cancellation fee.
Workshop Chair – Ms. Chris Susman, SURVICE Engineering Co
Technical Program Co-Chairs
– Dave Brown, PhD, CTEP, Chesapeake Systems Engineering
– Mr. Pete Christensen, CTEP, The MITRE Corporation
– Paul Dailey, PhD, CTEP, Johns Hopkins University Applied Physics Lab
– Mr. Bruce Einfalt, Applied Research Laboratory, The Penn State University
– Ms. Cathy Pritts
– Mr. Jim Myers
Registration – Mr. James Gaidry, CAE – firstname.lastname@example.org
25 - 28 Mar 2019
Water’s Edge Event Center