CMU SEI Research Review: Full Schedule

11:00am EST

Welcome to the 2020 CMU SEI Research Review from the SEI Director

Speakers

Dr. Paul Nielsen

Director and CEO, CMU SEI

Paul D. Nielsen is Director and Chief Executive Officer of the Carnegie Mellon University Software Engineering Institute (SEI), a leader in advancing software and cybersecurity to solve the nation’s toughest problems through focused research, development, and transition to the broad... Read More →

Monday November 9, 2020 11:00am - 11:05am EST
Virtual

Opening

11:05am EST

Welcome to the 2020 CMU SEI Research Review from the CMU Vice-President of Research

Speakers

Dr. J. Michael McQuade

Vice President for Research, CMU

J. Michael McQuade is Carnegie Mellon University's vice president for research, providing leadership for the university's research enterprise and advocating for the role that science, technology and innovation play nationally and globally.From 2006 to 2018 he served as senior vice... Read More →

Monday November 9, 2020 11:05am - 11:10am EST
Virtual

Opening

11:10am EST

Realizing Algorithmic and Computational Advantage including the Need for an AI Engineering Discipline

This introduction will show the need for an AI Engineering discipline in order to routinely produce AI-enabled systems that are scalable, robust and secure, and human-centered. Dr. Gaston will illustrate how CMU SEI as DoD's FFRDC for software engineering and cybersecurity has trust of stakeholders who will benefit from the use of an AI Engineering discipline

Speakers

Dr. Matt Gaston

Director, SEI Emerging Technology Center, CMU SEI

Dr. Matt Gaston is director of the SEI Emerging Technology Center (ETC). He assists the U.S. Department of Defense and the intelligence community in identifying, evaluating, developing, and transitioning leading-edge data-intensive scalable computing technologies. He has led the establishment... Read More →

Monday November 9, 2020 11:10am - 11:25am EST
Virtual

Framing, Live

11:25am EST

Break

Monday November 9, 2020 11:25am - 11:35am EST
Virtual

Break, Recorded

11:35am EST

Advancing AI Engineering for Defense and National Security

Dr. Gaston will lead a discussion with other experts in examining how the current state of Artificial Intelligence (AI) for the U.S. Department of Defense calls for the creation of a discipline for AI Engineering. Ms. Barmer will moderate viewer chats during the panel.

Moderators

Dr. Matt Gaston

Director, SEI Emerging Technology Center, CMU SEI

Speakers

Lieutenant General Michael S. Groen

Director, Joint Artificial Intelligence Center

Lieutenant General Michael S. Groen assumed his current position as the Director, Joint Artificial Intelligence Center on 1 October 2020. As a member of the JAIC team, he leads the transformation of U.S. Joint warfighting and departmental processes through the integration of Artificial... Read More →

Dr. Mary "Missy" Cummings

Defense Innovation Board

Professor in the Department of Mechanical Engineering and Materials Science, Mary "Missy" Cummings received her B.S. in Mathematics from the US Naval Academy in 1988, her M.S. in Space Systems Engineering from the Naval Postgraduate School in 1994, and her Ph.D. in Systems Engineering... Read More →

Dr. John Beieler

Director, Science & Technology, Office of the Director of National Intelligence

For more information on Dr. Beieler, visit https://www.linkedin.com/in/john-beieler-7496a554/.

Monday November 9, 2020 11:35am - 12:20pm EST
Virtual

Panel, Live

12:20pm EST

Break

Monday November 9, 2020 12:20pm - 12:35pm EST
Virtual

Break, Recorded

12:35pm EST

Introduction to Presentations

Speakers

Dr. Matt Gaston

Director, SEI Emerging Technology Center, CMU SEI

Monday November 9, 2020 12:35pm - 12:40pm EST
Virtual

Framing, Live

12:40pm EST

Train but Verify: Towards Practical AI Robustness

Dr. Van Houdnos will describe his research into developing a continuous integration/continuous delivery Fast AI Test Harness (FAITH) to verify the robustness properties of the system’s machine learning components. The objective of the Train, but Verify project is to: (1) research and refine an AI Engineering process designed to train AI systems to have specific robustness properties, and (2) develop a testing framework capable of verifying these robustness practices. This presentation will be followed by a live Q&A period with John Helland from the project research team.

Mr. Helland and Ms. Smith will moderate a live Q&A session following Dr. Van Houdnos's presentation.

Speakers

Ms. Tanisha Smith

Technical Manager, CMU SEI

Mr. Jon Helland

Associate Machine Learning Researcher, CMU SEI

Dr. Nathan Van Houdnos

Senior Machine Learning Research Scientist, CMU SEI

Learn more about Nathan at https://resources.sei.cmu.edu/library/author.cfm?authorid=484947. Contact him via https://www.sei.cmu.edu/contact-us/index.cfm?f=Nathan&l=VanHoudnos

Monday November 9, 2020 12:40pm - 1:10pm EST
Virtual

Presentation, Recorded with Live Q&A

1:10pm EST

Investigating Techniques for Summarizing and Searching Video

This presentation will discuss research to address the quality and efficacy of tracking items in aerial surveillance video. It will be followed by a live Q&A session on the topic.

Speakers

Mr. Edwin Morris

Senior Member of the Technical Staff, CMU SEI

Read Ed's recent blog "Summarizing and Searching Video with Machine Learning" at https://insights.sei.cmu.edu/sei_blog/2020/03/summarizing-and-searching-video-with-machine-learning.html. Contact Ed via https://www.sei.cmu.edu/contact-us/index.cfm?f=Edwin&l=Morris

Mr. Adam Harley

School of Computer Science, CMU

Monday November 9, 2020 1:10pm - 1:40pm EST
Virtual

Presentation, Recorded with Live Q&A

1:40pm EST

Break

Monday November 9, 2020 1:40pm - 1:45pm EST
Virtual

Break, Recorded

1:45pm EST

Ethics in AI Engineering

Ms. Smith will discuss why ethical principles are so important for AI and post a grand challenge to make AI ethical.

Following the talk, Ms. Van Deusen will moderate a Q&A session using comments shared in the chat.

Speakers

Ms. Alex Van Deusen

Design Researcher, CMU SEI

Ms. Carol Smith

Senior Research Scientist, Human Machine Interaction, CMU SEI

Read Carol's blogs at https://resources.sei.cmu.edu/library/author.cfm?authorID=636431

Monday November 9, 2020 1:45pm - 2:15pm EST
Virtual

Presentation, Recorded with Live Q&A

2:15pm EST

Knowing When You Don’t Know: Engineering AI Systems in an Uncertain World

Dr. Heim will preview new research focused on a gap in the practice of employing Artificial Intelligence. Modern AI systems most commonly employ Machine Learning (ML) models to make important, domain-relevant inferences. However, ML, almost by its very nature, is called upon to make inferences in the presence of inherent uncertainty. Due in part to uncertainty, state-of-the-art ML models can produce inaccurate inferences in scenarios where humans would reasonably expect high accuracy. Further exacerbating this issue is that many commonly used models do not provide accurate estimates about when they are uncertain about their predictions. As a result, not only can ML inferences be incorrect, but it can be extremely difficult to predict when they will be incorrect. AI system components downstream from an ML model or humans using the model's output to complete a task must then reason with incorrect inferences that they expect to be correct.

Speakers

Dr. Eric Heim

Senior Research Scientist - Machine Learning, CMU SEI

Learn more about some of Eric's recent work at https://www.sei.cmu.edu/research-capabilities/all-work/display.cfm?customel_datapageid_4050=201338. Contact him at https://www.sei.cmu.edu/contact-us/

Monday November 9, 2020 2:15pm - 2:25pm EST
Virtual

Presentation, Recorded

2:25pm EST

Break

Monday November 9, 2020 2:25pm - 2:30pm EST
Virtual

Break, Recorded

2:30pm EST

Topics in Advanced Computing: The Promise and Challenges of Recommendation Systems for the DoD

Dr. Wohlbier will discuss the use of recommendation systems, which are ubiquitous in the commercial space and on the rise across the Department of Defense. Recommendation systems present unique computational challenges including extremely large datasets and a combination of sparse and dense memory operations. We will discuss details of our recent work on improving the performance of Facebook’s Deep Learning Recommendation Model.

Dr. McMillan will moderate a live Q&A following the presentation.

Speakers

Dr. Scott McMillan

MTS - Principal Engineer, CMU SEI

Read blog posts by Scott at https://insights.sei.cmu.edu/author/scott-mcmillan/. Contact Scott via https://www.sei.cmu.edu/contact-us/index.cfm?f=Scott&l=McMillan

Dr. John Wohlbier

Senior Research Scientist, SEI Emerging Technology Center, CMU SEI

Monday November 9, 2020 2:30pm - 3:10pm EST
Virtual

Presentation, Recorded with Live Q&A

3:10pm EST

Break

Monday November 9, 2020 3:10pm - 3:15pm EST
Virtual

Break, Recorded

3:15pm EST

Bringing it all Together

Dr. Longstaff will blend the research discussions of the session

Speakers

Dr. Thomas Longstaff

CTO, CMU SEI

Read Tom's recent blog "What Engineers Need to Know about Artificial Intellilgence" at https://insights.sei.cmu.edu/sei_blog/2019/09/what-engineers-need-to-know-about-artificial-intelligence.html. Contact Tom via https://www.sei.cmu.edu/contact-us/index.cfm?f=Thomas&l=Longstaff Tom Longstaff is Chief Technology Officer of the SEI. As CTO, Longstaff is responsible for formulating a technical strategy and leading the funded research program of the institute based on current and predicted future trends in technology, government, and industry.Before joining the SEI as CTO in 2018, Longstaff was a program manager and principal cybersecurity strategist for th... Read More →

Monday November 9, 2020 3:15pm - 3:25pm EST
Virtual

Integration, Live

3:25pm EST

Break to Transition to Poster Rooms

Monday November 9, 2020 3:25pm - 3:30pm EST
Virtual

Break, Recorded

3:30pm EST

Concurrent Sessions: Four Poster Presentations and Discussions

Monday November 9, 2020 3:30pm - 4:00pm EST
Virtual

Posters, Live

3:30pm EST

Poster: Characterizing and Detecting Mismatch in ML-Enabled Systems

Dr. Grace Lewis
Characterizing and Detecting Mismatch in ML-Enabled Systems
We propose to develop machine-readable ML-Enabled System Element Descriptors as a mechanism to enable mismatch detection and prevention in ML-enabled systems. The goal of the descriptors is to codify attributes of system elements and therefore make all assumptions explicit. The descriptors can be used by system stakeholders in a manual way, for information, awareness and evaluation activities; and by automated mismatch detectors at design time and runtime for cases in which attributes lend themselves to automation.

Speakers

Dr. Grace A. Lewis

Principal Researcher / TAS Initiative Lead, CMU SEI

Read Grace's recent blog "Detecting Mismatches in Machine-Learning Systems" at https://insights.sei.cmu.edu/sei_blog/2020/06/detecting-mismatches-in-machine-learning-systems.html. Contact Grace via https://www.sei.cmu.edu/contact-us/index.cfm?f=Grace&l=Lewis

Monday November 9, 2020 3:30pm - 4:00pm EST
Virtual

Posters, Live

3:30pm EST

Poster: Improving Human Decision Making with AI Decision Support Systems

Mr. Rotem Guttman
Improving Human Decision Making with AI Decision Support Systems
The project will proceed along several semi-overlapping tracks. This parallelism is built in to the project plan in order to both maximize how much can be accomplished during the period of performance. As the purpose of a LENS project is to determine the merits of an approach and inform the development of larger research programs, our focus will be on establishing both the appropriate test apparatus, as well as a useful baseline of layman performance. Without such a baseline, it would be impossible to assess the effect that the domain experience of subject matter experts may cause.

Speakers

Mr. Rotem Guttman

Cybersecurity Researcher, CMU SEI

Monday November 9, 2020 3:30pm - 4:00pm EST
Virtual

Posters, Live

3:30pm EST

Poster: Quantum Advantage Evaluation Framework

Dr. Jason Larkin
Quantum Advantage Evaluation Framework
We will a create novel classical computing emulator and a software/hardware Co-Synthesis framework for quantum computing technology aimed at applications driven by the portfolio of DoD research.

Speakers

Dr. Jason Larkin

Research Scientist, CMU SEI

Read Jason's recent blog "Achieving the Quantum Advantage in Software" at https://insights.sei.cmu.edu/sei_blog/2019/12/achieving-the-quantum-advantage-in-software.html. Contact Jason at https://www.sei.cmu.edu/contact-us/index.cfm?f=Jason&l=Larkin

Monday November 9, 2020 3:30pm - 4:00pm EST
Virtual

Posters, Live

3:30pm EST

Poster: Spiral/AIML: Resource-Constrained Co-Optimization for High-Performance, Data-Intensive Computing

Dr. Scott McMillan
Spiral/AIML: Resource-Constrained Co-Optimization for High-Performance, Data-Intensive Computing
As the military adopts AI/ML to augment human teams, the cost of implementing and re-implementing AI/ML software on new hardware platforms will be prohibitive. To address these challenges, we propose to
develop a hardware-software co-optimization system that will

automatically search and select hardware configurations optimized for a specified computation
autonomously generate optimized codes for the selected hardware configuration and the irregular, data-intensive computations required for AI/ML algorithms

Speakers

Dr. Scott McMillan

MTS - Principal Engineer, CMU SEI

Read blog posts by Scott at https://insights.sei.cmu.edu/author/scott-mcmillan/. Contact Scott via https://www.sei.cmu.edu/contact-us/index.cfm?f=Scott&l=McMillan

Monday November 9, 2020 3:30pm - 4:00pm EST
Virtual

Posters, Live

11:00am EST

Welcome

Speakers

Dr. Thomas Longstaff

CTO, CMU SEI

Tuesday November 10, 2020 11:00am - 11:05am EST
Virtual

Opening, Live

11:05am EST

Engagement in all Facets of Cyberspace and Cyber-enabled Systems Essential to Mount an Effective Response

We act on the knowledge that the world we live in is increasingly digital, synthetic, and fueled by data. The software it is built on is developed with such speed and automation that we must think about security in a new way. And in today's age of artificial intelligence (AI), cyber adversaries operate with speed and dexterity in a world of ever-changing attack surfaces.

Speakers

Mr. Roman Danyliw

Deputy CTO, CMU SEI

Roman Danyliw is the Deputy Chief Technology Officer of the Carnegie Mellon University Software Engineering Institute. He is currently serving as an IETF Security Area Director.

Tuesday November 10, 2020 11:05am - 11:15am EST
Virtual

Framing, Live

11:15am EST

Advancing Cyber Operator Tradecraft through Automated Static Binary Analysis: Program Reachability for Vulnerability and Malware Analysis

This presentation period comprises

Framing (Mr. Cory Cohen)
Research on program reachability for vulnerability and malware analysis (Mr. Cohen)
Research on recovering meaningful variable names in decompiled code (Dr. Edward Schwartz)
Research on recent improvements in object-oriented construct recovery using OOAnalyzer (Mr. Cohen and Dr. Schwartz)
Live Q&A with the presenters (host: Mr. Jeffrey Gennari)

Speakers

Mr. Jeffrey Gennari

Senior Malware Reverse Engineer, CMU SEI

Read blog posts by Jeffrey at https://insights.sei.cmu.edu/author/jeffrey-gennari/. Contact him via https://www.sei.cmu.edu/contact-us/index.cfm?f=Jeffrey&l=Gennari... Read More →

Dr. Edward Schwartz

MTS - Senior Researcher, CMU SEI

Learn more about Edward through his writings at https://resources.sei.cmu.edu/library/author.cfm?authorid=446609. Contact Edward via https://www.sei.cmu.edu/contact-us/index.cfm?f=Edward&l=Schwartz

Mr. Cory Cohen

MTS - Principal Researcher, CMU SEI

Contact Cory at https://www.sei.cmu.edu/contact-us/index.cfm?f=Cory&l=Cohen

Tuesday November 10, 2020 11:15am - 12:15pm EST
Virtual

Presentation, Recorded with Live Q&A

12:15pm EST

Break

Tuesday November 10, 2020 12:15pm - 12:30pm EST
Virtual

Break

12:30pm EST

Framing: Combining Automated Code Repair for Memory Safety and Static Code Analysis Systems

Framing of two related projects

Speakers

Mr. Robert Schiela

Technical Manager, Cyber Security Foundations, CMU SEI

Robert is a Technical Manager, leading the Secure Coding group, in the Cyber Security Foundations directorate of CERT and the SEI. In this role, he helps the Secure Coding team define and execute research and transition knowledge that improves the state of the art and practice in... Read More →

Tuesday November 10, 2020 12:30pm - 12:35pm EST
Virtual

Framing, Recorded

12:35pm EST

Automated Code Repair for Memory Safety

Speakers

Dr. Will Klieber

Software Security Engineer, CMU SEI

Learn more about Will at https://insights.sei.cmu.edu/author/will-klieber/. Contact him via https://www.sei.cmu.edu/contact-us/index.cfm?f=Will&l=Klieber

Tuesday November 10, 2020 12:35pm - 12:55pm EST
Virtual

Presentation, Recorded

12:55pm EST

Static Code Analysis Classification

Speakers

Dr. Lori Flynn

Senior Software Security Engineer, CMU SEI

Learn more about SCAIFE at https://resources.sei.cmu.edu/library/asset-view.cfm?assetid=644354. Contact Lori at https://www.sei.cmu.edu/contact-us/index.cfm?f=Lori&l=Flynn... Read More →

Tuesday November 10, 2020 12:55pm - 1:15pm EST
Virtual

Presentation, Recorded

1:15pm EST

Combining Automated Code Repair for Memory Safety and Static Code Analysis Systems

Mr. Schiela moderates a live Q&A session with Dr. Flynn and Dr. Klieber.

Speakers

Dr. Lori Flynn

Senior Software Security Engineer, CMU SEI

Learn more about SCAIFE at https://resources.sei.cmu.edu/library/asset-view.cfm?assetid=644354. Contact Lori at https://www.sei.cmu.edu/contact-us/index.cfm?f=Lori&l=Flynn... Read More →

Tuesday November 10, 2020 1:15pm - 1:20pm EST
Virtual

Presentation, Recorded

1:20pm EST

Q&A: Combining Automated Code Repair for Memory Safety and Static Code Analysis Systems

Speakers

Dr. Lori Flynn

Senior Software Security Engineer, CMU SEI

Learn more about SCAIFE at https://resources.sei.cmu.edu/library/asset-view.cfm?assetid=644354. Contact Lori at https://www.sei.cmu.edu/contact-us/index.cfm?f=Lori&l=Flynn... Read More →

Dr. Will Klieber

Software Security Engineer, CMU SEI

Learn more about Will at https://insights.sei.cmu.edu/author/will-klieber/. Contact him via https://www.sei.cmu.edu/contact-us/index.cfm?f=Will&l=Klieber

Mr. Robert Schiela

Technical Manager, Cyber Security Foundations, CMU SEI

Tuesday November 10, 2020 1:20pm - 1:30pm EST
Virtual

Q&A, Live

1:30pm EST

Break

Tuesday November 10, 2020 1:30pm - 1:35pm EST
Virtual

Break

1:35pm EST

Framing: Implementing Cyber Security

Speakers

Mr. Roman Danyliw

Deputy CTO, CMU SEI

Roman Danyliw is the Deputy Chief Technology Officer of the Carnegie Mellon University Software Engineering Institute. He is currently serving as an IETF Security Area Director.

Tuesday November 10, 2020 1:35pm - 1:40pm EST
Virtual

Framing, Live

1:40pm EST

Implementing Cyber Security in DoD Supply Chains

Dr. Claycomb, as panel moderator, will lead the discussion among Mr. Bradley, Dr. Woody, Dr. Sherman, Dr. Mai, and Mr. Butkovic.Mr. Costa will monitor viewer questions shared in the chat for the panel moderator.

Moderators

Dr. William Claycomb

Principal Member of the Technical Staff, CMU SEI

Speakers

Mr. Joe Bradley

Director of the Cyber Resiliency Office for Weapon Systems and the Director of Engineering & Technical Management, Air Force Life Cycle Management Center

Joseph F. Bradley, a member of the Senior Executive Service, is the Director of the Cyber Resiliency Office for Weapon Systems and the Director of Engineering and Technical Management for the Air Force Life Cycle Management Center at Hanscom Air Force Base, Massachusetts.Mr. Bradley... Read More →

Mr. Dan Costa

Technical manager, Enterprise Threat and Vulnerability Management, CMU SEI

Mr. Matthew Butkovic

Technical Director, Risk and Resilience, CMU SEI

Read Matt's article "Organizations Must Reset Expectations to Spring Back from Pandemic" at https://www.sei.cmu.edu/news-events/news/article.cfm?assetid=642363... Read More →

Dr. Mark Sherman

Technical Director, Cyber Security Foundations, CMU SEI

Contact Mark at https://www.sei.cmu.edu/contact-us/index.cfm?f=Mark&l=Sherman

Dr. Carol Woody

Principal Researcher, CMU SEI

Read Carol's blog "Selecting Measurement Data for Software Assurance Practices" at https://insights.sei.cmu.edu/sei_blog/2019/07/selecting-measurement-data-for-software-assurance-practices.html. Contact Carol at https://www.sei.cmu.edu/contact-us/index.cfm?f=Carol&l=Woody

Dr. Kenneth Mai

Principal Systems Scientist, Electrical and Computer Engineering, CMU

Ken Mai received his B.S., M.S., and Ph.D. degrees in electrical engineering from Stanford University. He is currently a Principal Systems Scientist in the Electrical and Computer Engineering Department at Carnegie Mellon University. His research interests are in high-performance... Read More →

Tuesday November 10, 2020 1:40pm - 2:40pm EST
Virtual

Panel, Live

2:40pm EST

Break

Tuesday November 10, 2020 2:40pm - 2:45pm EST
Virtual

Break

2:45pm EST

Toward the Use of Human-Machine Teaming and Fully Autonomous Operations

CMU SEI R&D is working toward the use of human-machine teaming and fully autonomous operations to enable the DoD to identify adversary activity; respond at the cost, speed and scale required; and operate missions with increased certainty.

Speakers

Mr. Jeffrey Mattson

Deputy Technical Director, CMU SEI

Contact Jeffrey at https://www.sei.cmu.edu/contact-us/index.cfm?f=Jeffrey&l=Mattson

Tuesday November 10, 2020 2:45pm - 3:10pm EST
Virtual

Presentation, Recorded with Live Q&A

3:10pm EST

AIDE: Artificial Intelligence Defense Evaluation

Speakers

Dr. Grant Deffenbaugh

Senior Security Researcher, CMU SEI

Contact Dr. Deffenbaugh through our website at https://www.sei.cmu.edu/contact-us/index.cfm?f=Grant&l=Deffenbaugh.

Dr. Shing-hon Lau

Senior Cybersecurity Researcher, CMU SEI

Read Dr. Lau's blog on Measuring Resilience in Artificial Intelligence and Machine Learning Systems. Contact him through the SEI website at https://www.sei.cmu.edu/contact-us... Read More →

Tuesday November 10, 2020 3:10pm - 3:25pm EST
Virtual

Webinar, Recorded

3:25pm EST

About the President's Cup Competition

Established in response to Executive Order 13870, the President’s Cup Cybersecurity Competition is a national cyber competition aiming to identify, recognize, and reward the best cybersecurity talent in the federal executive workforce. Hosting challenges from across the National Initiative for Cybersecurity Education (NICE) Cybersecurity Framework, competitors will face a diverse array of challenges and will require an extensive skill set to succeed.

Speakers

Mr. Matt Kaar

Cyber Security Exercise Developer & Trainer, CMU SEI

Tuesday November 10, 2020 3:25pm - 3:45pm EST
Virtual

Webinar, Recorded

3:45pm EST

Bringing it all Together

Dr. Longstaff will blend the research discussions of the session and introduce the poster presentations

Speakers

Dr. Thomas Longstaff

CTO, CMU SEI

Tuesday November 10, 2020 3:45pm - 3:55pm EST
Virtual

Integration, Live

3:55pm EST

Closing

Video closing of the day

Tuesday November 10, 2020 3:55pm - 4:00pm EST
Virtual

Wrap-Up, Recorded

11:00am EST

Welcome

Speakers

Dr. Thomas Longstaff

CTO, CMU SEI

Thursday November 12, 2020 11:00am - 11:05am EST
Virtual

Opening, Live

11:05am EST

Enabling DoD to Produce Systems that are Agile and Responsive to its Missions

Speakers

Dr. Jeff Boleng

Senior Advisor for Software Acquisition/Senior Software Advisor, Director's Office, ISD(A&S)/CMU SEI

Watch Jeff's discussion with SEI CTO Tom Longstaff "A Discussion of DoD Software Advances and What's Next from SEI" at https://www.sei.cmu.edu/news-events/events/event.cfm?customel_datapageid_5541=207242

Thursday November 12, 2020 11:05am - 11:25am EST
Virtual

Framing, Live

11:25am EST

Break

Thursday November 12, 2020 11:25am - 11:30am EST
Virtual

Break

11:30am EST

Software Engineering’s Grand Challenges: Voices from Visionaries

How will software engineering enable our future vision? In this showcase, experts from industry and government will discuss major open problems and grand challenges in software engineering. Each participant will talk about software engineering’s “grand challenges” as they relate to their field of work, including space exploration, supercomputing, AI, and future battle systems.

Mr. Robert will moderate the flow of questions shared in the chat during the panel's discussion.

Moderators

Ms. Anita Carleton

Director, Software Solutions Division, CMU SEI

Anita Carleton is an Executive Leadership Team Member and Division Director of the Software Solutions Division (SSD) at the Software Engineering Institute (SEI), Carnegie Mellon University, where she has more than 30 years of technical and senior leadership experience in the software... Read More →

Speakers

Mr. Tim Dare

Deputy Director for Prototyping and Software; Lead of National Defense Authorization Act Section 255, Under Secretary of Defense for Research and Engineering

Mr. Timothy S. Dare is the Deputy Director for Prototyping and Software (DD(P&S)). As the DD(P&S), Mr. Dare is the senior DDRE(AC) official responsible for prototyping and manages DDRE(AC)’s annual $400+M prototyping portfolio. In support of USD(R&E)’s mission to develop capability... Read More →

Dr. J. Michael McQuade

Vice President for Research, CMU

Dr. Deborah Frincke

Associate Laboratory Director for National Security Sciences, Oak Ridge National Laboratory

Dr. Deborah Frincke, the Associate Laboratory Director for National Security Sciences at Oak Ridge National Laboratory, guides the research and development of science-based solutions to complex threats that put public safety, national defense, energy infrastructure, and the economy... Read More →

Dr. Vint Cerf

Vice President and Chief Internet Evangelist, Google

Mr. Vinton G. Cerf, Internet Hall of Fame Pioneer, is widely known as a “Father of the Internet,” Cerf is the co-designer of the TCP/IP protocols and the architecture of the Internet. In December 1997, President Bill Clinton presented the U.S. National Medal of Technology to Cerf... Read More →

Mr. Nand Mulchandani

Chief Technology Officer, Joint Artificial Intelligence Center

Mr. Nand Mulchandani serves as the Chief Technology Officer of the U.S. Department of Defense Joint Artificial Intelligence Center. He brings more than 25 years of experience in the technology industry as a serial entrepreneur and senior executive in the enterprise infrastructure... Read More →

Mr. John Robert

Deputy Director, Software Solutions Division, CMU SEI

Dr. William Scherlis

Director, Information Innovation Office, Defense Advance Research Projects Agency

Dr. William Scherlis assumed the role of office director for DARPA’s Information Innovation Office in September 2019. In this role he leads program managers in the development of programs, technologies, and capabilities to ensure information advantage for the United States and its... Read More →

Ms. Sara Manning Dawson

General Manager, Microsoft Critical Infrastructure Engineering, Microsoft Corporation

Ms. Sara Manning Dawson is a Partner General Manager at Microsoft, specializing in cloud infrastructure security. She leads the Critical Infrastructure (CI) Engineering team, working across engineering, industry and government to design and deliver a Microsoft cloud platform and... Read More →

Thursday November 12, 2020 11:30am - 12:35pm EST
Virtual

Panel, Live

12:35pm EST

Break

Thursday November 12, 2020 12:35pm - 12:50pm EST
Virtual

Break

12:50pm EST

Framing

Speakers

Dr. Ipek Ozkaya

Technical Director, Engineering Intelligent Software Systems, CMU SEI

Learn more about Ipek at https://www.linkedin.com/in/ipekozkaya/

Thursday November 12, 2020 12:50pm - 12:55pm EST
Virtual

Framing, Live

12:55pm EST

Untangling the Knot: Enabling Rapid Software Evolution

This project introduces automation to a software problem that is largely handled manually in DoD and industry today, restructuring poorly structured software to enable harvesting or replacement of components. The kinds of structural coupling problems addressed by this proposal are pervasive in software and commonly interfere with DoD objectives.

Speakers

Mr. James Ivers

Principal Engineer, CMU SEI

Learn more about James at https://resources.sei.cmu.edu/library/author.cfm?authorid=4463. Contact him at https://www.sei.cmu.edu/contact-us/index.cfm?f=James&l=Ivers.

Thursday November 12, 2020 12:55pm - 1:15pm EST
Virtual

Presentation, Recorded

1:15pm EST

TwinOps – Digital Twins meet DevOps

At the SEI, we have developed a line of research that improves both the state of the art and the state of practice to design and analyze cyber-physical systems. Through AADL and ACVIP, we address both system and software concerns (safety, security, performance and code generation. Analytical frameworks based on AADL evaluate system integrability prior to the performance of actual integration testing activities. As of today, these do not integrate the physics of the system. In this project, we want to study the interplay between physics models (using Modelica and the FMI standard) and AADL models to improve virtual integration.

Speakers

Dr. Jerome Hugues

Senior Architecture Researcher, CMU SEI

Learn more about Jerome at https://www.linkedin.com/public-profile/in/jeromehugues?challengeId=AQF0mR6kGnkb1wAAAXORuR2WB0sYZQ3-WFKv95jOW1lP5qiFR6dOuhhRxIas2yC2XDX90gvhBOspnfH6S-mBIvetKngCpNJGbQ&submissionId=18b5b2d3-4eb2-2516-0436-39a82b3a535f

Thursday November 12, 2020 1:15pm - 1:35pm EST
Virtual

Presentation, Recorded

1:35pm EST

Q&A: TwinOps and Untangling the Knot

Dr. Ozkaya will moderate a live Q&A session with Dr. Hugues and Mr. Ivers.

Speakers

Dr. Ipek Ozkaya

Technical Director, Engineering Intelligent Software Systems, CMU SEI

Learn more about Ipek at https://www.linkedin.com/in/ipekozkaya/

Dr. Jerome Hugues

Senior Architecture Researcher, CMU SEI

Mr. James Ivers

Principal Engineer, CMU SEI

Learn more about James at https://resources.sei.cmu.edu/library/author.cfm?authorid=4463. Contact him at https://www.sei.cmu.edu/contact-us/index.cfm?f=James&l=Ivers.

Thursday November 12, 2020 1:35pm - 1:55pm EST
Virtual

Q&A, Live

1:55pm EST

Break

Thursday November 12, 2020 1:55pm - 2:00pm EST
Virtual

Break

2:00pm EST

Model Based Engineering with AADL: Transitioning Research to Practice

A discussion of the Architecture Analysis and Design Language, including its history and impact on transition partners. This will encompass R&D in the ongoing Line-funded project for integrating safety and security engineering.

Speakers

Dr. Sam Procter

Senior Architecture Researcher, CMU SEI

Learn more about Sam's blogs at https://insights.sei.cmu.edu/author/sam-procter/. Contact Sam at https://www.sei.cmu.edu/contact-us/index.cfm?f=Sam&l=Procter

Thursday November 12, 2020 2:00pm - 2:25pm EST
Virtual

Presentation, Recorded

2:25pm EST

Q&A: Model Based Engineering with AADL: Transitioning Research to Practice

Speakers

Dr. Ipek Ozkaya

Technical Director, Engineering Intelligent Software Systems, CMU SEI

Learn more about Ipek at https://www.linkedin.com/in/ipekozkaya/

Dr. Sam Procter

Senior Architecture Researcher, CMU SEI

Learn more about Sam's blogs at https://insights.sei.cmu.edu/author/sam-procter/. Contact Sam at https://www.sei.cmu.edu/contact-us/index.cfm?f=Sam&l=Procter

Dr. Jerome Hugues

Senior Architecture Researcher, CMU SEI

Thursday November 12, 2020 2:25pm - 2:40pm EST
Virtual

Q&A, Live

2:40pm EST

Bringing it all Together

Dr. Longstaff will blend the research discussions of the session and introduce the poster presentations

Speakers

Dr. Thomas Longstaff

CTO, CMU SEI

Thursday November 12, 2020 2:40pm - 2:50pm EST
Virtual

Integration, Live

2:55pm EST

Break to Transition to Poster Rooms

Thursday November 12, 2020 2:55pm - 3:00pm EST
Virtual

Break

3:00pm EST

Concurrent Sessions: Four Poster Presentations and Discussions

Thursday November 12, 2020 3:00pm - 3:30pm EST
Virtual

Posters, Live

3:00pm EST

Poster: High-Assurance Software-Defined IoT Security

Mr. Sebastian Echeverria
High-Assurance Software-Defined IoT Security
The outcomes for this project are (i) policy abstractions that address the threats identified in each task; (ii) end-to-end prototype, with verified properties, running verified, trusted and untrusted system components; (iii) publications in venues such as NDSS, MilCom, IEEE Security and Privacy, and the USENIX Security Symposium.

Speakers

Mr. Sebastian Echeverria

MTS - Senior Engineer, CMU SEI

Learn more about Sebastian's work at https://resources.sei.cmu.edu/library/author.cfm?authorid=447474. Contact him at https://www.sei.cmu.edu/contact-us/index.cfm?f=Sebasti%C3%A1n&l=Echeverr%C3%ADa... Read More →

Thursday November 12, 2020 3:00pm - 3:30pm EST
Virtual

Posters, Live

3:00pm EST

Poster: Investigating the Feasibility of an Integrated Causal Model for Software Cost Control

Dr. Michael Konrad
Investigating the Feasibility of an Integrated Causal Model for Software Cost Control
Estimating and controlling software project costs would benefit from causal knowledge of what drives program costs; however, much of software engineering research reports results from multiple regression, which focuses on correlation rather than causation. For three years (FY18-20), this project investigated the application of causal discovery as an alternative approach to conducting software engineering research, resulting in the identification of direct causes (instead of spurious causes) of program costs, schedule, and quality. This knowledge supports (1) program investments in the enablers of program success and reduction in software vulnerabilities; and (2) corrective and preventive actions on those factors more likely to place a program on track to achieve its objectives.

Speakers

Dr. William Nichols

Senior Member of the Technical Staff, CMU SEI

Dr. Michael Konrad

Principal Researcher, CMU SEI

Read the recent blog "Addressing Open Architecture in Software Cost Estimation" at https://insights.sei.cmu.edu/sei_blog/2020/07/addressing-open-architecture-in-software-cost-estimation.html to learn more about Michael's recent work

Thursday November 12, 2020 3:00pm - 3:30pm EST
Virtual

Posters, Live

3:00pm EST

Poster: Multicore Confidence

Dr. Bjorn Andersson
Multicore Confidence
Many DoD systems have all processor cores except one disabled in order to be confident about timing. The objective of this project is to develop a solution to overcome this obstacle. The goal is to achieve a 300% in-crease in the processing capacity that can be used while being confident about timing.

Speakers

Dr. Bjorn Andersson

MTS - Principal Researcher, CMU SEI

Read Bjorn's latest blog on multicore processors at https://insights.sei.cmu.edu/sei_blog/2020/08/verifying-timing-in-undocumented-multicore-processors.html. Learn more about hiss work at https://resources.sei.cmu.edu/library/author.cfm?authorid=54143... Read More →

Thursday November 12, 2020 3:00pm - 3:30pm EST
Virtual

Posters, Live

3:00pm EST

Poster: Rapid Certification of Trust

Dr. Dionisio de Niz
Rapid Certification of Trust
The goal of this project is to reduce the deployment time of Military Cyber-Physical Systems (CPS) by reducing the development and assurance time. We will do this by enabling the use of unverified commodity software components (e.g., open source drone piloting software) guarded by verified enforcers that guarantees that unsafe component behavior is contained.

Speakers

Dr. Dionisio de Niz

Technical Director, Assuring CyberPhysical Systems, CMU SEI

Learn more about Dio's work at https://resources.sei.cmu.edu/library/author.cfm?authorid=3373

Thursday November 12, 2020 3:00pm - 3:30pm EST
Virtual

Posters, Live

11:00am EST

Welcome

Speakers

Dr. Thomas Longstaff

CTO, CMU SEI

Friday November 13, 2020 11:00am - 11:05am EST
Virtual

Opening, Live

11:05am EST

Integrating CI/CD Processes Across the Acquisition Lifecycle

Speakers

Ms. Eileen Wrubel

Technical Director, Transforming Software Acquisition Policy and Practice, CMU SEI

Friday November 13, 2020 11:05am - 11:25am EST
Virtual

Framing, Live

11:25am EST

Break

Friday November 13, 2020 11:25am - 11:30am EST
Virtual

Break

11:30am EST

Software Research in Action: Multidisciplinary Work Supporting a Paradigm Shift in DoD Acquisition

Dr. Shull leads work that is enabling the DoD to adopt modern software development practices that will delivery innovative capabilities to the warfighter much sooner than was historically achieved.

Ms. Gates will moderate questions shared in the chat during the panel's discussion.

Moderators

Dr. Forrest Shull

Lead for Defense Software Acquisition Policy Research, CMU SEI

Forrest Shull is the Lead for Defense Software Acquisition Policy Research at Carnegie Mellon University’s Software Engineering Institute (SEI). His role is to lead work with US government agencies, national labs, industry, and academic institutions to advance the use of empirically... Read More →

Speakers

Ms . Linda Parker Gates

Initiative Lead, Software Acquisition Pathways, CMU SEI

Mr. Sean Brady

Software Acquisition Pathway Lead, USD(A&S)/Acquisition Enablers

Dr. Amy Henninger

Senior Advisor for Software and Cybersecurity, Director of Operational Test and Evaluation

Mr. Shane Ficorilli

Software Engineer, CMU SEI

Friday November 13, 2020 11:30am - 12:15pm EST
Virtual

Panel, Live

12:15pm EST

Break

Friday November 13, 2020 12:15pm - 12:30pm EST
Virtual

Break

12:30pm EST

Framing

Ms. Wrubel provides context for presentations on software design and development in a continuous integration environment.

Speakers

Ms. Eileen Wrubel

Technical Director, Transforming Software Acquisition Policy and Practice, CMU SEI

Friday November 13, 2020 12:30pm - 12:35pm EST
Virtual

Framing, Live

12:35pm EST

Rapid Adjudication of Static Analysis Alerts During Continuous Integration

The goal of this project is to improve the state of the art in reducing false positives and integrating SA tools into continuous integration/continuous deployment (CI/CD) processes.

Speakers

Dr. Lori Flynn

Senior Software Security Engineer, CMU SEI

Learn more about SCAIFE at https://resources.sei.cmu.edu/library/asset-view.cfm?assetid=644354. Contact Lori at https://www.sei.cmu.edu/contact-us/index.cfm?f=Lori&l=Flynn... Read More →

Friday November 13, 2020 12:35pm - 12:55pm EST
Virtual

Presentation, Recorded

12:55pm EST

Automated Design Conformance During Continuous Integration

This project will develop machine learning (ML) techniques that reduce the time to detect implementations that do not conform to intended designs (i.e. nonconformances) in systems from months or years to hours. To reduce the time to field capabilities and to lower lifecycle costs.

Speakers

Dr. Rod Nord

Principal Member of the Technical Staff, CMU SEI

Learn more about Rod at https://resources.sei.cmu.edu/library/author.cfm?authorid=4181. Contact Rod at https://www.sei.cmu.edu/contact-us/index.cfm?f=Robert&l=Nord

Friday November 13, 2020 12:55pm - 1:15pm EST
Virtual

Presentation, Recorded

1:15pm EST

Q&A Discussion with Researchers in Rapid Adjudication of Static Analysis Alerts and Automated Design Conformance

Mr. Yasar moderates a live Q&A session with Dr. Flynn and Dr. Nord.

Speakers

Mr. Hasan Yasar

Technical Director, Continuous Deployment of Capability, CMU SEI

Watch Hasan's recent webinar "Trust, Verify, and Authorize with DevSecOps" at https://www.sei.cmu.edu/news-events/events/event.cfm?customel_datapageid_5541=207075Hasan Yasar is the Technical Director, Continuous Deployment of Capability at Carnegie Mellon University's Software Engineering... Read More →

Dr. Lori Flynn

Senior Software Security Engineer, CMU SEI

Learn more about SCAIFE at https://resources.sei.cmu.edu/library/asset-view.cfm?assetid=644354. Contact Lori at https://www.sei.cmu.edu/contact-us/index.cfm?f=Lori&l=Flynn... Read More →

Dr. Rod Nord

Principal Member of the Technical Staff, CMU SEI

Learn more about Rod at https://resources.sei.cmu.edu/library/author.cfm?authorid=4181. Contact Rod at https://www.sei.cmu.edu/contact-us/index.cfm?f=Robert&l=Nord

Friday November 13, 2020 1:15pm - 1:35pm EST
Virtual

Q&A, Live

1:35pm EST

Break

Friday November 13, 2020 1:35pm - 1:40pm EST
Virtual

Break

1:40pm EST

Modernization for Rapid Delivery of Enhanced Capability/Reduction of Sustainment Costs

The largest cyberphysical systems that the SEI has Program Work Plans with (F35 and GBSD among others) are facing not just software development challenges but also a myriad of socio-technical challenges in navigating the acquisition eco-system. This panel highlights three aspects of the challenges for modernization and sustainment:

the implications of the move from single product delivery to ongoing capability delivery
the role of modeling throughout the acquisition lifecycle
the effect of Dev*Ops on an ongoing capability delivery mindset

Moderators

Ms. Suzanne M. Miller

Principal Researcher, CMU SEI

Speakers

Dr. Kate Gill

F-35 Digital Transformation and Software Modernization, F35 Joint Project Office

Dr. Kate Gill, F-35 Digital Transformation and Software Modernization, F-35 Joint Project Office, Washington DC (Seconded from UK Ministry of Defence, Defence Science and Technology Laboratory (Dstl))2020 UK Women in Defence FinalistDr. Gill is seconded to the F35 Joint Project Office... Read More →

Mr. Stephen Falcone

Director of Engineering, United States Air Force

Mr. Stephen J. Falcone, a member of the Acquisition Corps, is the Digital Director of Engineering, Air Force Life Cycle Management Center (AFLCMC), Air Force Materiel Command (AFMC), Hanscom Air Force Base, Massachusetts. He is responsible for organizing, training and equipping the... Read More →

Friday November 13, 2020 1:40pm - 2:20pm EST
Virtual

Panel, Live

2:20pm EST

Break

Friday November 13, 2020 2:20pm - 2:25pm EST
Virtual

Break

2:25pm EST

CMU SEI Agile Virtual Schoolhouse

The Department of Defense seeks to leverage Agile and DevSecOps principles to meet the urgent need to deliver capability at the speed of relevance. We will discuss our recent experience deploying a virtual training channel to provide best-of-breed resources and CMU SEI research in a flexible online format for remote team education.

Following the recorded presentation, Ms. Nolan will moderate a live Q&A discussion, using questions shared by viewers in the chat, with Ms. Miller and Mr. Hayes.

Speakers

Presentation, Recorded with Live Q&A

3:05pm EST

Break

Friday November 13, 2020 3:05pm - 3:10pm EST
Virtual

Break

3:10pm EST

Bringing it all Together

Dr. Longstaff will blend the research discussions of the session and introduce the poster presentations

Speakers

Dr. Thomas Longstaff

CTO, CMU SEI

Friday November 13, 2020 3:10pm - 3:20pm EST
Virtual

Integration, Live