Loading…

Log in to bookmark your favorites and sync them to your phone or calendar.

Monday, November 9
 

11:00am EST

Welcome to the 2020 CMU SEI Research Review from the SEI Director
Speakers
avatar for Dr. Paul Nielsen

Dr. Paul Nielsen

Director and CEO, CMU SEI
Paul D. Nielsen is Director and Chief Executive Officer of the Carnegie Mellon University Software Engineering Institute (SEI), a leader in advancing software and cybersecurity to solve the nation’s toughest problems through focused research, development, and transition to the broad... Read More →


Monday November 9, 2020 11:00am - 11:05am EST
Virtual

11:05am EST

Welcome to the 2020 CMU SEI Research Review from the CMU Vice-President of Research
Speakers
avatar for Dr. J. Michael McQuade

Dr. J. Michael McQuade

Vice President for Research, CMU
J. Michael McQuade is Carnegie Mellon University's vice president for research, providing leadership for the university's research enterprise and advocating for the role that science, technology and innovation play nationally and globally.From 2006 to 2018 he served as senior vice... Read More →


Monday November 9, 2020 11:05am - 11:10am EST
Virtual

11:10am EST

Realizing Algorithmic and Computational Advantage including the Need for an AI Engineering Discipline
This introduction will show the need for an AI Engineering discipline in order to routinely produce AI-enabled systems that are scalable, robust and secure, and human-centered. Dr. Gaston will illustrate how CMU SEI as DoD's FFRDC for software engineering and cybersecurity has trust of stakeholders who will benefit from the use of an AI Engineering discipline

Speakers
avatar for Dr.  Matt Gaston

Dr. Matt Gaston

Director, SEI Emerging Technology Center, CMU SEI
Dr. Matt Gaston is director of the SEI Emerging Technology Center (ETC). He assists the U.S. Department of Defense and the intelligence community in identifying, evaluating, developing, and transitioning leading-edge data-intensive scalable computing technologies. He has led the establishment... Read More →


Monday November 9, 2020 11:10am - 11:25am EST
Virtual

11:25am EST

Break
Monday November 9, 2020 11:25am - 11:35am EST
Virtual

11:35am EST

Advancing AI Engineering for Defense and National Security
Dr. Gaston will lead a discussion with other experts in examining how the current state of Artificial Intelligence (AI) for the U.S. Department of Defense calls for the creation of a discipline for AI Engineering. Ms. Barmer will moderate viewer chats during the panel.

Moderators
avatar for Dr.  Matt Gaston

Dr. Matt Gaston

Director, SEI Emerging Technology Center, CMU SEI
Dr. Matt Gaston is director of the SEI Emerging Technology Center (ETC). He assists the U.S. Department of Defense and the intelligence community in identifying, evaluating, developing, and transitioning leading-edge data-intensive scalable computing technologies. He has led the establishment... Read More →

Speakers
avatar for Lieutenant General Michael S. Groen

Lieutenant General Michael S. Groen

Director, Joint Artificial Intelligence Center
Lieutenant General Michael S. Groen assumed his current position as the Director, Joint Artificial Intelligence Center on 1 October 2020. As a member of the JAIC team, he leads the transformation of U.S. Joint warfighting and departmental processes through the integration of Artificial... Read More →
avatar for Dr. Mary

Dr. Mary "Missy" Cummings

Defense Innovation Board
Professor in the Department of Mechanical Engineering and Materials Science, Mary "Missy" Cummings received her B.S. in Mathematics from the US Naval Academy in 1988, her M.S. in Space Systems Engineering from the Naval Postgraduate School in 1994, and her Ph.D. in Systems Engineering... Read More →
avatar for Dr. John Beieler

Dr. John Beieler

Director, Science & Technology, Office of the Director of National Intelligence
For more information on Dr. Beieler, visit https://www.linkedin.com/in/john-beieler-7496a554/.


Monday November 9, 2020 11:35am - 12:20pm EST
Virtual

12:20pm EST

Break
Monday November 9, 2020 12:20pm - 12:35pm EST
Virtual

12:35pm EST

Introduction to Presentations
Speakers
avatar for Dr.  Matt Gaston

Dr. Matt Gaston

Director, SEI Emerging Technology Center, CMU SEI
Dr. Matt Gaston is director of the SEI Emerging Technology Center (ETC). He assists the U.S. Department of Defense and the intelligence community in identifying, evaluating, developing, and transitioning leading-edge data-intensive scalable computing technologies. He has led the establishment... Read More →


Monday November 9, 2020 12:35pm - 12:40pm EST
Virtual

12:40pm EST

Train but Verify: Towards Practical AI Robustness
Dr. Van Houdnos will describe his research into developing a continuous integration/continuous delivery Fast AI Test Harness (FAITH) to verify the robustness properties of the system’s machine learning components. The objective of the Train, but Verify project is to: (1) research and refine an AI Engineering process designed to train AI systems to have specific robustness properties, and (2) develop a testing framework capable of verifying these robustness practices. This presentation will be followed by a live Q&A period with John Helland from the project research team.

Mr. Helland and Ms. Smith will moderate a live Q&A session following Dr. Van Houdnos's presentation.

Speakers
avatar for Ms. Tanisha Smith

Ms. Tanisha Smith

Technical Manager, CMU SEI
avatar for Mr. Jon Helland

Mr. Jon Helland

Associate Machine Learning Researcher, CMU SEI
avatar for Dr. Nathan Van Houdnos

Dr. Nathan Van Houdnos

Senior Machine Learning Research Scientist, CMU SEI
Learn more about Nathan at https://resources.sei.cmu.edu/library/author.cfm?authorid=484947. Contact him via https://www.sei.cmu.edu/contact-us/index.cfm?f=Nathan&l=VanHoudnos


Monday November 9, 2020 12:40pm - 1:10pm EST
Virtual

1:10pm EST

Investigating Techniques for Summarizing and Searching Video
This presentation will discuss research to address the quality and efficacy of tracking items in aerial surveillance video. It will be followed by a live Q&A session on the topic.

Speakers
avatar for Mr. Edwin Morris

Mr. Edwin Morris

Senior Member of the Technical Staff, CMU SEI
Read Ed's recent blog "Summarizing and Searching Video with Machine Learning" at https://insights.sei.cmu.edu/sei_blog/2020/03/summarizing-and-searching-video-with-machine-learning.html. Contact Ed via https://www.sei.cmu.edu/contact-us/index.cfm?f=Edwin&l=Morris
avatar for Mr. Adam Harley

Mr. Adam Harley

School of Computer Science, CMU


Monday November 9, 2020 1:10pm - 1:40pm EST
Virtual

1:40pm EST

Break
Monday November 9, 2020 1:40pm - 1:45pm EST
Virtual

1:45pm EST

Ethics in AI Engineering
Ms. Smith will discuss why ethical principles are so important for AI and post a grand challenge to make AI ethical.

Following the talk, Ms. Van Deusen will moderate a Q&A session using comments shared in the chat.

Speakers
avatar for Ms. Alex Van Deusen

Ms. Alex Van Deusen

Design Researcher, CMU SEI
avatar for Ms. Carol Smith

Ms. Carol Smith

Senior Research Scientist, Human Machine Interaction, CMU SEI
Read Carol's blogs at https://resources.sei.cmu.edu/library/author.cfm?authorID=636431


Monday November 9, 2020 1:45pm - 2:15pm EST
Virtual

2:15pm EST

Knowing When You Don’t Know: Engineering AI Systems in an Uncertain World
Dr. Heim will preview new research focused on a gap in the practice of employing Artificial Intelligence. Modern AI systems most commonly employ Machine Learning (ML) models to make important, domain-relevant inferences. However, ML, almost by its very nature, is called upon to make inferences in the presence of inherent uncertainty. Due in part to uncertainty, state-of-the-art ML models can produce inaccurate inferences in scenarios where humans would reasonably expect high accuracy. Further exacerbating this issue is that many commonly used models do not provide accurate estimates about when they are uncertain about their predictions. As a result, not only can ML inferences be incorrect, but it can be extremely difficult to predict when they will be incorrect. AI system components downstream from an ML model or humans using the model's output to complete a task must then reason with incorrect inferences that they expect to be correct.


Speakers
avatar for Dr. Eric Heim

Dr. Eric Heim

Senior Research Scientist - Machine Learning, CMU SEI
Learn more about some of Eric's recent work at https://www.sei.cmu.edu/research-capabilities/all-work/display.cfm?customel_datapageid_4050=201338. Contact him at https://www.sei.cmu.edu/contact-us/


Monday November 9, 2020 2:15pm - 2:25pm EST
Virtual

2:25pm EST

Break
Monday November 9, 2020 2:25pm - 2:30pm EST
Virtual

2:30pm EST

Topics in Advanced Computing: The Promise and Challenges of Recommendation Systems for the DoD
Dr. Wohlbier will discuss the use of recommendation systems, which are ubiquitous in the commercial space and on the rise across the Department of Defense. Recommendation systems present unique computational challenges including extremely large datasets and a combination of sparse and dense memory operations. We will discuss details of our recent work on improving the performance of Facebook’s Deep Learning Recommendation Model.

Dr. McMillan will moderate a live Q&A following the presentation.


Speakers
avatar for Dr. Scott McMillan

Dr. Scott McMillan

MTS - Principal Engineer, CMU SEI
Read blog posts by Scott at https://insights.sei.cmu.edu/author/scott-mcmillan/. Contact Scott via https://www.sei.cmu.edu/contact-us/index.cfm?f=Scott&l=McMillan
avatar for Dr. John Wohlbier

Dr. John Wohlbier

Senior Research Scientist, SEI Emerging Technology Center, CMU SEI


Monday November 9, 2020 2:30pm - 3:10pm EST
Virtual

3:10pm EST

Break
Monday November 9, 2020 3:10pm - 3:15pm EST
Virtual

3:15pm EST

Bringing it all Together
Dr. Longstaff will blend the research discussions of the session

Speakers
avatar for Dr. Thomas Longstaff

Dr. Thomas Longstaff

CTO, CMU SEI
Read Tom's recent blog "What Engineers Need to Know about Artificial Intellilgence" at https://insights.sei.cmu.edu/sei_blog/2019/09/what-engineers-need-to-know-about-artificial-intelligence.html. Contact Tom via https://www.sei.cmu.edu/contact-us/index.cfm?f=Thomas&l=LongstaffTom Longstaff is Chief Technology Officer of the SEI. As CTO, Longstaff is responsible for formulating a technical strategy and leading the funded research program of the institute based on current and predicted future trends in technology, government, and industry.Before joining the SEI as CTO in 2018, Longstaff was a program manager and principal cybersecurity strategist for th... Read More →


Monday November 9, 2020 3:15pm - 3:25pm EST
Virtual

3:25pm EST

Break to Transition to Poster Rooms
Monday November 9, 2020 3:25pm - 3:30pm EST
Virtual

3:30pm EST

3:30pm EST

Poster: Characterizing and Detecting Mismatch in ML-Enabled Systems
Dr. Grace Lewis
Characterizing and Detecting Mismatch in ML-Enabled Systems

We propose to develop machine-readable ML-Enabled System Element Descriptors as a mechanism to enable mismatch detection and prevention in ML-enabled systems. The goal of the descriptors is to codify attributes of system elements and therefore make all assumptions explicit. The descriptors can be used by system stakeholders in a manual way, for information, awareness and evaluation activities; and by automated mismatch detectors at design time and runtime for cases in which attributes lend themselves to automation.

Speakers
avatar for Dr. Grace A. Lewis

Dr. Grace A. Lewis

Principal Researcher / TAS Initiative Lead, CMU SEI
Read Grace's recent blog "Detecting Mismatches in Machine-Learning Systems" at https://insights.sei.cmu.edu/sei_blog/2020/06/detecting-mismatches-in-machine-learning-systems.html. Contact Grace via https://www.sei.cmu.edu/contact-us/index.cfm?f=Grace&l=Lewis


Monday November 9, 2020 3:30pm - 4:00pm EST
Virtual

3:30pm EST

Poster: Improving Human Decision Making with AI Decision Support Systems
Mr. Rotem Guttman
Improving Human Decision Making with AI Decision Support Systems

The project will proceed along several semi-overlapping tracks. This parallelism is built in to the project plan in order to both maximize how much can be accomplished during the period of performance. As the purpose of a LENS project is to determine the merits of an approach and inform the development of larger research programs, our focus will be on establishing both the appropriate test apparatus, as well as a useful baseline of layman performance. Without such a baseline, it would be impossible to assess the effect that the domain experience of subject matter experts may cause.

Speakers
avatar for Mr. Rotem Guttman

Mr. Rotem Guttman

Cybersecurity Researcher, CMU SEI


Monday November 9, 2020 3:30pm - 4:00pm EST
Virtual

3:30pm EST

Poster: Quantum Advantage Evaluation Framework
Dr. Jason Larkin
Quantum Advantage Evaluation Framework

We will a create novel classical computing emulator and a software/hardware Co-Synthesis framework for quantum computing technology aimed at applications driven by the portfolio of DoD research.

Speakers
avatar for Dr. Jason Larkin

Dr. Jason Larkin

Research Scientist, CMU SEI
Read Jason's recent blog "Achieving the Quantum Advantage in Software" at https://insights.sei.cmu.edu/sei_blog/2019/12/achieving-the-quantum-advantage-in-software.html. Contact Jason at https://www.sei.cmu.edu/contact-us/index.cfm?f=Jason&l=Larkin


Monday November 9, 2020 3:30pm - 4:00pm EST
Virtual

3:30pm EST

Poster: Spiral/AIML: Resource-Constrained Co-Optimization for High-Performance, Data-Intensive Computing
Dr. Scott McMillan
Spiral/AIML: Resource-Constrained Co-Optimization for High-Performance, Data-Intensive Computing
As the military adopts AI/ML to augment human teams, the cost of implementing and re-implementing AI/ML software on new hardware platforms will be prohibitive. To address these challenges, we propose to
develop a hardware-software co-optimization system that will
  • automatically search and select hardware configurations optimized for a specified computation 
  • autonomously generate optimized codes for the selected hardware configuration and the irregular, data-intensive computations required for AI/ML algorithms

Speakers
avatar for Dr. Scott McMillan

Dr. Scott McMillan

MTS - Principal Engineer, CMU SEI
Read blog posts by Scott at https://insights.sei.cmu.edu/author/scott-mcmillan/. Contact Scott via https://www.sei.cmu.edu/contact-us/index.cfm?f=Scott&l=McMillan


Monday November 9, 2020 3:30pm - 4:00pm EST
Virtual
 
Tuesday, November 10
 

11:00am EST

Welcome
Speakers
avatar for Dr. Thomas Longstaff

Dr. Thomas Longstaff

CTO, CMU SEI
Read Tom's recent blog "What Engineers Need to Know about Artificial Intellilgence" at https://insights.sei.cmu.edu/sei_blog/2019/09/what-engineers-need-to-know-about-artificial-intelligence.html. Contact Tom via https://www.sei.cmu.edu/contact-us/index.cfm?f=Thomas&l=LongstaffTom Longstaff is Chief Technology Officer of the SEI. As CTO, Longstaff is responsible for formulating a technical strategy and leading the funded research program of the institute based on current and predicted future trends in technology, government, and industry.Before joining the SEI as CTO in 2018, Longstaff was a program manager and principal cybersecurity strategist for th... Read More →


Tuesday November 10, 2020 11:00am - 11:05am EST
Virtual

11:05am EST

Engagement in all Facets of Cyberspace and Cyber-enabled Systems Essential to Mount an Effective Response
We act on the knowledge that the world we live in is increasingly digital, synthetic, and fueled by data. The software it is built on is developed with such speed and automation that we must think about security in a new way. And in today's age of artificial intelligence (AI), cyber adversaries operate with speed and dexterity in a world of ever-changing attack surfaces.

Speakers
avatar for Mr. Roman Danyliw

Mr. Roman Danyliw

Deputy CTO, CMU SEI
Roman Danyliw is the Deputy Chief Technology Officer of the Carnegie Mellon University Software Engineering Institute.  He is currently serving as an IETF Security Area Director.


Tuesday November 10, 2020 11:05am - 11:15am EST
Virtual

11:15am EST

Advancing Cyber Operator Tradecraft through Automated Static Binary Analysis: Program Reachability for Vulnerability and Malware Analysis
This presentation period comprises
  • Framing (Mr. Cory Cohen)
  • Research on program reachability for vulnerability and malware analysis (Mr. Cohen)
  • Research on recovering meaningful variable names in decompiled code (Dr. Edward Schwartz)
  • Research on recent improvements in object-oriented construct recovery using OOAnalyzer (Mr. Cohen and Dr. Schwartz)
  • Live Q&A with the presenters (host: Mr. Jeffrey Gennari)

Speakers
avatar for Dr. Edward Schwartz

Dr. Edward Schwartz

MTS - Senior Researcher, CMU SEI
Learn more about Edward through his writings at https://resources.sei.cmu.edu/library/author.cfm?authorid=446609. Contact Edward via https://www.sei.cmu.edu/contact-us/index.cfm?f=Edward&l=Schwartz
avatar for Mr. Cory Cohen

Mr. Cory Cohen

MTS - Principal Researcher, CMU SEI


Tuesday November 10, 2020 11:15am - 12:15pm EST
Virtual

12:15pm EST

Break
Tuesday November 10, 2020 12:15pm - 12:30pm EST
Virtual

12:30pm EST

Framing: Combining Automated Code Repair for Memory Safety and Static Code Analysis Systems
Framing of two related projects


Speakers
avatar for Mr. Robert Schiela

Mr. Robert Schiela

Technical Manager, Cyber Security Foundations, CMU SEI
Robert is a Technical Manager, leading the Secure Coding group, in the Cyber Security Foundations directorate of CERT and the SEI. In this role, he helps the Secure Coding team define and execute research and transition knowledge that improves the state of the art and practice in... Read More →


Tuesday November 10, 2020 12:30pm - 12:35pm EST
Virtual

12:35pm EST

Automated Code Repair for Memory Safety
Speakers
avatar for Dr. Will Klieber

Dr. Will Klieber

Software Security Engineer, CMU SEI
Learn more about Will at https://insights.sei.cmu.edu/author/will-klieber/. Contact him via https://www.sei.cmu.edu/contact-us/index.cfm?f=Will&l=Klieber


Tuesday November 10, 2020 12:35pm - 12:55pm EST
Virtual

12:55pm EST

Static Code Analysis Classification

Tuesday November 10, 2020 12:55pm - 1:15pm EST
Virtual

1:15pm EST

Combining Automated Code Repair for Memory Safety and Static Code Analysis Systems
Mr. Schiela moderates a live Q&A session with Dr. Flynn and Dr. Klieber.


Tuesday November 10, 2020 1:15pm - 1:20pm EST
Virtual

1:20pm EST

Q&A: Combining Automated Code Repair for Memory Safety and Static Code Analysis Systems
Speakers
avatar for Dr. Will Klieber

Dr. Will Klieber

Software Security Engineer, CMU SEI
Learn more about Will at https://insights.sei.cmu.edu/author/will-klieber/. Contact him via https://www.sei.cmu.edu/contact-us/index.cfm?f=Will&l=Klieber
avatar for Mr. Robert Schiela

Mr. Robert Schiela

Technical Manager, Cyber Security Foundations, CMU SEI
Robert is a Technical Manager, leading the Secure Coding group, in the Cyber Security Foundations directorate of CERT and the SEI. In this role, he helps the Secure Coding team define and execute research and transition knowledge that improves the state of the art and practice in... Read More →


Tuesday November 10, 2020 1:20pm - 1:30pm EST
Virtual

1:30pm EST

Break
Tuesday November 10, 2020 1:30pm - 1:35pm EST
Virtual

1:35pm EST

Framing: Implementing Cyber Security



Speakers
avatar for Mr. Roman Danyliw

Mr. Roman Danyliw

Deputy CTO, CMU SEI
Roman Danyliw is the Deputy Chief Technology Officer of the Carnegie Mellon University Software Engineering Institute.  He is currently serving as an IETF Security Area Director.


Tuesday November 10, 2020 1:35pm - 1:40pm EST
Virtual

1:40pm EST

Implementing Cyber Security in DoD Supply Chains
Dr. Claycomb, as panel moderator, will lead the discussion among Mr. Bradley, Dr. Woody, Dr. Sherman, Dr. Mai, and Mr. Butkovic.Mr. Costa will monitor viewer questions shared in the chat for the panel moderator.


Moderators
avatar for Dr. William Claycomb

Dr. William Claycomb

Principal Member of the Technical Staff, CMU SEI

Speakers
avatar for Mr. Joe Bradley

Mr. Joe Bradley

Director of the Cyber Resiliency Office for Weapon Systems and the Director of Engineering & Technical Management, Air Force Life Cycle Management Center
Joseph F. Bradley, a member of the Senior Executive Service, is the Director of the Cyber Resiliency Office for Weapon Systems and the Director of Engineering and Technical Management for the Air Force Life Cycle Management Center at Hanscom Air Force Base, Massachusetts.Mr. Bradley... Read More →
avatar for Mr. Dan Costa

Mr. Dan Costa

Technical manager, Enterprise Threat and Vulnerability Management, CMU SEI
avatar for Mr. Matthew Butkovic

Mr. Matthew Butkovic

Technical Director, Risk and Resilience, CMU SEI
Read Matt's article "Organizations Must Reset Expectations to Spring Back from Pandemic" at https://www.sei.cmu.edu/news-events/news/article.cfm?assetid=642363... Read More →
avatar for Dr. Mark Sherman

Dr. Mark Sherman

Technical Director, Cyber Security Foundations, CMU SEI
Contact Mark at https://www.sei.cmu.edu/contact-us/index.cfm?f=Mark&l=Sherman
avatar for Dr. Carol Woody

Dr. Carol Woody

Principal Researcher, CMU SEI
Read Carol's blog "Selecting Measurement Data for Software Assurance Practices" at https://insights.sei.cmu.edu/sei_blog/2019/07/selecting-measurement-data-for-software-assurance-practices.html. Contact Carol at https://www.sei.cmu.edu/contact-us/index.cfm?f=Carol&l=Woody
avatar for Dr. Kenneth Mai

Dr. Kenneth Mai

Principal Systems Scientist, Electrical and Computer Engineering, CMU
Ken Mai received his B.S., M.S., and Ph.D. degrees in electrical engineering from Stanford University. He is currently a Principal Systems Scientist in the Electrical and Computer Engineering Department at Carnegie Mellon University. His research interests are in high-performance... Read More →


Tuesday November 10, 2020 1:40pm - 2:40pm EST
Virtual

2:40pm EST

Break
Tuesday November 10, 2020 2:40pm - 2:45pm EST
Virtual

2:45pm EST

Toward the Use of Human-Machine Teaming and Fully Autonomous Operations
CMU SEI R&D is working toward the use of human-machine teaming and fully autonomous operations to enable the  DoD to identify adversary activity; respond at the cost, speed and scale required; and operate missions with increased certainty.

Speakers
avatar for Mr. Jeffrey Mattson

Mr. Jeffrey Mattson

Deputy Technical Director, CMU SEI
Contact Jeffrey at https://www.sei.cmu.edu/contact-us/index.cfm?f=Jeffrey&l=Mattson


Tuesday November 10, 2020 2:45pm - 3:10pm EST
Virtual

3:10pm EST

AIDE: Artificial Intelligence Defense Evaluation
Speakers
avatar for Dr. Grant Deffenbaugh

Dr. Grant Deffenbaugh

Senior Security Researcher, CMU SEI
Contact Dr. Deffenbaugh through our website at https://www.sei.cmu.edu/contact-us/index.cfm?f=Grant&l=Deffenbaugh.
avatar for Dr. Shing-hon Lau

Dr. Shing-hon Lau

Senior Cybersecurity Researcher, CMU SEI
Read Dr. Lau's blog on Measuring Resilience in Artificial Intelligence and Machine Learning Systems. Contact him through the SEI website at https://www.sei.cmu.edu/contact-us... Read More →


Tuesday November 10, 2020 3:10pm - 3:25pm EST
Virtual

3:25pm EST

About the President's Cup Competition
Established in response to Executive Order 13870, the President’s Cup Cybersecurity Competition is a national cyber competition aiming to identify, recognize, and reward the best cybersecurity talent in the federal executive workforce. Hosting challenges from across the National Initiative for Cybersecurity Education (NICE) Cybersecurity Framework, competitors will face a diverse array of challenges and will require an extensive skill set to succeed.

Speakers
avatar for Mr. Matt Kaar

Mr. Matt Kaar

Cyber Security Exercise Developer & Trainer, CMU SEI


Tuesday November 10, 2020 3:25pm - 3:45pm EST
Virtual

3:45pm EST

Bringing it all Together
Dr. Longstaff will blend the research discussions of the session and introduce the poster presentations

Speakers
avatar for Dr. Thomas Longstaff

Dr. Thomas Longstaff

CTO, CMU SEI
Read Tom's recent blog "What Engineers Need to Know about Artificial Intellilgence" at https://insights.sei.cmu.edu/sei_blog/2019/09/what-engineers-need-to-know-about-artificial-intelligence.html. Contact Tom via https://www.sei.cmu.edu/contact-us/index.cfm?f=Thomas&l=LongstaffTom Longstaff is Chief Technology Officer of the SEI. As CTO, Longstaff is responsible for formulating a technical strategy and leading the funded research program of the institute based on current and predicted future trends in technology, government, and industry.Before joining the SEI as CTO in 2018, Longstaff was a program manager and principal cybersecurity strategist for th... Read More →


Tuesday November 10, 2020 3:45pm - 3:55pm EST
Virtual

3:55pm EST

Closing
Video closing of the day

Tuesday November 10, 2020 3:55pm - 4:00pm EST
Virtual
 
Thursday, November 12
 

11:00am EST

Welcome
Speakers
avatar for Dr. Thomas Longstaff

Dr. Thomas Longstaff

CTO, CMU SEI
Read Tom's recent blog "What Engineers Need to Know about Artificial Intellilgence" at https://insights.sei.cmu.edu/sei_blog/2019/09/what-engineers-need-to-know-about-artificial-intelligence.html. Contact Tom via https://www.sei.cmu.edu/contact-us/index.cfm?f=Thomas&l=LongstaffTom Longstaff is Chief Technology Officer of the SEI. As CTO, Longstaff is responsible for formulating a technical strategy and leading the funded research program of the institute based on current and predicted future trends in technology, government, and industry.Before joining the SEI as CTO in 2018, Longstaff was a program manager and principal cybersecurity strategist for th... Read More →


Thursday November 12, 2020 11:00am - 11:05am EST
Virtual

11:05am EST

Enabling DoD to Produce Systems that are Agile and Responsive to its Missions
Speakers
avatar for Dr. Jeff Boleng

Dr. Jeff Boleng

Senior Advisor for Software Acquisition/Senior Software Advisor, Director's Office, ISD(A&S)/CMU SEI
Watch Jeff's discussion with SEI CTO Tom Longstaff "A Discussion of DoD Software Advances and What's Next from SEI" at https://www.sei.cmu.edu/news-events/events/event.cfm?customel_datapageid_5541=207242


Thursday November 12, 2020 11:05am - 11:25am EST
Virtual

11:25am EST

Break
Thursday November 12, 2020 11:25am - 11:30am EST
Virtual

11:30am EST

Software Engineering’s Grand Challenges: Voices from Visionaries
How will software engineering enable our future vision? In this showcase, experts from industry and government will discuss major open problems and grand challenges in software engineering. Each participant will talk about software engineering’s “grand challenges” as they relate to their field of work, including space exploration, supercomputing, AI, and future battle systems.

Mr. Robert will moderate the flow of questions shared in the chat during the panel's discussion.

Moderators
avatar for Ms. Anita Carleton

Ms. Anita Carleton

Director, Software Solutions Division, CMU SEI
Anita Carleton is an Executive Leadership Team Member and Division Director of the Software Solutions Division (SSD) at the Software Engineering Institute (SEI), Carnegie Mellon University, where she has more than 30 years of technical and senior leadership experience in the software... Read More →

Speakers
avatar for Mr. Tim Dare

Mr. Tim Dare

Deputy Director for Prototyping and Software; Lead of National Defense Authorization Act Section 255, Under Secretary of Defense for Research and Engineering
Mr. Timothy S. Dare is the Deputy Director for Prototyping and Software (DD(P&S)). As the DD(P&S), Mr. Dare is the senior DDRE(AC) official responsible for prototyping and manages DDRE(AC)’s annual $400+M prototyping portfolio. In support of USD(R&E)’s mission to develop capability... Read More →
avatar for Dr. J. Michael McQuade

Dr. J. Michael McQuade

Vice President for Research, CMU
J. Michael McQuade is Carnegie Mellon University's vice president for research, providing leadership for the university's research enterprise and advocating for the role that science, technology and innovation play nationally and globally.From 2006 to 2018 he served as senior vice... Read More →
avatar for Dr. Deborah Frincke

Dr. Deborah Frincke

Associate Laboratory Director for National Security Sciences, Oak Ridge National Laboratory
Dr. Deborah Frincke, the Associate Laboratory Director for National Security Sciences at Oak Ridge National Laboratory, guides the research and development of science-based solutions to complex threats that put public safety, national defense, energy infrastructure, and the economy... Read More →
avatar for Dr. Vint Cerf

Dr. Vint Cerf

Vice President and Chief Internet Evangelist, Google
Mr. Vinton G. Cerf, Internet Hall of Fame Pioneer, is widely known as a “Father of the Internet,” Cerf is the co-designer of the TCP/IP protocols and the architecture of the Internet. In December 1997, President Bill Clinton presented the U.S. National Medal of Technology to Cerf... Read More →
avatar for Mr. Nand Mulchandani

Mr. Nand Mulchandani

Chief Technology Officer, Joint Artificial Intelligence Center
Mr. Nand Mulchandani serves as the Chief Technology Officer of the U.S. Department of Defense Joint Artificial Intelligence Center. He brings more than 25 years of experience in the technology industry as a serial entrepreneur and senior executive in the enterprise infrastructure... Read More →
avatar for Mr. John Robert

Mr. John Robert

Deputy Director, Software Solutions Division, CMU SEI
avatar for Dr. William Scherlis

Dr. William Scherlis

Director, Information Innovation Office, Defense Advance Research Projects Agency
Dr. William Scherlis assumed the role of office director for DARPA’s Information Innovation Office in September 2019. In this role he leads program managers in the development of programs, technologies, and capabilities to ensure information advantage for the United States and its... Read More →
avatar for Ms. Sara Manning Dawson

Ms. Sara Manning Dawson

General Manager, Microsoft Critical Infrastructure Engineering, Microsoft Corporation
Ms. Sara Manning Dawson is a Partner General Manager at Microsoft, specializing in cloud infrastructure security.  She leads the Critical Infrastructure (CI) Engineering team, working across engineering, industry and government to design and deliver a Microsoft cloud platform and... Read More →


Thursday November 12, 2020 11:30am - 12:35pm EST
Virtual

12:35pm EST

Break
Thursday November 12, 2020 12:35pm - 12:50pm EST
Virtual

12:50pm EST

Framing
Speakers
avatar for Dr. Ipek Ozkaya

Dr. Ipek Ozkaya

Technical Director, Engineering Intelligent Software Systems, CMU SEI
Learn more about Ipek at https://www.linkedin.com/in/ipekozkaya/


Thursday November 12, 2020 12:50pm - 12:55pm EST
Virtual

12:55pm EST

Untangling the Knot: Enabling Rapid Software Evolution
This project introduces automation to a software problem that is largely handled manually in DoD and industry today, restructuring poorly structured software to enable harvesting or replacement of components. The kinds of structural coupling problems addressed by this proposal are pervasive in software and commonly interfere with DoD objectives.

Speakers
avatar for Mr. James Ivers

Mr. James Ivers

Principal Engineer, CMU SEI
Learn more about James at https://resources.sei.cmu.edu/library/author.cfm?authorid=4463. Contact him at https://www.sei.cmu.edu/contact-us/index.cfm?f=James&l=Ivers.


Thursday November 12, 2020 12:55pm - 1:15pm EST
Virtual

1:15pm EST

TwinOps – Digital Twins meet DevOps
At the SEI, we have developed a line of research that improves both the state of the art and the state of practice to design and analyze cyber-physical systems. Through AADL and ACVIP, we address both system and software concerns (safety, security, performance and code generation. Analytical frameworks based on AADL evaluate system integrability prior to the performance of actual integration testing activities. As of today, these do not integrate the physics of the system. In this project, we want to study the interplay between physics models (using Modelica and the FMI standard) and AADL models to improve virtual integration.

Speakers
avatar for Dr. Jerome Hugues

Dr. Jerome Hugues

Senior Architecture Researcher, CMU SEI
Learn more about Jerome at https://www.linkedin.com/public-profile/in/jeromehugues?challengeId=AQF0mR6kGnkb1wAAAXORuR2WB0sYZQ3-WFKv95jOW1lP5qiFR6dOuhhRxIas2yC2XDX90gvhBOspnfH6S-mBIvetKngCpNJGbQ&submissionId=18b5b2d3-4eb2-2516-0436-39a82b3a535f


Thursday November 12, 2020 1:15pm - 1:35pm EST
Virtual

1:35pm EST

Q&A: TwinOps and Untangling the Knot
Dr. Ozkaya will moderate a live Q&A session with Dr. Hugues and Mr. Ivers.

Speakers
avatar for Dr. Ipek Ozkaya

Dr. Ipek Ozkaya

Technical Director, Engineering Intelligent Software Systems, CMU SEI
Learn more about Ipek at https://www.linkedin.com/in/ipekozkaya/
avatar for Dr. Jerome Hugues

Dr. Jerome Hugues

Senior Architecture Researcher, CMU SEI
Learn more about Jerome at https://www.linkedin.com/public-profile/in/jeromehugues?challengeId=AQF0mR6kGnkb1wAAAXORuR2WB0sYZQ3-WFKv95jOW1lP5qiFR6dOuhhRxIas2yC2XDX90gvhBOspnfH6S-mBIvetKngCpNJGbQ&submissionId=18b5b2d3-4eb2-2516-0436-39a82b3a535f
avatar for Mr. James Ivers

Mr. James Ivers

Principal Engineer, CMU SEI
Learn more about James at https://resources.sei.cmu.edu/library/author.cfm?authorid=4463. Contact him at https://www.sei.cmu.edu/contact-us/index.cfm?f=James&l=Ivers.


Thursday November 12, 2020 1:35pm - 1:55pm EST
Virtual

1:55pm EST

Break
Thursday November 12, 2020 1:55pm - 2:00pm EST
Virtual

2:00pm EST

Model Based Engineering with AADL: Transitioning Research to Practice
A discussion of the Architecture Analysis and Design Language, including its history and impact on transition partners. This will encompass R&D in the ongoing Line-funded project for integrating safety and security engineering.


Speakers
avatar for Dr. Sam Procter

Dr. Sam Procter

Senior Architecture Researcher, CMU SEI
Learn more about Sam's blogs at https://insights.sei.cmu.edu/author/sam-procter/. Contact Sam at https://www.sei.cmu.edu/contact-us/index.cfm?f=Sam&l=Procter


Thursday November 12, 2020 2:00pm - 2:25pm EST
Virtual

2:25pm EST

Q&A: Model Based Engineering with AADL: Transitioning Research to Practice
Speakers
avatar for Dr. Ipek Ozkaya

Dr. Ipek Ozkaya

Technical Director, Engineering Intelligent Software Systems, CMU SEI
Learn more about Ipek at https://www.linkedin.com/in/ipekozkaya/
avatar for Dr. Sam Procter

Dr. Sam Procter

Senior Architecture Researcher, CMU SEI
Learn more about Sam's blogs at https://insights.sei.cmu.edu/author/sam-procter/. Contact Sam at https://www.sei.cmu.edu/contact-us/index.cfm?f=Sam&l=Procter
avatar for Dr. Jerome Hugues

Dr. Jerome Hugues

Senior Architecture Researcher, CMU SEI
Learn more about Jerome at https://www.linkedin.com/public-profile/in/jeromehugues?challengeId=AQF0mR6kGnkb1wAAAXORuR2WB0sYZQ3-WFKv95jOW1lP5qiFR6dOuhhRxIas2yC2XDX90gvhBOspnfH6S-mBIvetKngCpNJGbQ&submissionId=18b5b2d3-4eb2-2516-0436-39a82b3a535f


Thursday November 12, 2020 2:25pm - 2:40pm EST
Virtual

2:40pm EST

Bringing it all Together
Dr. Longstaff will blend the research discussions of the session and introduce the poster presentations

Speakers
avatar for Dr. Thomas Longstaff

Dr. Thomas Longstaff

CTO, CMU SEI
Read Tom's recent blog "What Engineers Need to Know about Artificial Intellilgence" at https://insights.sei.cmu.edu/sei_blog/2019/09/what-engineers-need-to-know-about-artificial-intelligence.html. Contact Tom via https://www.sei.cmu.edu/contact-us/index.cfm?f=Thomas&l=LongstaffTom Longstaff is Chief Technology Officer of the SEI. As CTO, Longstaff is responsible for formulating a technical strategy and leading the funded research program of the institute based on current and predicted future trends in technology, government, and industry.Before joining the SEI as CTO in 2018, Longstaff was a program manager and principal cybersecurity strategist for th... Read More →


Thursday November 12, 2020 2:40pm - 2:50pm EST
Virtual

2:55pm EST

Break to Transition to Poster Rooms
Thursday November 12, 2020 2:55pm - 3:00pm EST
Virtual

3:00pm EST

3:00pm EST

Poster: High-Assurance Software-Defined IoT Security
Mr. Sebastian Echeverria
High-Assurance Software-Defined IoT Security

The outcomes for this project are (i) policy abstractions that address the threats identified in each task; (ii) end-to-end prototype, with verified properties, running verified, trusted and untrusted system components; (iii) publications in venues such as NDSS, MilCom, IEEE Security and Privacy, and the USENIX Security Symposium.


Thursday November 12, 2020 3:00pm - 3:30pm EST
Virtual

3:00pm EST

Poster: Investigating the Feasibility of an Integrated Causal Model for Software Cost Control
Dr. Michael Konrad
Investigating the Feasibility of an Integrated Causal Model for Software Cost Control
Estimating and controlling software project costs would benefit from causal knowledge of what drives program costs; however, much of software engineering research reports results from multiple regression, which focuses on correlation rather than causation. For three years (FY18-20), this project investigated the application of causal discovery as an alternative approach to conducting software engineering research, resulting in the identification of direct causes (instead of spurious causes) of program costs, schedule, and quality. This knowledge supports (1) program investments in the enablers of program success and reduction in software vulnerabilities; and (2) corrective and preventive actions on those factors more likely to place a program on track to achieve its objectives.


Speakers
avatar for Dr. William Nichols

Dr. William Nichols

Senior Member of the Technical Staff, CMU SEI
avatar for Dr. Michael Konrad

Dr. Michael Konrad

Principal Researcher, CMU SEI
Read the recent blog "Addressing Open Architecture in Software Cost Estimation" at https://insights.sei.cmu.edu/sei_blog/2020/07/addressing-open-architecture-in-software-cost-estimation.html to learn more about Michael's recent work


Thursday November 12, 2020 3:00pm - 3:30pm EST
Virtual

3:00pm EST

Poster: Multicore Confidence
Dr. Bjorn Andersson
Multicore Confidence

Many DoD systems have all processor cores except one disabled in order to be confident about timing. The objective of this project is to develop a solution to overcome this obstacle. The goal is to achieve a 300% in-crease in the processing capacity that can be used while being confident about timing.

Speakers

Thursday November 12, 2020 3:00pm - 3:30pm EST
Virtual

3:00pm EST

Poster: Rapid Certification of Trust
Dr. Dionisio de Niz
Rapid Certification of Trust

The goal of this project is to reduce the deployment time of Military Cyber-Physical Systems (CPS) by reducing the development and assurance time. We will do this by enabling the use of unverified commodity software components (e.g., open source drone piloting software) guarded by verified enforcers that guarantees that unsafe component behavior is contained.


Speakers
avatar for Dr. Dionisio de Niz

Dr. Dionisio de Niz

Technical Director, Assuring CyberPhysical Systems, CMU SEI
Learn more about Dio's work at https://resources.sei.cmu.edu/library/author.cfm?authorid=3373


Thursday November 12, 2020 3:00pm - 3:30pm EST
Virtual
 
Friday, November 13
 

11:00am EST

Welcome
Speakers
avatar for Dr. Thomas Longstaff

Dr. Thomas Longstaff

CTO, CMU SEI
Read Tom's recent blog "What Engineers Need to Know about Artificial Intellilgence" at https://insights.sei.cmu.edu/sei_blog/2019/09/what-engineers-need-to-know-about-artificial-intelligence.html. Contact Tom via https://www.sei.cmu.edu/contact-us/index.cfm?f=Thomas&l=LongstaffTom Longstaff is Chief Technology Officer of the SEI. As CTO, Longstaff is responsible for formulating a technical strategy and leading the funded research program of the institute based on current and predicted future trends in technology, government, and industry.Before joining the SEI as CTO in 2018, Longstaff was a program manager and principal cybersecurity strategist for th... Read More →


Friday November 13, 2020 11:00am - 11:05am EST
Virtual

11:05am EST

Integrating CI/CD Processes Across the Acquisition Lifecycle
Speakers
avatar for Ms. Eileen Wrubel

Ms. Eileen Wrubel

Technical Director, Transforming Software Acquisition Policy and Practice, CMU SEI


Friday November 13, 2020 11:05am - 11:25am EST
Virtual

11:25am EST

Break
Friday November 13, 2020 11:25am - 11:30am EST
Virtual

11:30am EST

Software Research in Action: Multidisciplinary Work Supporting a Paradigm Shift in DoD Acquisition
Dr. Shull leads work that is enabling the DoD to adopt modern software development practices that will delivery innovative capabilities to the warfighter much sooner than was historically achieved.

Ms. Gates will moderate questions shared in the chat during the panel's discussion.



Moderators
avatar for Dr. Forrest Shull

Dr. Forrest Shull

Lead for Defense Software Acquisition Policy Research, CMU SEI
Forrest Shull is the Lead for Defense Software Acquisition Policy Research at Carnegie Mellon University’s Software Engineering Institute (SEI). His role is to lead work with US government agencies, national labs, industry, and academic institutions to advance the use of empirically... Read More →

Speakers
avatar for Ms . Linda Parker Gates

Ms . Linda Parker Gates

Initiative Lead, Software Acquisition Pathways, CMU SEI
avatar for Mr. Sean Brady

Mr. Sean Brady

Software Acquisition Pathway Lead, USD(A&S)/Acquisition Enablers
avatar for Dr. Amy Henninger

Dr. Amy Henninger

Senior Advisor for Software and Cybersecurity, Director of Operational Test and Evaluation
avatar for Mr. Shane Ficorilli

Mr. Shane Ficorilli

Software Engineer, CMU SEI


Friday November 13, 2020 11:30am - 12:15pm EST
Virtual

12:15pm EST

Break
Friday November 13, 2020 12:15pm - 12:30pm EST
Virtual

12:30pm EST

Framing
Ms. Wrubel provides context for presentations on software design and development in a continuous integration environment.

Speakers
avatar for Ms. Eileen Wrubel

Ms. Eileen Wrubel

Technical Director, Transforming Software Acquisition Policy and Practice, CMU SEI


Friday November 13, 2020 12:30pm - 12:35pm EST
Virtual

12:35pm EST

Rapid Adjudication of Static Analysis Alerts During Continuous Integration
The goal of this project is to improve the state of the art in reducing false positives and integrating SA tools into continuous integration/continuous deployment (CI/CD) processes.


Friday November 13, 2020 12:35pm - 12:55pm EST
Virtual

12:55pm EST

Automated Design Conformance During Continuous Integration
This project will develop machine learning (ML) techniques that reduce the time to detect implementations that do not conform to intended designs (i.e. nonconformances) in systems from months or years to hours. To reduce the time to field capabilities and to lower lifecycle costs.

Speakers
avatar for Dr. Rod Nord

Dr. Rod Nord

Principal Member of the Technical Staff, CMU SEI
Learn more about Rod at https://resources.sei.cmu.edu/library/author.cfm?authorid=4181. Contact Rod at https://www.sei.cmu.edu/contact-us/index.cfm?f=Robert&l=Nord


Friday November 13, 2020 12:55pm - 1:15pm EST
Virtual

1:15pm EST

Q&A Discussion with Researchers in Rapid Adjudication of Static Analysis Alerts and Automated Design Conformance
Mr. Yasar moderates a live Q&A session with Dr. Flynn and Dr. Nord.

Speakers
avatar for Mr. Hasan Yasar

Mr. Hasan Yasar

Technical Director, Continuous Deployment of Capability, CMU SEI
Watch Hasan's recent webinar "Trust, Verify, and Authorize with DevSecOps" at https://www.sei.cmu.edu/news-events/events/event.cfm?customel_datapageid_5541=207075Hasan Yasar is the Technical Director, Continuous Deployment of Capability at Carnegie Mellon University's Software Engineering... Read More →
avatar for Dr. Rod Nord

Dr. Rod Nord

Principal Member of the Technical Staff, CMU SEI
Learn more about Rod at https://resources.sei.cmu.edu/library/author.cfm?authorid=4181. Contact Rod at https://www.sei.cmu.edu/contact-us/index.cfm?f=Robert&l=Nord


Friday November 13, 2020 1:15pm - 1:35pm EST
Virtual

1:35pm EST

Break
Friday November 13, 2020 1:35pm - 1:40pm EST
Virtual

1:40pm EST

Modernization for Rapid Delivery of Enhanced Capability/Reduction of Sustainment Costs
The largest cyberphysical systems that the SEI has Program Work Plans with (F35 and GBSD among others) are facing not just software development challenges but also a myriad of socio-technical challenges in navigating the acquisition eco-system. This panel highlights three aspects of the challenges for modernization and sustainment:
  1. the implications of the move from single product delivery to ongoing capability delivery
  2. the role of modeling throughout the acquisition lifecycle
  3. the effect of Dev*Ops on an ongoing capability delivery mindset


Moderators
avatar for Ms. Suzanne M. Miller

Ms. Suzanne M. Miller

Principal Researcher, CMU SEI

Speakers
avatar for Dr. Kate Gill

Dr. Kate Gill

F-35 Digital Transformation and Software Modernization, F35 Joint Project Office
Dr. Kate Gill, F-35 Digital Transformation and Software Modernization, F-35 Joint Project Office, Washington DC (Seconded from UK Ministry of Defence, Defence Science and Technology Laboratory (Dstl))2020 UK Women in Defence FinalistDr. Gill is seconded to the F35 Joint Project Office... Read More →
avatar for Mr. Stephen Falcone

Mr. Stephen Falcone

Director of Engineering, United States Air Force
Mr. Stephen J. Falcone, a member of the Acquisition Corps, is the Digital Director of Engineering, Air Force Life Cycle Management Center (AFLCMC), Air Force Materiel Command (AFMC), Hanscom Air Force Base, Massachusetts. He is responsible for organizing, training and equipping the... Read More →


Friday November 13, 2020 1:40pm - 2:20pm EST
Virtual

2:20pm EST

Break
Friday November 13, 2020 2:20pm - 2:25pm EST
Virtual

2:25pm EST

CMU SEI Agile Virtual Schoolhouse
The Department of Defense seeks to leverage Agile and DevSecOps principles to meet the urgent need to deliver capability at the speed of relevance. We will discuss our recent experience deploying a virtual training channel to provide best-of-breed resources and CMU SEI research in a flexible online format for remote team education.

Following the recorded presentation, Ms. Nolan will moderate a live Q&A discussion, using questions shared by viewers in the chat, with Ms. Miller and Mr. Hayes.

Speakers
avatar for Mr. Will  Hayes

Mr. Will Hayes

Principal Member of the Technical Staff, CMU SEI
avatar for Ms. Suzanne M. Miller

Ms. Suzanne M. Miller

Principal Researcher, CMU SEI


Friday November 13, 2020 2:25pm - 3:05pm EST
Virtual

3:05pm EST

Break
Friday November 13, 2020 3:05pm - 3:10pm EST
Virtual

3:10pm EST

Bringing it all Together
Dr. Longstaff will blend the research discussions of the session and introduce the poster presentations

Speakers
avatar for Dr. Thomas Longstaff

Dr. Thomas Longstaff

CTO, CMU SEI
Read Tom's recent blog "What Engineers Need to Know about Artificial Intellilgence" at https://insights.sei.cmu.edu/sei_blog/2019/09/what-engineers-need-to-know-about-artificial-intelligence.html. Contact Tom via https://www.sei.cmu.edu/contact-us/index.cfm?f=Thomas&l=LongstaffTom Longstaff is Chief Technology Officer of the SEI. As CTO, Longstaff is responsible for formulating a technical strategy and leading the funded research program of the institute based on current and predicted future trends in technology, government, and industry.Before joining the SEI as CTO in 2018, Longstaff was a program manager and principal cybersecurity strategist for th... Read More →


Friday November 13, 2020 3:10pm - 3:20pm EST
Virtual