Assurance of AI Enabled Systems

[info_list style=”hexagon” icon_bg_color=”#002d72″ icon_color=”#ffffff” font_size_icon=”12″ eg_br_width=”1″ connector_color=”#002d72″][info_list_item list_title=”Describe the novel challenges introduced by AI, including machine learning (ML), in autonomous systems.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Describe the 6-D framework for creating an AI-enabled system, navigate AI technology solutions with an end-to-end engineering perspective, and explain how convolutional neural networks (CNNs) relate to the AI renaissance.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Summarize the basic math behind CNNs, compare CNNs to how the human brain works, and distinguish fact and fiction in CNN applications.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Identify the dimensions of complexity for autonomous systems, explain the role and requirements of simulations in autonomy development and testing, and identify the major architectural components of a modular autonomous system.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Describe a cyber-physical system; explain safety concerns related to AI-enabled cyber-physical systems; identify mitigations for addressing key classes of challenges and vulnerabilities.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Describe the challenges of confidence estimation for deep learning models and explain current approaches for dealing with problems of uncertainty and domain shift.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Identify metrics for performance, quality, reliability, safety for AI-enabled systems.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Test and Evaluation / Verification and Validation (TEVV) tools and methodologies for AI-enabled systems.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Identify challenges verification and validation on autonomous systems that perform control/planning tasks; describe approaches to formal verification of AI controllers; describe approaches safe design and fallback control architectures.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Describe the UL4600 standard and how it relates to MIL STD 882; lessons learned from R&D work in the industry.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Define the concept of explainable AI; explain how AI systems can be made more user-friendly; identify ways that failure modes can be made easier to understand.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”List the essential elements of teamwork and describe how they might apply to AI-enabled and autonomous systems; explain how humans can interact safely and effectively with autonomous systems.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Describe strategies for human supervision of AI-enabled and autonomous systems; explain the overarching frameworks that apply to the governance of AI-enabled systems; Identify influence of human-systems interaction on assurance and trust.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Identify legal, policy, and ethical issues related to AI-enabled systems; list challenges of interpreting policy and ethical concepts for technology development.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Review case studies of testing and evaluating AI-enabled systems to identify lessons learned and potential pitfalls. Establish mock reviews of nominal AI-enabled systems to demonstrate application of learned tools to relevant challenges.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][info_list_item list_title=”Identify key considerations for deploying autonomous systems in the real world.” heading_tag=”p” list_icon=”Defaults-check”][/info_list_item][/info_list]