DoD HPC Modernization Program
Better Cost, Quality, Schedules, and Planning through Defense Supercomputing
Dr. Roy Campbell March 2023 Distribution A. Approved for Public Release; distribution is unlimited.
Functional Overview Input
DoD HPCMP
ROI ~ 6x-10x
Defense Challenges
Verified/Validated Application Software for Supercomputers
New Capabilities
Improved Quality
Defense Scientists/Engineers
20+ Supercomputers and Storage
Reduced Schedule
Avoided Cost
Defense Data
Secure Global Defense Research Network
Reduced Risk
$9 Billion Supercomputing Investment Over 30 Years Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-2
Air Force Supercomputing Initiatives Interactome Sciences in Genomic High Throughput Studies
GOTCHA Monitoring System
Examination of physical interactions among molecules via machine learning on HPC systems; accelerates successful drug treatment programs and CBR threat analysis
Transformation of synthetic aperture radar ground images (observed from a single UAV) into 3-D holograms via real-time computation using a combination of onboard and ground-based processing
Improved Methodologies for Fighter Aircraft Stability and Control
Hypersonics Evaluation of aerodynamic structures, advanced combustion, durable/resilient materials, and precise maneuverability for both glide-boost and air-breathing vehicles traveling above Mach 5; reduces frequency and cost of expensive live experiments
Target Recognition and Adaptation in Contested Environments Generation of synthetic data based on known signatures to understand possible intentional permutations; development of detection methods via deep learning on HPC systems
Simulation of aircraft maneuvers in lieu of live experiments; support for modeling and simulation research at the United States Air Force Academy (USAFA)
Counter-electronics High Power Microwave Advanced Missile Project (CHAMP) Development of directed energy strikes from small UAVs; challenging design due to space, weight, and power limitations
Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-3
Army Supercomputing Initiatives Explosive Reactive Armor
Terminal Ballistics for Lethality and Protection Evaluation of armor and anti-armor technologies to improve the effectiveness of weapons and defenses (e.g., ceramic, composite, and electromagnetic armor)
Advanced Methods for Weapons Effects M&S Electromagnetic Armor
Development, verification, and validation of blast modeling codes for hull analysis
Gray Eagle Flight Performance
Rapid Data Analysis for Army C4 Systems
Prediction of flight performance (e.g., climb, cruise, descent) for an important Army UAV
Rapid analysis of network integration evaluation (NIE) field data; 12x reduction in analysis time, improving event fidelity and reducing test duration
Design and Analysis of NextGeneration Rotorcraft Systems Aerodynamic and aeromechanic assessment of vehicles in Joint Multirole Technology Demonstrator (JMR-TD) Program; supports wind tunnel testing and proposal evaluation
Ground Vehicle Acquisition Trade-space assessment based on advanced mobility, transportability, payload, and sustainability concepts for the Joint Light Tactical Vehicle (JLTV)
Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-4
Navy Supercomputing Initiatives COAMPS Tropical Cyclone
Pacific Missile Range Facility
Accurate tropical storm forecasting; better sortie decisions; avoidance of damaging winds/seas
Rapid, accurate range safety analysis; cost avoidance of ~$500K per antiballistic missile test
V-22 Osprey PMA 275
Advanced Arresting Gear (AAG)
Analysis of engine exhaust airflow path; enhanced durability of exhaust nozzle components and reduction in operational costs
Columbia Class Submarine Trade-space analysis and design assessment for new class of ballistic missile submarines
Structural validation and life-cycle analysis of fighter jet stopping mechanisms for Ford class carriers
T-45 Goshawk Trainer Virtual evaluation of proposed air inlet modification to reduce the number of unsafe flight tests
Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-5
Future Supercomputing Initiatives Space Defense
Digital Engineering
Advanced Scenario Analysis
Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-6
Advanced Scenario Analysis Hypothesis Testing Example
Art of War (Sun Tzu) If you know the enemy and know yourself, you need not fear the results of a hundred battles.
Oracle of Delphi Ancient Greece Consulted by kings, queens, generals Provided advice on a broad set of topics including military campaign outcomes
Delphic Maxims Know thyself Nothing to excess Surety brings ruin
Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-7
Supercomputing Problem Space Not Exhaustive
Technical Issue Resolution
Compute-Intensive
High-End, Physics-Based Calculations
Advanced Scenario Planning Trade Space Analysis
Digital Engineering
Life-cycle Management
Basic Computing and Basic Data Analysis
Scenario Planning
Machine and Deep Learning Graph Analysis Big Data Analysis
Data-Intensive Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-8
Supercomputing Definition Compute-Intensive
Data-Intensive
Difficult
Easy
Difficult
Easy
Tightly-coupled
Embarrassingly parallel
10s to 1000s of accelerators
Few accelerators
10s to 1000s of information feeds
Few information feeds
100s to 1000s of nodes in lock-step
independent task / node
Fast / low-latency network
Slow / high-latency network
Fast / large memory and storage
Slow / small memory and storage
Large graphs
Small graphs
Large data sets
Small data sets
High Performance Computing
Basic Computing
High Performance Data Analysis
Basic Data Analysis
Supercomputing
=
High Performance Computing (HPC)
+
High Performance Data Analysis (HPDA)
Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-9
HPCMP Supercomputing Assets Relative to Department of Energy (DOE) Exemplar Attribute Peak Capability Supercomputers Undepreciated Valuation Nodes CPU Cores GPUs Memory Storage Power Consumption
HPCMP (FY23) 107 PF 20 $274 million 20 thousand 1.6 million 2.8 thousand 5 PiB 273 PB 18 MW
Summit (#5 - Top500) 201 PF 1 $200 million 5 thousand 0.2 million 28 thousand 10 PiB 250 PB 10 MW
Notable Divergence P P P P P P P
HPCMP invests in a variety of architectures to satisfy a wide array of use cases – Mapping the right architecture to the right use case – Generally favoring CPUs over GPUs, since the efficient use of a GPU requires high spatial or temporal data locality
HPCMP considers the total cost of research (including software refactoring costs) rather than solely focusing on performance Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-10
Distribution A. Approved for Public Release; distribution is unlimited.
Defense Supercomputing Page-11