Example - Determining Technical Performance Measures for Multirole Aircraft.

1. Example - Determining TechnicalPerformance Measures for Multirole Aircraft.

2. Sample Multi-Role Aircraft Requirements Warfare Objectives to Be Achieved Top-Level Multi-Role Aircraft Requirements Identification Massive Firepower In-Theater “At a Pace and in Numbers Sufficient to Field an Over-Whelming Force” 1. In-theatre Sortie Generation 2. Supportable 3. Kill Armored Vehicles 4. Destroy Critical Chokepoints 5. Destroy Enemy Aircraft in Air and on Ground 6. Destroy Enemy Air Defenses 7. Reconstitutable Direct Support of the Ground Campaign “Slow the Enemy’s Offensive Temp until Friendly Ground Forces Can Mass and Counter the Advance” Establish Air Superiority “Denying the Enemy Use of His Airpower and Defenses” Reconstitution “The ability to Reconstitute a Credible Defense Faster Than Any Potential Opponent Can Generate an Over-Whelming Offense”

3. Technical Performance Measuresthat Impact In-Theater Sortie Generation • Airlift Loads/Squadron • Airlift Lbs/Squadron • Vulnerable Area • 24 Hour Repairability • Lbs of Expendables Per Sortie Aircraft Available In-Theater • Taxi Speed • Shelter Park Time • Alert Time • Integrated Combat Turn Time • Mission Initialization Time • Break Rate • Ground Abort Rate • Fix Rate • Mean Repair Time Sorties Per Day Per Aircraft Available

4. Technical Performance Measuresthat Impact Supportability Maintenance Personnel • Maintenance Manhours Per Flight Hour • Average Skill Level Required • Number of Special Skills Required • Break Rate • Maintenance Manhours Per Flight Hour • Flyaway Cost • Mean Fuel Consumption Per Flight Hour • System Weights Cost of Consumables • Break Rate • Maintenance Manhours Per Flight Hour • System Weights Depot Maintenance Cost

5. Technical Performance Measures thatImpact Armored Vehicles Killed • Takeoff Distance • Landing Distance • Takeoff Ground Roll • Landing Ground Roll • Airlift Loads/Squadron • Airlift Lbs/Squadron • 24 Hour Repairability • Lbs of Expendables Per Sortie • Taxi Speed • Shelter Park Time • Alert Time • Integrated Combat Turn Time • Mission Initialization Time • Break Rate • Ground Abort Rate • Fix Rate • Mean Repair Time In-Theater Sortie Generation Targets Acquired Per Sortie • Range • Loiter Time • Max Detection Range • Max Recognition Range • Navigation System Error • Nite/Wx Capability

6. Technical Performance MeasuresImpact Armored Vehicles Killed • Deliverable Weapon CEP • Max Number of Air-to-Ground Weapons • Type/Mix of Air-to-Ground Weapons • Targeting Azimuth Limits • Targeting Elevation Limits Targets Destroyed Per Attack • Instantaneous Gs At Combat Conditions • Sustained Gs At Combat conditions • Mil Power Penetration Speed • Ps At Combat Conditions • Acceleration Times at Combat Weight • Time to Bank 90 degrees • Instantaneous Turn Rate • RCS • IR Signature • Visual Signature • Vulnerable Area • Standoff • Threat Sort/Identification Time Aircraft Lost Per Sortie

7. Technical Performance Measures that Impact Vehicle Flow Rate Reduction in Critical Choke Points • Takeoff Distance • Landing Distance • Takeoff Ground Roll • Landing Ground Roll • Airlift Loads/Squadron • Airlift Lbs/Squadron • 24 Hour Repairability • Lbs of Expendables Per Sortie • Taxi Speed • Shelter Park Time • Alert Time • Integrated Combat Turn Time • Mission Initialization Time • Break Rate • Ground Abort Rate • Fix Rate • Mean Repair Time In-Theater Sortie Generation Targets Acquired Per Sortie • Range • Loiter Time • Max Detection Range • Max Recognition Range • Navigation System Error • Nite/Wx Capability

8. Technical Performance Measures that Impact Vehicle Flow Rate Reduction in Critical Choke Points (cont.) • Deliverable Weapon CEP • Max Number of Air-to-Ground Weapons • Type/Mix of Air-to-Ground Weapons • Targeting Azimuth Limits • Targeting Elevation Limits Targets Destroyed Per Attack • Instantaneous Gs At Combat Conditions • Sustained Gs At Combat conditions • Mil Power Penetration Speed • Ps At Combat Conditions • Acceleration Times at Combat Weight • Time to Bank 90 degrees • Instantaneous Turn Rate • RCS • IR Signature • Visual Signature • Vulnerable Area • Standoff • Threat Sort/Identification Time Aircraft Lost Per Sortie

9. Technical Performance Measures that Impact Destruction of Enemy Aircraft in the Air • Takeoff Distance • Landing Distance • Takeoff Ground Roll • Landing Ground Roll • Airlift Loads/Squadron • Airlift Lbs/Squadron • 24 Hour Repairability • Lbs of Expendables Per Sortie • Taxi Speed • Shelter Park Time • Alert Time • Integrated Combat Turn Time • Mission Initialization Time • Break Rate • Ground Abort Rate • Fix Rate • Mean Repair Time In-Theater Sortie Generation Destroy Enemy Aircraft in Air and on Ground Targets Acquired Per Sortie • Range • Loiter Time • Max Detection Range • Max Recognition Range • Navigation System Error • Nite/Wx Capability

10. Technical Performance Measures that Impact Destruction of Enemy Aircraft in the Air (cont.) • Deliverable Weapon CEP • Max Number of Air-to-Ground Weapons • Type/Mix of Air-to-Ground Weapons • Targeting Azimuth Limits • Targeting Elevation Limits Targets Destroyed Per Attack • Instantaneous Gs At Combat Conditions • Sustained Gs At Combat conditions • Mil Power Penetration Speed • Ps At Combat Conditions • Acceleration Times at Combat Weight • Time to Bank 90 degrees • Instantaneous Turn Rate • RCS • IR Signature • Visual Signature • Vulnerable Area • Standoff • Threat Sort/Identification Time Aircraft Lost Per Sortie

11. Technical Performance Measures that Impact Aircraft Destroyed on the Ground • Takeoff Distance • Landing Distance • Takeoff Ground Roll • Landing Ground Roll • Airlift Loads/Squadron • Airlift Lbs/Squadron • 24 Hour Repairability • Lbs of Expendables Per Sortie • Taxi Speed • Shelter Park Time • Alert Time • Integrated Combat Turn Time • Mission Initialization Time • Break Rate • Ground Abort Rate • Fix Rate • Mean Repair Time In-Theater Sortie Generation Targets Acquired Per Sortie • Range • Loiter Time • Max Detection Range • Max Recognition Range • Navigation System Error • Nite/Wx Capability

12. Technical Performance Measures that Impact Aircraft Destroyed on the Ground • Deliverable Weapon CEP • Max Number of Air-to-Ground Weapons • Type/Mix of Air-to-Ground Weapons • Targeting Azimuth Limits • Targeting Elevation Limits Targets Destroyed Per Attack • Instantaneous Gs At Combat Conditions • Sustained Gs At Combat conditions • Mil Power Penetration Speed • Ps At Combat Conditions • Acceleration Times at Combat Weight • Time to Bank 90 degrees • Instantaneous Turn Rate • RCS • IR Signature • Visual Signature • Vulnerable Area • Standoff • Threat Sort/Identification Time Aircraft Lost Per Sortie

13. Technical Performance Measuresthat Impact Air Defenses Operating • Takeoff Distance • Landing Distance • Takeoff Ground Roll • Landing Ground Roll • Airlift Loads/Squadron • Airlift Lbs/Squadron • 24 Hour Repairability • Lbs of Expendables Per Sortie • Taxi Speed • Shelter Park Time • Alert Time • Integrated Combat Turn Time • Mission Initialization Time • Break Rate • Ground Abort Rate • Fix Rate • Mean Repair Time In-Theater Sortie Generation Targets Acquired Per Sortie • Range • Loiter Time • Max Detection Range • Max Recognition Range • Navigation System Error • Nite/Wx Capability

14. Technical Performance Measures that Impact Air Defenses Operating • Deliverable Weapon CEP • Max Number of Air-to-Ground Weapons • Type/Mix of Air-to-Ground Weapons • Targeting Azimuth Limits • Targeting Elevation Limits Targets Destroyed Per Attack • Instantaneous Gs At Combat Conditions • Sustained Gs At Combat conditions • Mil Power Penetration Speed • Ps At Combat Conditions • Acceleration Times at Combat Weight • Time to Bank 90 degrees • Instantaneous Turn Rate • RCS • IR Signature • Visual Signature • Vulnerable Area • Standoff • Threat Sort/Identification Time Aircraft Lost Per Sortie

15. Technical Performance MeasuresImpact Time To Reconstitute Force Cost of Reconstitution • Weapon System Unit Cost • Mean Cost to Remanufacture • Long-Lead Time • Time to Manufacture/Assemble • Interchangeability • Mean Time to Remanufacture • Service Life Manufacturing Time

16. Multi-Role Aircraft System LevelTechnical Performance Measure List • Takeoff Distance • Landing Distance • Takeoff Ground Roll • Landing Ground Roll • Airlift Loads/Squadron • Airlift Lbs/Squadron • 24 Hour Repairability • Lbs of Expendables Per Sortie • Taxi Speed • Shelter Park Time • Alert Time • Integrated Combat Turn Time • Mission Initialization Time • Break Rate • Ground Abort Rate • Fix Rate • Mean Repair Time • Range • Loiter Time • Max Detection Range • Max Recognition Range • Navigation System Error • Nite/Wx Capability • Deliverable Weapon CEP • Max Number of Air-to-Ground Weapons • Type/Mix of Air-to-Ground Weapons • Targeting Azimuth Limits • Targeting Elevation Limits • RCS • IR Signature • Visual Signature • Vulnerable Area • Standoff • Threat Sort/Identification Time

17. Multi-Role Aircraft System LevelTechnical Performance Measure List • Instantaneous Gs At Combat Conditions • Sustained Gs At Combat conditions • Mil Power Penetration Speed • Ps At Combat Conditions • Acceleration Times at Combat Weight • Time to Bank 90 degrees • Instantaneous Turn Rate • Maintenance Manhours Per Flight Hour • Average Skill Level Required • Number of Special Skills Required • Mean Fuel Consumption Per Flight Hour • Flyaway cost • System Weights • Weapon System Unit Cost • Mean Cost to Remanufacture • Long-Lead Time • Time to Manufacture/Assemble • Interchangeability • Mean Time to Remanufacture • Service Life

18. Requirements Handoff - Capturing New Business

19. Requirements Handoff For Contract Work BV41791

20. Sample TPM Warning and ActionThresholds Action Threshold System Weight Warning Threshold x x x x x x Requirement Milestones TIME Requirement x x x x System Range x x Warning Threshold Action Threshold x - Predicted Value Milestones

21. Requirements Tracking

22. Function Decomposition is Taken to aLevel Sufficient to Drive System Synthesis • System Synthesis • System Concept • Architecture • Conf. Item Def. • Phy. Interfaces • Alternative Solutions Functional Decomposition (System Functions {development, operations, etc} to Segments to Individual Functions) F1, F2, F3... • Systems Analysis • & Control • Trade-Offs • Effect Analyses • Life Cycle Cost • Risk Management • TPMs • Technical Reviews • Documentation Data Base • Decision Support Data • System Architecture • System Specification

23. Example Functional Decomposition Primary Functions Development Manufacturing Verification Deployment Operations Support Training Disposal Cruise/ Ingress Loiter Climb Commit/ Engage Wpn Del Egress Pre-flight Taxi Takeoff Escort RTB CAP Post-Fit Each Individual Function Must Be Assigned An Owner

24. Functional Requirements are Owned by IPD Teams Operations Functions Avionics IPD Team Pre- Flight Commit/ Engage Post- Flight • Constraints: • Cost Analysis/Allocation • Weight Analysis/ Allocation • Rel. & Main Analysis • Other ... ... F1 - Search F2 - Detect F3 - Identify F4 - Designate F5 - Track

25. Requirements Should Be BaselinedBut Plan For Change Requirements will Change, but Baselines put You in Control. • Requirements Baselines: • Insure a Common Understanding Within the Development Group of the “Current” Set of Requirements (What’s In, What’s Not) • Provide a Basis for Evaluating the Effects and Impacts of Proposed Changes • Allows Grouping Changes in Blocks to Minimize Rework Always Include Changes in Budget and Schedule Planning.

26. Baselines are Needed for Each Product Release 1st Capability 2nd Capability 3rd Capability

27. Requirements Characteristics • Unambiguous - Every Requirement Has Only One Interpretation • Complete - Includes All Significant Requirements, Functions, Behaviors, Performance, Constraints, and Interfaces • Verifiable - Cost-Effective Means Exists for People or Machines to Check Product Against Requirements • Consistent - Requirements Not in Conflict • Modifiable - Requirements Are Easy to Change Completely and Consistently • Correct - No Errors Exist That Will Affect Design • Traceable - Origin of Requirement is Clear • Design Free - Design Is Left to the Designer

28. Software Requirement Issues Issues Attributes Performance Constraints Usability Interfaces Reliability Supportability Bits Processed, Speed, Response Time Standards, Data Format, Language Ease of Use, Consistency, Ease of Training, Input Preparation, Output Interpretation Software, Hardware, People Frequency of Failure, Severity of Failure, Recovery From Failure Ease of Upgrade, Ease of Repair, Instability, Expandability, Testability, Flexibility, Portability

29. Example of Design-Dependent andDesign-Free Requirement • Design-Dependent: The Flight Control System Shall Be Quad-Redundant for Safety Problem - Redundancy Was Dictated without Getting to Fundamental Requirement • Design-Free: No Combinations of Failures within the FLCS, with a Probability of Occurrence Greater Than 10 to 7, Shall Result in a Category 1 Hazard. The Redundancy Level Will Be Determined by Analysis and Trades of Different Redundancy Architectures, MTBFs of Hardware and Allocation of Functions to Hardware and Software During the Design Phase

30. Example of a Verifiable Requirement • Non-Verifiable: A Single Failure (of the FLCS) Shall Result in Minimal Transients • Verifiable: A Single Failure Shall Result in Less Than +/- 1g’s Normal or Lateral Axis

31. Example of Requirements Allocation,Traceability and Decomposition • Parent Requirement from Weapon System Spec: • WSS102004: The Weapon System Shall Be Designed to Promote Operational Personnel Safety • One Child Requirement to WSS102004 in Air Vehicle Spec: • AVE31550: The Diagnostic Function Shall Provide Built-in Logic to Promote Personnel Safety for all Tests • One Child Requirement to AVE31550 in Vehicle Management System Spec: • VMS01380: Initiated Built-in Test (IBIT) Shall Not Be Enabled Until Multiple Interlocks are Satisfied • One Child Requirement to VMS01380 in Flight Control System SW Spec: • FLC13790: FLCS Software Shall Only Allow IBIT to Be Engaged When Weight is on Wheels and Wheel Gear Tachs < x Knots and Engine Thrust is Below Flight Idle and IBIT Engaged Switch is Selected

32. The Need for Automated Requirements Management • System Engineers Need It • Large numbers of requirements (along with the availability of computer hardware and software tools) makes computer automation very beneficial • Answering customer requirement queries will be easier and more defendable • Communication within the design team will be enhanced • Some Programs Require It (Customer Mandate) • Benefits of ARM Approach • Technical Performance Measures tracking/management • Rapid response for management and analysis • Standard views, reports, analyses available • Multi-user access with configuration controls • Complete traceability of requirements - Reqts hierarchies - Reqts histories - Open Issues - Allocation to design elemnets - Verification methods - Response organizations

33. Need and Enabling Technologies Pointto Implementing Automated Requirements Tracking Requirements Automation Changing Requirements Specialization in Workplace Distributed Processing Hardware Requirements Tracking Software Distributed Data Entry With Update Under Configuration Control Will Allow Specialists From Different Disciplines to Work Efficiently as a Team.

34. Reasons to Use a Requirements Tracking Tool • Customer Requests for Changing Requirements CanBe Fully, Accurately, and Efficiently Addressed (Allow for Reasonable Requirements Evolution) • Enhances Internal Communications within and AcrossManagement, Engineering, Production and Support Functions • Provides “Corporate Memory” for Future Projects • F-22 Customer Required Top-Down and Bottom-UpRequirements Tracking Capability to Better Address Cost Issues

35. Requirements Data Base Environment Weapon System ... Air Vehicle Sys Eng & Integ Support Training Test ... ... Funct.Reqt.3 Fire Control Airframe Propulsion Funct.Reqt.2 Functional Reqt. 1 Sys Eng & Integ Specs and Other Constraints TPMs & Trade Studies ... Support Radar Training Reqt. Attributes Owner Parent Reqt. Child Reqt. Verif. Method ... ... Application Software Antenna Receiver Transmitter Other Lower Level WBS Elements

36. Sample Weapons System RequirementsDatabase (common data) Number Type Statement Owner Development, Manufacturing, Verification, Deployment, Operations, Support, Training, or Disposal Text statement IPT (or name)

37. Sample Weapons System RequirementsDatabase (common data Cont. 1) WBS Parent Req. Child Req. Element Number Number Identifier

38. Sample Weapons System RequirementsDatabase (common data Cont. 2) Associated Trade Studies Related TPMs TPM Names Notes Trade Study Identifier Text

39. Sample Weapons System RequirementsDatabase (unique data by WBS) • Development: Cost, Schedule (Hardware, Software, • Facilities, Data, Materials) • Manufacturing: Primary Technology, Alternate Technology • (Availability, Cost, Risk) • Verification: Method, Description, Date • Operations: Performance Threshold, Performance Objective, • Weight, Space, Power, Cooling • Support: MTBF, Inspection Cycle, Spares Investment $, • Support Equipment Req. • Training: ... • Disposal: ...

40. Sample Weapons System RequirementsDatabase (unique data by WBS Cont. 1) Software: - Performance (bits processed, speed, response time) - Constraints (standards, data format, language) - Interfaces (software, hardware, people) - Reliability (freq. of failure, severity of failure, recovery of failure) - Supportability (diagnostics, portability)

41. Review Parts 1, 2, 3, and 4 of Systems Engineering Fundamentals

42. Develop Progression of Plans

43. Sample Requirements / Verification Metrics • Acceptance of Requirement • Verification Method Defined • Verification Requirement Defined • Verification Procedure Completed • Verification Results Completed • Verification Approved by Supervisor • FCA Performed

44. Requirements Tracking Software Tools&Sample Trade Study

45. ARM Comparative Ratings (Performance Capabilities Category) SLATE (1Q94) RDD-100 (Ver 4.0) RTM (Ver 2.1) Wt. Decision Criteria 1. Weights used were 1,2, & 3 with 3 being best. 2. Utility scores used varied from 0 to 10 with 10 being the best.

46. ARM Comparative Ratings (Performance Capabilities Category) SLATE (1Q94) RDD-100 (Ver 4.0) RTM (Ver 2.1) Wt. Decision Criteria Yes Yes Yes 1. Can the history or rqmts. changes and design decis- ions be maintained and dis- played showing the decision, source and decision date? MUM feature and SE facility in present version Provides audit trail of rqmts. etc. 3 Yes Yes Yes 2. Is top down and bottom up and lateral traceability possible for all classes of requirements? Reports can be generated. No graphical display of rqmts. Graphically or textually. Many viewing options available Graphically or textually 3 3. Can rqmts. be linked to WBS elements in such away that will allow WBS elem- ents to be summed, sorted, etc. by various key criteria? Yes Will link & track No computations Will link & track Computations with “SLATE Tab” feature 3 No computations

47. ARM Comparative Ratings SLATE (1Q94) RDD-100 (Ver 4.0) RTM (Ver 2.1) Wt. Decision Criteria Yes Will link & track 4. Can engineering estimates and customer/mgmt. rqmts. be tracked and sorted? Can difference/variation be deter- mined and sorted as in 1? Will link & track “SLATE Tab” feature will support 2 Ex. Can recall such as all wts> 100 lbs No computations 5. What stndrd. report for- mats does the ARM tool support? RAD,RAM, MIL- STD-490, MIL-STD-2167? RAD, RAM, 490, 2167A RAD, RAM, 490, 2167A- with mult. presentations Can do standard SE reports 2 Yes Yes Yes 6. Are reports tailorable by user(i.e., when 2167A is up- dated can the user change the report format to match the new standard? Tailorable by the user, with updates by the developer Labor intensive in present version Need additional training 2 Easily tailorable No, but.... Yes Yes 7. Can data fields be added by the user (addtl. attributes assigned to a class of rqmts.)? User defined attributes are being considered Extender feature for schema mods. 2 Simple & fast

48. ARM Comparative Ratings (Cost Category) SLATE (1Q94) RDD-100 (Ver 4.0) RTM (Ver 2.1) Wt. Decision Criteria Approx. $30K SD: $29.4K 1. What is the purchase cost? Each station: $7500 2 Assuming no LFWC invstmt. Quantity discnt. for licenses in use by Lockheed 2. What is the yearly maintenance fee? 12-15% (est.) 1 15% 15% 3. Are updates provided as part of maintenance fee or billed separately? 1 Provided Provided Provided $3000/mo. $1500/mo 4. What is the yearly lease cost? No lease pro- gram planned at this time 3 licenses 1 Includes 2 days per month on- site consultation 4 users

49. ARM Comparative Ratings (Training/Support Category) SLATE (1Q94) RDD-100 (Ver 4.0) RTM (Ver 2.1) Wt. Decision Criteria 1. What assistance is pro- vided for initial tool setup? As necessary, form IDE(third party) in Dallas Local (Plano) TI Local (Dallas) ALC 2 2. What on-site consultation support is provided during setup, beyond initial training? Telephone hotline Telephone hotline By IDE (third party) in Dallas 2 On-site consult could be nego- tiated Paid consults on-site are available 3. What is the training cost for the initial startup? $1500/stud. at ALC $7500: Up to 8 students - on site (plus expenses) Undetermined 1 $9000: up to 6 studts. (on-site) Trained RDD- 100 users on staff

50. ARM Comparative Ratings (Host Environment) SLATE (1Q94) RDD-100 (Ver 4.0) RTM (Ver 2.1) Wt. Decision Criteria Mac IIci Mac XV Quadra 700, 950 1. What hardware systems can host the ARM tool? Sun SPARC 4.1.3 Sun SPARC User remote terminals: X-compliant IBM 386/486 types HP 700 series IBM RS-6000 DEC VMS 1 Sup SPARC DEC Stn 5000 HP 9000/700 IBM RS-6000 IBM PC 486 Apple 7.0 Sun OS 4.1.2 DEC Ultrix HPUX 9.0.7 AIX 3.2 DOS or Windows 2. What operating system is needed to host the ARM tool? Current for above UNIX 1 3. Is a color display supported? Yes Yes - in current version Yes 1