Focus Group 2: Network Reliability Data Reporting & Analysis

1. Focus Group 2.B1 Network Reliability - Data Reporting & Analysis NRIC V Council Meeting - June 26, 2001

2. Agenda • Governance • Charter • Membership • Key Deliverables • Reliability Reporting

3. Governance Focus Group 2 Network Reliability Chair: Brian Moir, ICA (202) 331-9852 Focus Group 2.A1 on Best Practices Chair: Rick Harrison Telcordia (732) 758-2013 Focus Group 2.B1 on Data Reporting and Analysis Chair: P.J. Aduskevicz, AT&T (908) 234-5790 Focus Group 2.A2 on Best Practices Packet Switching Chair: Karl Rauscher Lucent Technologies (908) 582-5306 Focus Group 2.B2 on Data Reporting and Analysis for Packet Switching Chair: Paul Hartman Hartman Associates (913) 893-9722

4. Charter I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. • Criteria for determining types of outages to be reported will be developed by each industry segment building on the recommendations from NRIC IV. • The process for reporting data during the voluntary trial will be documented and implemented. • Analysis of the data from the trial will be conducted by a neutral third party. • Industry associations will be requested to encourage participation by their constituents. • At the completion of the trial period, an evaluation of its effectiveness will be conducted and a recommendation made. II. Evaluate outage-reporting requirements and guidelines currently used by wireline carriers to improve the quality of outage reporting. III. Evaluate and report on the reliability and availability of the PSTN utilizing NRSC quarterly reports.

5. Membership 2.B1 - Data Reporting and Analysis Team

6. Key Deliverables I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. Voluntary Trial Status • Recommendation to NRIC IV to proceed with trial predicated on FOIA exemption • NRIC V Chairman sent letter to industry association representatives reinforcing commitment to voluntary trial and explaining MOU (Memorandum of Understanding) signed by NCS/NCC and FCC ensuring that proprietary information provided under the agreement is protected against unauthorized use or disclosure • Industry associations have reviewed the Chairman’s letter and the MOU with their members • Flowchart of reporting process and criteria for data scrubbing by NCS/NCC have been validated and refined • Trialed process • Handed off data to Best Practices Team • Overarching trial goals and data analysis options have been documented by the team and distributed to industry association representatives

7. Key Deliverables I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. Voluntary Trial Status • Progress has been made through the industry associations in identifying trial participants and obtaining positive reports when no outages have occurred; however, at this time, portions of the industry have insufficient participation to provide data needed for valid conclusions or recommendations • Outreach activities have been initiated to increase participation • ATIS Teleconference Series (INFOSYNC) presentation • Contact Campaign • NCS/NCC has received one report to date

8. Voluntary Trial Process Subcommittee 2.B 1 Service Provider NCS/NCC NRIC V Outage Occurs Handoff scrubbed data required by 2.A1 and 2.A2 (Best Practices) NCS/NCC Logs Report Initial Final Determine if Outage Meets Vol. Trial Criteria Scrub Data per Criteria Established by 2.B1 Does 2.B2 want to use data? Initial Final Local Root Cause Analysis If no Aggregate And Send Data • Analyze Scrubbed • Data: • By Type/Segment • Impact • Frequency • Root cause for • Commonality If yes Create Initial Report within 3 Days – Mark Company Proprietary Fax to NCS/NCC On (703-607-4998) Provide status at NRIC V Council meetings Monitor Progress Conduct Root Cause Analysis Determine whether request to share data should be made Concur or Provide Input on Recommendations Make Recommendations Identify Best Practices If no Fax Final Report with in 30 Days If yes Take No Further Action Grant Permission to Share Data? If no File Final Report Develop Final Report to Include Recommendations Share Scrubbed Data (i.e. NIPC) If yes • Service Provider – Companies who provide CMRS, Satellite, Cable Telephony, ISP and Data Services • NCS/NCC (National Communication System/National Coordinating Center) - Joint industry-government • organization and mechanism by which the federal government and telecommunications industry respond • to national security and emergency preparedness (NS/EP) telecommunications service requirements. • Subcommittee 2.B1 – A subcommittee of the NRIC V Network comprised of representatives of • industry associations, consultants, and providers for wireline and non-wireline services and equipment. • NRIC V – A federal advisory committee that is chartered to evaluate and report on the reliability of • public telecomm network services in the US including the reliability of packet switched networks.

9. Template NON-WIRELINE VOLUNTARY NETWORK OUTAGE INITIAL REPORTING TEMPLATE

10. Voluntary Trial Outage Report - Scrubbed Data Criteria Agreement with Team – For Data Handoff

11. Potential Analysis Options Scrubbed Final Report field Sample Analysis Action Potential Product or Conclusion Outage Tag Filter data by industry segment in conjunction with other fields Comparison of outage frequencies by industry segment Identification of any industry segment-specific anomalies Start Date Aggregate outages by unit time Outage frequency graphs by week, quarter, time, etc. Date- or time-specific conclusions (e.g.,weekend vs weekday, holidays, rush hour outages) Start Time of Impact Estimated number of customers affected Outage Index graphs (characterizing outage severity) Verification of /Additions to T1A1.2 outage index method New industry segment-specific outage indices Comparison of outage severity trends; recommendations on appropriate thresholds for reporting by industry segment Apply outage index Identify new outage index Types of Services Affected (if applicable) Identify new services affected within industry segments Recommendation on outage index weightings for new services Outage Index graphs (characterizing outage severity) Verification of /Additions to T1A1.2 outage index method New industry segment-specific outage indices Recommendations onappropriate thresholds for reporting by industry segment Apply outage index Identify new outage index Duration of Outage (hours and minutes) Graphs focusing on key causes by industry segment Recommendation of new causes to track/monitor/mitigate (e.g., DNS, cell site, head end, transponder) Identify existing and new causes Aggregate outages by cause Apparent or known cause Root Cause and Trouble Found [OPT] Aggregate outages by network part; Identify “new” parts (e.g.,radio access segment) Industry segment-specific graphs showing susceptible network parts (e.g., access vs transport): Conclusions on industry-wide “reliability” of network access, etc. Specific Part of Network Involved Identify existing/new methods New best practices/Validation of existing practices Recommendations on restoral and prevention methods by industry segment. Recommendations on “crossover” methods (i.e., practices in one segment that may be of use in others) Methods Used to Restore Service [OPT] Steps Taken to Prevent Recurrence Applicable Best Practice [OPTIONAL]

12. Overarching Trial Goals • Enable a general characterization of reported outages’ impact on the public • Address effectiveness of trial • Identify outage reporting similarities or differences across industry segments • Show that industry has the initiative to gather “outage” information without government involvement • Identify what data should/should not be reported • Provide an opinion on the “State of Reliability” of the examined networks • Address next steps (e.g., continue/stop trial) • Identify the Root Cause(s) (i.e., chain(s) of events that led to an outage) for Best Practices review • Allow Best Practices to be identified for entire industry benefit • Allow unregulated voluntary outage reporting to assist national communications security and awareness • Enable carrier and vendor service improvement for all consumers

13. Key Deliverables II. Evaluate outage-reporting requirements and guidelines currently used by wireline carriers to improve the quality of outage reporting. • Revised Network Reliability Steering Committee Charter to Reflect intent to “improve” reliability verses previous charter to “monitor” • Changed baseline for FCC Reportable Service Outages from first year to cumulative going forward • Began conducting special analysis on detected trends (for example, single failure affecting large geographic areas) • Began performing analysis on Emergency Services Outages • FCC working to implement 63.100 electronic filing and putting template into “user friendly” format.

14. Key Deliverables III. Evaluate and report on the reliability and availability of the PSTN utilizing NRSC quarterly reports. • Utilize NRSC to report data analysis from 63.100 process • Outage results assembled and analyzed by Network Reliability Steering Committee • Quarterly and annual results for overall outages and sub categories available on web site: http://www.atis.org/atis/nrsc/nrschome.htm • Will incorporate analytics from Voluntary Outage Reporting Trial for cable, satellite, wireless, ISPs to extend Network Reliability Reporting based on the Voluntary Trial Data Analysis Options • Formed study group to review CCS outages and identify possible causes of the recent increase and initiated an awareness program • 2000 Annual Report in progress

15. Reliability Reporting NRSC – 1Q01 ResultsFCC Reportable Service Outages (by number of events)

16. Reliability Reporting NRSC – 1Q01 ResultsFCC Reportable Service Outages (by outage index)

17. Reliability Reporting NRSC – 1Q01 Results Failure Category - Common Channel Signaling (by number of events)

18. Reliability Reporting NRSC – 1Q01 Results Failure Category – CO Power (by number of events)

19. Reliability Reporting NRSC – Annual Control Chart FCC Reportable Service Outages (by number of events)

20. Reliability Reporting NRSC – Annual Control Chart FCC Reportable Service Outages (by outage index)

21. NRSC Significant ResultsThrough 1Q01 • Outage frequency overall was in the “Green” region and was the second lowest ever. Within failure categories, all outage frequencies were within the “Green” region. • The aggregated outage index overall was in the “Green” region. • The frequency of Facility outages was the lowest ever and the lowest total for any four consecutive quarters. • The frequency of CCS outages over the last four quarters (24) was the greatest of any four consecutive quarters. • The frequency of CO Power outages over the last four quarters (37) was the greatest of any four consecutive quarters.

22. NRSC Significant ResultsThrough 1Q01 Based upon analysis of all outages reported from 1Q93 through 1Q01, the NRSC notes: • There is an increasing trend in the number of Tandem Switch, CO Power, CCS, and DCS outages. • There is an increasing trend in the frequency and aggregated outage index of Procedural Errors as the root cause of outages. • There is a decreasing trend in the number of Facility and Local Switch outages.