InfiniBand Trade Association Developers Conference CIWG Update

1. InfiniBand Trade AssociationDevelopers ConferenceCIWG Update Tuan Phamdo – CIWG Rupert Dance – CIWG

2. Presentation Goals • CIWG Charter and Organization • Compliance and Interoperability • IBTA October 2006 Plugfest • SDR and DDR Testing • IL List

3. CIWG Charter CIWG Deliverables • Define, implement and oversee an effective IBTA Compliance and Interoperability Program. • InfiniBand Compliance Test Specification and Test Suites • Process for InfiniBand Compliance and Interoperability Testing • Plugfests CIWG Organization • Management group – responsible for Volume 1 Spec review and writing Test Descriptions (TDs) • Physical Group – responsible for Volume 2 Spec review and updating TDs and MOIs • Plugfest group – responsible for organizing PlugFest events • Lamprey Networks – responsible for test implementation and running the Plugfests CIWG Membership • 22 Member Companies, 110 participants

4. Key Milestones and Deliverables • CIWG Formed -- August 2000 • 1st Plugfest - June 2001 • Test Specification - June 2003 • First Integrator List Launch - June 2003 • 9th Plugfest – March 2006 • April 2006 – Updated IL List • http://www.infinibandta.org/itinfo/IL • 10th Plugfest – October 2006 – IBTA/OFA Joint Session

5. Compliance and Interoperability • InfiniBand Architecture specification • Defines the Protocol • Defines compliance requirements • The success of InfiniBand Architecture depends on rolling out products that • Meet the architecture requirements (Compliance) • Work seamlessly together (Interoperability)

6. IBA Spec Test Specs Compliance & Interoperability Tool Mapping PASS FAIL IBA Spec Describes Compliance Statements Test Spec Interprets Compliance Statements and Defines Test Criteria Tests Clear Test Output Maps Directly to Test Spec and IB Spec Test H/W & S/W Validates Test Criteria Predictable Path to C&I

7. IBTA Plugfests • The 10th IBTA Plugfest will be held October 9-10 2006 • Compliance testing based on IBTA Specs • Physical Layer tests suites are being updated to Volume 2 v 1.2.1 • Link and management tests are being updated to Volume 1 v 1.2 • Interoperability testing based on updated OFA Interop Test Plan • SDR and DDR testing available • Cable testing will include both SDR and DDR testing • Physical Layer DDR Device testing will be conducted using the latest techniques and Tektronix equipment

8. SDR and DDR testing details • Physical layer testing • Cable testing will include both SDR and DDR testing • SDR and DDR Device testing will be conducted using the latest techniques and Tektronix equipment. • Eugene Mayevskiy - Tektronix • Jay Diepenbrock - IBM • John Calvin – Tektronix • Protocol Layer Testing • Testing will be conducted using the Agilent E2954 SDR Generator • There is currently no DDR generator available • Addressing, Management, Network and Transport tests are not affected by DDR • Link Layer tests • 37 of 42 tests are not affected by SDR/DDR issues • C7-053 and C7-070 will only be verified at SDR rates

9. Integrators List • Definition of the Integrators List • The List includes a set of devices that passed the specified testing suite at a certain date • The CIWG defines the testing process and the actual tests • Integrators List has been updated • Current – this list includes all and devices which passed at the most recent Plugfest • Archives - An Integrators' List has been published for each Plugfest since the first one in June 2003. • http://www.infinibandta.org/itinfo/IL

10. Summary – CIWG Activities • Compliance and Interoperability are essential elements for the success of InfiniBand Architecture • CIWG is chartered to manage the InfiniBand Trade Association’s Compliance and Interoperability Program • Plugfest Objectives • Enable industry to design for C&I • Provide confidence that InfiniBand Products are compliant and interoperable within the InfiniBand Architecture framework thru IBTA sponsored plugfests • Support the advance of InfiniBand Architecture technology • Plugfest Roadmap • Twice a year (next one in October 2006) • Integrator List updated at each PlugFest

11. Interoperability Testing Sujal Das, Mellanox Tuan Phamdo, Intel Rupert Dance – Lamprey Networks

12. OFA IWG Charter • Define and Execute interoperability testing policies, processes and procedures for the OpenFabrics software stack • Focused on Interoperability and not compliance OFA IWG Deliverables • Interoperability Test Spec – version 1.0 now available • Select vendor to host Interoperability events - UNH IOL • Develop Logo Program • Full Interop demo at SC06

13. OFA IWG Organization • Formed in April 2006 • Similar to IBTA but focused on Interoperability • Members – responsible for writing Interop Test Spec, maintaining the Logo program and promoting the use of the OFA Stack. • UNH IOL – responsible for test implementation and running the Interoperability Events OFA IWG Membership • 15 Member Companies and 30 participants • Chelsio, Cisco, Flextronics, Intel, Lamprey Networks, Lawrence Livermore Labs, LSI Logic, Mellanox, Network Appliance, NetEffect, QLogic, SilverStorm, System Fabric Works, UNH IOL and Voltaire

14. OFA Membership Benefits Overview • Testing Membership: $10K/year • University of New Hampshire-Interop Lab • Create and maintain an Interop Test bed • Maintain Interop Test Spec • Organize and sponsor Plugfests • Provide On-Demand testing for members who wish to test outside of Plugfests • Paid membership benefits • Free scheduled events and on-demand testing participation • Eligibility for Logo grant • Non-members can participate in the scheduled events for $5K/event • Not eligible for on-demand testing and logo grant • IWG works with the OFA Marketing Group to promote the LOGO program that is based on Interop results

15. Deployment Scenarios InfiniBand Fabric SRP StorageTarget SRP to Fibre Channel Gateway Server HCA InfiniBand toEthernet Gateway InfiniBand Switch Server HCA Fibre Channel Network iSER StorageGateway NFS-RDMA Server iSER StorageTarget Server Ethernet Switch R-NIC Ethernet to Fibre Channel Gateway Server R-NIC NFS-RDMAServer iSER StorageTarget Ethernet Fabric Interoperability across InfiniBand and iWARP fabrics Interoperability with other fabric components

16. OpenFabrics Software Stack IP Based App Access Sockets BasedAccess Various MPIs Block Storage Access Clustered DB Access Access to File Systems Application Level Diag Tools Open SM User Level MAD API UDAPL User APIs InfiniBand OpenFabrics User Level Verbs / API iWARP User Space SDP Lib Kernel Space Upper Layer Protocol IPoIB SDP SRP iSER RDS NFS-RDMA RPC Cluster File Sys Connection Manager Abstraction (CMA) Mid-Layer SA Client MAD SMA Connection Manager ConnectionManager Kernel bypass Kernel bypass InfiniBand OpenFabrics Kernel Level Verbs / API iWARP Provider Hardware Specific Driver Hardware Specific Driver Key Common Apps & AccessMethodsfor usingOF Stack InfiniBand Hardware InfiniBand HCA iWARP R-NIC iWARP

17. Test Plan v1.0 Scope InfiniBand Fabric SRP StorageTarget Server HCA OFED v1.x Software (Now) InfiniBand Switch Server HCA iSER StorageTarget Ethernet Switch Server R-NIC OFED v2.x Software (TBD) Server R-NIC iSER StorageTarget Ethernet Fabric Interoperability with some fabric components within fabric Cross fabric interoperability tests in later versions

18. Test Plan v1.0 Scope IP Based App Access Sockets BasedAccess Various MPIs Block Storage Access Application Level Diag Tools Open SM User Level MAD API UDAPL User APIs InfiniBand OpenFabrics User Level Verbs / API iWARP User Space SDP Lib Kernel Space Upper Layer Protocol IPoIB SDP SRP iSER Connection Manager Abstraction (CMA) Mid-Layer SA Client MAD SMA Connection Manager ConnectionManager Kernel bypass Kernel bypass InfiniBand OpenFabrics Kernel Level Verbs / API iWARP Provider Hardware Specific Driver Hardware Specific Driver Hardware Specific Driver Hardware Specific Driver Key Common Apps & AccessMethodsfor usingOF Stack InfiniBand Hardware InfiniBand HCA QLogic HCA Ammasso R-NIC NetEffect R-NIC iWARP

19. InfiniBand Specific Test Cases • OpenSM (in servers) • Proprietary Subnet Managers (in switches) • Over CMA or InfiniBand CM • Disconnect/reconnect • Discovery, port states, error counters • SM failover • IPoIB – I/F, subnet, multicast, ping, FTP • iSER/SRP – connection, recovery, DD tests

20. iWARP Specific Test Cases • Over CMA or iWARP CM • Single and multiple iWARP connections and RDMA operations • Disconnect/reconnect • IP speed negotiation • Error ratio • Stress pattern • Parameter negotiation

21. Transport Independent Test Cases • Over CMA • iSER – connection, recovery, DD tests • SDP – netperf, FTP, SCP procedures • UDAPL – connection, verification, end-points, RDMA R/W, threads, pipeline, point-to-point and switched topologies • MPI – benchmark tests, different SMs (IB), RDMA R/W, all-to-all connections, dynamic connections, errors

22. OFA Interop Event • Same week and location as IBTA Plugfest • Date: October 11-13th 2006 • Location: UNH-IOL – Durham, NH • Interop Test Plan v 1.0 • Hardware • 9 Intel Servers • 6 IB HCAs and 2 iWARP R-NICs • 8 IB Switches and one 10 GbE Switch • Software • RHEL 4.0 Update 4 • SLES 10 • Windows Server 2003 • OFED 1.1

23. OFA-UNH IOL Tested Logo Program

24. OFA-UNH IOL Tested Logo • Program Goals • Compelling end-user benefits • Gauge vendor equipment interoperability using trusted source (UNH-IOL) • Easy bring-up experience • Vendor motivation • Product with logo  better end-user acceptance • For paying members only ($10K/year) • Non Goals • OFA, IWG, or UNH-IOL liability • Certification, proven to work or interoperate

25. Logo Program Proposal • “OFA & UNH-IOL Tested” Logo • Granted to vendors that meet following three requirements: • Participate and complete testing in IWG and UNH-IOL hosted test events • Scheduled events or on-demand • Make UNH-IOL issued test report public • Ensure integrity of OFA & UNH-IOL “Tested” Logo • Sign logo license agreement (administered by OFA-IWG) • Vendors can opt to keep results confidential by not applying for logo • Logo signifies “tested” only • No liability • Supplemental test report validates actual extent of interoperability

26. Logo Usage (Scenario) • Vendor PR and marketing collateral • Announces granting of Logo by IWG and UNH-IOL • Uses logo in product and collateral • Supplements with IWG-IOL test results • What versions, what hardware • Pass, fail, workarounds • Possible visibility in UNH web site • Evaluate participation in multi-vendor networks • By end users, SCINET organizers etc.

27. OFA IWG Members • 15 Member Companies and 30 participants • Chelsio • Cisco • Flextronics • Intel • Lamprey Networks • Lawrence Livermore Labs • LSI Logic • Mellanox • Network Appliance • NetEffect • QLogic • SilverStorm • System Fabric Works • UNH IOL • Voltaire

28. OFA Backup Slides

29. CIWG Backup

30. Benefits Importance • Products do not operate in vacuum • Your InfiniBand Product will operate with others in customer environments • Perfect compliance to the InfiniBand Specification leads to successful interoperability • Testing with other products is key • Individual product functional testing is not adequate • System vendors • Better user experience -- system “just works” • Compliant peripherals reduce support calls • Peripherals vendors • Compliant components reduce support calls and product returns • Stronger peripheral sales • Building blocks (silicon, software, etc.) • Stronger system and peripheral sales lead to stronger “building block” sales

31. CIWG Membership • 22 Member Companies, 110 participants • Cisco • Flextronics • Foxconn • Fujitsu Components America, Inc. • Golden Bridge Electech, Inc. • Hewlett-Packard • Hitachi • IBM • Intel • Lamprey Networks • LEONI Special Cables • LSI Logic • Mellanox • Molex • NEC • Panduit • QLogic • SilverStorm • Sun • Tyco • Voltaire • W.L. Gore