80 likes | 227 Vues
Discover the advanced capabilities of InfiniBand architecture, designed for high-performance computing environments. This unified fabric supports IPC, networking, and storage through a switched fabric topology, allowing up to 64K nodes per subnet. With features like IPv6 addressing, multiple subnets, QoS, and automatic fail-over, InfiniBand ensures reliable and efficient data transfer. It supports diverse link widths, copper and fiber connections, and offers high signaling rates, making it ideal for large-scale deployments. Embrace the future of data transmission with InfiniBand technology!
E N D
Link Link MemCntlr MemCntlr MemCntlr MemCntlr CPU CPU CPU CPU HCA HCA HCA HCA InfiniBand HW Architecture InfiniBand Unified Fabric • Topology • Switched Fabric (vs shared bus) • 64K nodes per sub-net • Multiple subnets bridged w/routers • IPv6 addressing x-subnet • Fabric Transactions • Unified fabric for IPC, Networking, and Storage • Channel based interconnect • Closely integrated with Mem Ctrlr • QoS (Service Levels, Virtual Lanes) • Reliability • Automatic fail-over in switch • Support for redundant fabrics • Physical Layer • Cost Effective Four wire link (2 pairs) • Enables volume deployments • 2.5Gb/sec signaling rate • Copper & Fiber support • Multiple link widths • 1x - 2.5 Gbits/sec • 4x - 10 Gb/sec • 12x - 30 Gb/sec Hosts Storage 1 InfiniBand Switch Network 2 3 . . . . Router n InfiniBand Architecture Storage Target TCA 1 Link Link Switch 2 Link Link Link TCA N/W Target 3 Link Link Link Link xCA Router n 1
Virtual Lane (VL) • Multiplex multiple independent data streams onto a single physical link which provides: • Differentiated services on a packet-boundary basis • Increase fabric utilization in the face of head-of-line blocking on a given VL and via VL-based routing across multiple paths • Support for up to 16 VLs with 1 VL reserved for fabric management • Implementations shall support a minimum of 1 VL application usage and 1 VL for fabric management Packets Packets De-Mux Mux 4
Messages & Packets Transaction • Applications, drivers, devices, adapters, etc. execute transactions via logical units of work termed messages. • H/W-based memory / resource protection to prevent unauthorized access to messages • Message semantics supported are: • Memory - RDMA Read / Write • Channel - Send / Receive • Atomics (optional functionality) • Multicast (optional functionality) • InfiniBandtechnology H/W provides automatic message segmentation and re-assembly via packets • End-to-end fabric unit of transfer Message Message Message Packet Packet Packet Packet Packet Packet Packet Packet 5