Tech Notes

Networking: Data Center Physical layer

Single mode Vs multi-mode fiber:

Single-Mode Fiber (SMF):
  • Core Diameter: Small (around 9 micrometers).
  • Light Propagation: Single light mode, minimal dispersion.
  • Distance: Capable of long distances, typically over 10 km, up to 80 km or more depending on the transceiver used.
  • Transceiver for 25/100G: For 25G, use SFP28 LR (Long Reach) transceivers; for 100G, use QSFP28 LR4 or ER4 transceivers.
Multi-Mode Fiber (MMF):
  • Core Diameter: Larger (50 or 62.5 micrometers).
  • Light Propagation: Multiple light modes, more dispersion.
  • Distance: Shorter distances, up to 550 meters for 10G, reduced for higher speeds (100-150 meters for 25G/100G).
  • Transceiver for 25/100G: For 25G, use SFP28 SR (Short Reach); for 100G, use QSFP28 SR4 transceivers.

Choose single-mode fiber for long-distance communication and multi-mode fiber for short-distance, high-bandwidth connections within data centers or buildings.

Transceivers: an optical transceiver is a module that converts electrical signals into optical signals and vice versa, allowing data to be transmitted over fiber optic cables.

Optical transceivers come in various form factors, such as SFP (Small Form-Factor Pluggable), SFP+ (enhanced SFP), QSFP (Quad Small Form-Factor Pluggable), QSFP28 (for 100Gbps), QSFP-DD (Double Density, for 400Gbps), and others. They plug into a port on a switch, router, or network interface card and are used in conjunction with fiber optic cables to enable high-speed data transmission.

Transceivers have an optical connector interface (like LC, SC, or MTP/MPO) for the fiber cable on one end and an electrical connector on the other end that connects to the networking equipment.

AOC vs MTP/MPO

An AOC (Active Optical Cable) is a cable that has fiber optic components and electronics embedded within the connectors at either end. These cables are designed to provide a high-speed connection between networking equipment, such as switches, servers, and routers. AOCs are typically used for short-range, multi-lane data communication and data center interconnects.

Key characteristics of AOCs include:

  • Integrated Transceivers: Each end of an AOC has an integrated transceiver that converts electrical signals to optical signals and vice versa.
  • High Bandwidth: AOCs support high data rates, commonly used for 10G, 25G, 40G, 100G, and higher speeds.
  • Plug and Play: AOCs are factory-terminated and tested, making them easy to install and use without the need for field termination or splicing.
  • Power Consumption: They typically consume less power than separate transceivers plus fiber cables due to the integrated design.
  • Distance: AOCs are suitable for short to medium distances, ranging from less than a meter up to 100 meters or more, depending on the quality and design of the cable.

On the other hand, MTP/MPO (Multi-fiber Termination Push-on/Multi-fiber Push-On) cables are a type of multi-fiber cable that terminates with an MTP or MPO connector. These connectors can house a specific number of fibers, typically 12, 24, 48, or more, in a single connector, allowing for the simultaneous connection of multiple fibers.

Key differences between AOC and MTP/MPO cables:

  • Active vs. Passive: AOCs are active cables with embedded electronics, while MTP/MPO cables are passive and only contain optical fibers without any active components.
  • Transceivers: AOCs have transceivers built into the cable ends, whereas MTP/MPO cables need to be plugged into separate transceivers at the equipment.
  • Use Case: AOCs are commonly used for direct-attach connections within racks or between adjacent racks, while MTP/MPO cables are often used for structured cabling solutions, backbone cabling, or to facilitate high-density fiber networks.
  • Flexibility: MTP/MPO cables can be part of a more extensive and flexible cabling system, including patch panels and break-out cables, allowing for various configurations and reconfigurations.

In summary, AOCs are active cables that come with built-in transceivers for direct connections between devices, while MTP/MPO cables are passive, high-density fiber cables that require separate transceivers and are used in structured cabling systems. The choice between the two depends on the specific requirements of the network, including distance, bandwidth, power consumption, and deployment flexibility.

Chipsets/ASICs:

The Tomahawk 4 and Jericho chipsets are both produced by Broadcom and are designed for different use cases within networking equipment such as switches and routers.

Tomahawk 4 Chipset:

  • Targeted Application: Data center networking, particularly for high-density, high-throughput environments.
  • Bandwidth: Designed to support high data rates, with versions capable of providing up to 25.6 Tbps switching capacity.
  • Port Speeds: Supports 1G, 10G, 25G, 40G, 50G, 100G, 200G, and 400G Ethernet ports.
  • Use Case: Ideal for cloud-scale data centers, high-performance computing, and AI applications where large amounts of data are moved within a data center.
  • Features: Focuses on high-speed data transfer with features like large on-chip buffers, low latency, and support for a large number of ports.
  • Port Density: Provides high port density, enabling more ports per switch.

Jericho Chipset:

  • Targeted Application: Service provider networking and carrier-grade routing.
  • Bandwidth: Offers lower overall switching capacity compared to Tomahawk 4 but includes features tailored for complex routing tasks.
  • Port Speeds: Supports a variety of port speeds, with a focus on 10G, 25G, 40G, 100G, and beyond.
  • Use Case: Suited for edge and core routers in service provider networks, where it’s necessary to manage traffic between different networks with sophisticated routing capabilities.
  • Features: Includes advanced features for carrier networks, such as deep packet buffers, hierarchical Quality of Service (QoS), large routing tables, and support for MPLS (Multiprotocol Label Switching) and segment routing.
  • Routing Capabilities: Designed to handle complex routing and traffic management tasks required in service provider networks.


Posted

in

by

Tags: