plexxi switch 2e install guide · or program components described in this documentation, as...

®

PlexxiHCN™PlexxiSwitch2e

HardwareandInstallationGuide

705-30002-20Rev1.1DocumentVersion2December1,2017

® 100InnovativeWay-Suite3322Nashua,NH03062Tel.+1.888.630.PLEX(7539)www.plexxi.com

2 PlexxiSwitch2eHardwareandInstallationGuide

LegalNoticesThe information contained herein is subject to change without notice. Plexxi®, the Plexxi logo, and LightRail® are registered trademarks, and Plexxi HCN™, Plexxi Control™ and Plexxi Connect™ are trademarks of Plexxi, Inc. in the United States and other countries. Other product or service name may be trademarks or service marks of others. No part of this documentation may be reproduced in any form or by any means or used to make any derivative work (such as translation, transformation, or adaptation) without written permission from Plexxi, Inc. Plexxi, Inc. reserves all rights of copyright in this documentation. PLEXXI, INC. PROVIDES THIS DOCUMENTATION “AS IS,” WITHOUT WARRANTY, TERM, OR CONDITION OF ANY KIND, EITHER IMPLIED OR EXPRESSED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES, TERMS, OR CONDITIONS OF MERCHANTABILITY, SATISFACTORY QUALITY, NON-INFRINGEMENT AND FITNESS FOR A PARTICULAR PURPOSE. Plexxi, Inc. reserves the right to make changes to equipment design or program components described in this documentation, as progress in engineering, manufacturing methods, or other circumstances may warrant. No responsibility is assumed for the use of Plexxi, Inc. software or hardware, all rights, obligations and remedies related to which are as set forth in the applicable sales and license agreements.

Plexxi, Inc. 100 Innovative Way - Suite 3322 Nashua, NH 03062 Tel: +1.888.630.PLEX (7539) www.plexxi.com

Published December 1, 2017 Printed in United States of America. Copyright © 2017 Plexxi, Inc. All rights reserved.

The Plexxi Switch system is classified as a class 1 telecommunications laser product employing embedded class 1 lasers and complies with the following:

THIS PRODUCT COMPLIES WITH FDA RULE 21 CFR SUBCHAPTER J IN EFFECT AT DATE OF MANUFACTURE. PRODUCT COMPLIES WITH 21 CFR 1040.10 AND 1040.11

PRODUIT CONFORME SELON LE SOUS CHAPITRE J DU DOCUMENT FDA RÈGLE 21 CFR EN VIGUEUR LORS DE LA DATE DE FABRICATION. PRODUIT CONFORME SELON 21CFR 1040.10 ET 1040.11.

Electrotechnical Commission (IEC) 60825-1, 60825-2

This product is classified as a: CLASS 1 LASER PRODUCT

APPAREIL À LASER DE CLASSE 1

This unit is intended to be installed in a Restricted Access Location only with access only by trained personnel.

3 Plexxi Switch 2e Hardware and Installation Guide

TableofContents

LegalNotices.........................................................................................................................................................2

Welcome!...........................................................................................................................................................5NetworkDeployments......................................................................................................................................5

InstallationConsiderations.............................................................................................................................5Power.....................................................................................................................................................................................................5OpticalCables.....................................................................................................................................................................................5

ContactingPlexxiSupport................................................................................................................................5SafetyNotes...........................................................................................................................................................6

ElectrostaticDischargePrecautions.............................................................................................................6ESDGuidelines................................................................................................................................................................6

RegulatoryCompliance......................................................................................................................................7

FCCNotice..............................................................................................................................................................7

IndustryCanadaNotice.....................................................................................................................................8ICES-003ClassA...............................................................................................................................................................8EN55022ClassAWarning...........................................................................................................................................8

Specifications.......................................................................................................................................................9Checklist.................................................................................................................................................................9

VerifyEquipment..............................................................................................................................................10

MountPlexxiSwitch2e...................................................................................................................................11MountRailAssembly...................................................................................................................................................11

CreateNetworks................................................................................................................................................12QSFPPortDiagram.......................................................................................................................................................12

PlexxiPSIInterconnectNetwork.................................................................................................................13PlexxiPSIInterconnect..............................................................................................................................................13MaketheConnections.................................................................................................................................................13LoopbackUnusedPorts...............................................................................................................................................................14ConnectMultiplePSIDevices....................................................................................................................................................14ConnectionDiagram......................................................................................................................................................................14

NetworkwithSwitch2PodModels........................................................................................................................15DirectConnectNetwork.................................................................................................................................16ConnectionGuidelines................................................................................................................................................16FourSwitchNetworkConnectionExample.........................................................................................................16FiveSwitchNetworkConnectionExample..........................................................................................................16NetworkDiagrams.......................................................................................................................................................17SevenSwitchConnectionExample.........................................................................................................................18AddSwitchtoExistingNetwork..............................................................................................................................19Five-SwitchNetworkExample..................................................................................................................................................19ConnectionTable............................................................................................................................................................................19

ChangeConnections.....................................................................................................................................................20NewConnectionTable..................................................................................................................................................................21

SixSwitch2eNetworkExample..............................................................................................................................21PortsandLEDs...................................................................................................................................................22


AccessPortsandLEDs................................................................................................................................................22I/OPanelLEDs...............................................................................................................................................................22STATLEDStates............................................................................................................................................................23PowerSupplyLED........................................................................................................................................................23FanLED............................................................................................................................................................................23ManagementPortLEDs..............................................................................................................................................24

SiteRequirements............................................................................................................................................25Altitude............................................................................................................................................................................25Ventilation......................................................................................................................................................................25Temperature..................................................................................................................................................................25CircuitOverloading......................................................................................................................................................25ReliableEarthing/Grounding...................................................................................................................................25MechanicalLoading.....................................................................................................................................................25Cabling..............................................................................................................................................................................25EquipmentProtection.................................................................................................................................................25


Welcome!Plexxi Switch 2e (Model: PX-S2E or S2E) is a Plexxi entry-series switch that supports scale-out applications with high performance East-West traffic needs. Plexxi Switch 2e differs from the other Plexxi Switch 2 models; it does not have the Plexxi LightRail™ interface. Instead, it uses 1310nm waves through the six QSFP interfaces to create a LightRail interface.

Each of the six QSFP interfaces supports 4x10GbE, making the total bandwidth identical to the LightRail interfaces on other Switch 2 models (6x4x10GbE=24x10GbE).

NetworkDeploymentsPlexxi Switch 2e network deployments include:

• PSI optical-based solution for six switches or more (four switch minimum)

Connect all Plexxi 2e switches to a Plexxi PSI Interconnect passive device. You plug each Switch 2e into the PSI using the Plexxi-supplied cable. The passive PSI device creates the mesh structure of a Plexxi network. You can deploy Switch 2 models 2p and 2sp with 2e in this network.

• Switch 2e Direct Connect for seven switches or less

Directly connect Plexxi 2e switches together using a QSFP-to-QSFP cable such as a Direct Attach Cable (DAC) or Active Optical Cable (AOC). You cannot directly connect Plexxi 2e switches in a network that includes Switch 2p and 2sp as well, or if the deployment is expected to grow beyond seven switches.

InstallationConsiderationsKeep the following considerations in mind when installing your switches.

Power• Make certain that all input connections are accessible at all times, and disconnect all power plugs

before servicing or moving the unit.

• Ensure that appropriate grounding and current surge protection are in place before connecting the switch to a power source.

OpticalCables

• Avoid excessive bending, which can damage the cables — particularly optical cables.

• Ample clearance exists at the front and access port panels to allow unrestricted cabling.

• AC power cords can easily reach from the AC power outlet to the connection on the power supply panel of the switch.

ContactingPlexxiSupportPlexxi Technical Support services are available to answer your questions and to make sure that your software and hardware continue to operate properly.

You can contact Plexxi Support at:

[email protected]

1.888.415.9809 (US/Canada toll-free)

+1 603-782-0702 (US/International)

http://support.plexxi.com


SafetyNotes

Warning: The primary hazards of exposure to invisible laser radiation from an optical fiber communications system are:

ï Damage to the eye by viewing an unterminated optical fiber or fiber optic connector. ï Damage to the eye from invisible laser radiation from viewing a cut fiber or a broken fiber.

Never attempt to view optical connectors that may be emitting laser energy and always avoid possible exposure to invisible optical laser radiation. Using optical fiber scopes or magnifying lenses may increase the possibility for an eye hazard. It is recommended that you use an optical power meter to determine if there is optical laser radiation present or use a remote video display inspection tool to inspect connectors.

WARNING To avoid possible eye injury, use an optical power meter to ensure there is no optical power in a cable connected to any Plexxi switch. Even if a switch is powered off, passive optics in a Plexxi fabric may transmit eye-damaging optical signals from neighboring switches.

! No user serviceable parts are inside the chassis other than the power supplies and fan assemblies. Contact Plexxi for all repairs. ! Only qualified personnel should service or replace Plexxi Switches. ! The Plexxi Switch contains multiple separate power sources. Always make certain

that all power sources are disconnected before servicing the unit.

ElectrostaticDischargePrecautionsUse Electrostatic Discharge (ESD) precautions when handling a Plexxi Switch outside a data center rack. Once the switch is installed in a rack, the mounting hardware provides grounding through the rack.

ESDGuidelinesObserve the following guidelines to avoid electrostatic discharge (ESD) damage when installing or servicing the Plexxi Switch.

• Minimize handling of assemblies and components.

• Assemble or remove equipment only in a static-free work area.

• Use conductive work surfaces (such as an antistatic mat) to dissipate static charge and wear a conductive wrist strap to dissipate the accumulation of static charge accumulation.

• Keep replacement parts in their original static-free packaging.

• Remove all plastic, foam, vinyl, paper, and other static-generating materials from the work area.

• Whenever possible, use tools that do not create electrostatic discharge.


RegulatoryComplianceSwitch 2e complies with the following regulatory certificates:

CCC

CE

EN 55022:2010/AC:2011 EN 61000-3-2:2014 EN 61000-3-3:2013 EN 55024:2010 IEC 61000-4-2 ed2.0 (2008-12) IEC 61000-4-3 ed3.2 Consol with am1&2 (2010-04) IEC 61000-4-4 ed3.0 (20012-04) IEC 61000-4-5 ed3.0 (2014-05) IEC 61000-4-6 ed4.0 (2013-10) IEC 61000-4-8 ed2.0 (2009-09) IEC 61000-4-11 ed2.0 (2004-03)

FCC

NOM

RCM

UL

EN 60950-1:2006/ A11:2009/ A1:2010/ A12:2011/ A2:2013 IEC 60950-1(ed.2), IEC 60950-1(ed.2);am1, IEC 60950-1(ed.2);am2

VCCI Class A

FCCNoticeNOTE: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense.


IndustryCanadaNotice

ICES-003ClassAThis Class A digital apparatus complies with Industry Canada Standard ICES-003. Cet appareil numérique de la classe A est conforme à la norme NMB-003 d'Industrie Canada.

EN55022ClassAWarningWarning: This is a class A product. In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures.


Specifications

Component Value

Chassis 1 RU form factor redundant

Dimensions 1.73 inches high by 17.3 inches wide by 21.6 inches deep

Weight 22.4 pounds (10.2 Kg)

Power Consumption maximum: 300W, typical: 200W

Altitude -60 to 3000 m

Temperature 0-40C

Humidity 10-90% non-condensing

LightRail Interfaces 6 x QSFP+ (24 x 10GbE)

Access interfaces 48 x SFP+

ChecklistPre-staging

! Physical, redundant power infrastructure is available

! Unpack switches

! Verify equipment delivered (air flow for fans and power supplies and cable lengths)

! Cabling plan

Installation

! Rack switches

! Build LightRail™ Fabric Interconnect (cabling)

! Verify switch connectivity and fabric health


VerifyEquipmentReview the components to ensure you received what your ordered.

Equipment Description

Four hot swappable fans Installed in chassis. A blue bar indicates airflow from the power supply panel to the I/O end. A red bar indicates airflow from I/O end to power supply panel.

Two power supplies Installed in chassis.

Two power cables 2.5 meters in length, which complies with appropriate country standards, You need to connect those cables to separate circuits for redundancy protection.

Cables Verify you have to cables ordered for your installation.

PSI:

• Two 24 fiber MTP to 3x12-fiber MTP Breakout cables for PSI interconnect (5M or 20M).

• Three 10 inch 24 fiber LightRail cables for single PSI loopback if not connected to another PSI device. You need additional cables for less than six switches on the PSI.

• Two 24 fiber LightRail cables to be used to connect PSI devices together or to connect Switch 2p/2sp switches to a PSI device. Available in 1, 3, 5, 10, 20 and 100M lengths. You need six cables to connect PSIs if interconnecting PSIs.

Direct Connect:

• DAC Passive cable, QSFP-to-QSFP 26AWG twinaxial cable, IEEE 802.3ba. Available in 1, 3, 5 and 7 meters.

• AOC cable supplied by Plexxi

Rack mount kit Rack mount for the switch.


MountPlexxiSwitch2eYou need the following to rack the switch:

• Two rack rail assembly pieces

• Two anchors to mount switch to rack

• Fourteen screws to mount rack rail assembly and anchors to switch

MountRailAssemblyThe rail assembly is attached with a set of four screws in the rear of the rail assembly and two at the front of the rail assembly.

1. Attach anchors to the switch.

2. Screw in rail-slide screws in the sides of the switch.

3. Attach rack rail pieces to rack.

4. Slide back of switch rail-slide screws into the anchor installed on rack.

5. Mount front of switch to the other side of the rack.


CreateNetworksYou make connections using the six QSFP ports that are located at the right side of I/O end of the switch. You connect these ports to a PSI Interconnect or to QSFP ports on another Switch 2e for a direct connect network.

QSFPPortDiagramIn the diagram, the QSFP ports include a label indicating direction (W1 through W3 and E1 through E3). These labels are for informational purpose and are not found on the Plexxi Switch 2e chassis.


PlexxiPSIInterconnectNetworkYou can create a network of six switches or more (four switch minimum) by connecting Plexxi 2e switches to a Plexxi PSI Interconnect device.

PlexxiPSIInterconnectPlexxi’s Pod Switch Interconnect (PSI) is a passive optical switch that uses Plexxi’s optical LightRail interface to connect some of Plexxi Switch 2 models 2p, 2sp, and 2e into a meshed network.

MaketheConnectionsYou connect Plexxi PSI Interconnect LightRail ports to the Plexxi Switch 2e QSFP ports following the West-to-East convention. You plug the 24-fiber connector into the Plexxi PSI Interconnect port and the 12-fiber side of the MTP connector to the QSFP ports on Plexxi Switch 2e.

You need to match the label number (1, 2, and 3) on the 12-fiber side of the MTP connectors with a specific port number on Plexxi Switch 2e. You connect to the appropriate QSFP port in the direction, West or East, that you need.

MTP Connector Switch 2e Port Label Direction

1 Q1

Q2

West (W1)

East (E1)

2 Q3

Q4

West (W2)

East (E2)

3 Q5

Q6

West (W3)

East (E3)

LightRail Ports

East West

Extender LightRail ports for connection to other PSI units.


LoopbackUnusedPortsYou need to loopback any unused ports, including the extender ports. For example, if you are using a single PSI device you need to loopback the extension ports with three 10-inch MTP cables to make the following connections:

• EX1-WX1

• EX2-WX2

• EX3-WX3

ConnectMultiplePSIDevicesWhen use regular 24 fiber LightRail cables to connect multiple PSI devices; three cables to the East PSI device, three cables to the West PSI device.

ConnectionDiagramThe QSFP ports in the diagram include a label indicating direction (W1 through W3 and E1 through E3). These labels are for informational purpose and are not found on the Plexxi Switch 2e chassis.

Open LightRail ports Unused ports are looped back


NetworkwithSwitch2PodModelsYou can create a network topology that includes Switch 2e, Switch 2p and Switch 2sp when they are attached to a PSI. The optics used in the QSFP slots that create the LightRail use 1310nm waves, which makes Switch 2e LightRail compatible with these two pod versions of Plexxi Switches (Switch 2p, 2sp).

The following illustration shows a network topology that includes two Plexxi 2e switches and a Plexxi Switch 2sp connected to Plexxi PSI Interconnect device. As shown, all unused ports are looped back.


DirectConnectNetworkYou can directly connect Plexxi 2e switches together using a QSFP-to-QSFP cable such as DAC or AOC. You cannot directly connect Plexxi 2e switches in a network that includes Switch 2p and 2sp as well or if the deployment is expected to grow beyond seven switches.

ConnectionGuidelines• Three type of connections are allowed between two Plexxi 2e switches:

W1-E1, W2-E2, W3-E3

QSFP DAC or AOC cables are connected from the top ports (W1, W2, W3) to the bottom ports (E1, E2, E3), East and West ports of the same number are allowed to connect.

• Number the Plexxi 2e switches you want to connect starting with 1. For example, if you are connecting five Plexxi 2e switches, number them 1, 2, 3, 4, 5. You can affix a label to the switch for identification.

• Start the connection from Switch 2e 1, go on to Switch 2e 2 next, through to the last Switch 2e in the Plexxi Ring fabric.

• Start connections from W1, then W2, then W3 for each Switch 2e.

• Connect W1 to E1, W2 to E2, and W3 to E3. For each switch, connect W1 to the next numbered switch E1, W2 to the E2 port of the switch that comes next in order, and W3 to the E3 port of the switch that comes next again in order. For example, you plug one end of the DAC or AOC cable in W1 on Switch 2e 1 and the other end in E1 on the Switch 2e 2.

FourSwitchNetworkConnectionExample1. Number your switches 1 to 4.

2. Connect switch 1:

• W1 to switch 2 E1



FiveSwitchNetworkConnectionExampleIn a five Switch 2e network, when you connect Switch 2e 5, the next switch is 1, followed by switch 2, and then switch 3.

1. Number your switches 1 to 5.

2. Connect switch 5:





NetworkDiagrams


SevenSwitchConnectionExampleFollow these steps to create a seven Switch 2e ring fabric. Start with Switch 2e 1 and connect in order. Keep in mind that Switch 1 is after Switch 7 in the Plexxi Ring fabric.

From To From To From To

Switch 1 Switch 2 Switch 3

W1 (Q1) Switch 2 E1 (Q2) W1 (Q1) Switch 3 E1 (Q2) W1 (Q1) Switch 4 E1 (Q2)







Switch 7

W1 (Q1) Switch 1 E1 (Q2)




AddSwitchtoExistingNetworkFollow the guidelines described here to add a Switch 2e to an existing network, which requires recabling the switches.

• Identify the numbers or order of the current Plexxi 2e switches in the existing ring fabric, which one is 1, which one is 2, and so on.

• Make the Switch 2e you want to add to the ring fabric the last number/last in order.

Five-SwitchNetworkExampleYou have an existing ring fabric with five Plexxi 2e switches. You want to add another switch 2e to make it a ring fabric of six. To add the switch, you need to shift six existing connections and add three more cables.

ConnectionTable






Switch 4 Switch 5

W1 (Q1) Switch 5 E1 (Q2) W1 (Q1) Switch 1 E1 (Q2)




ChangeConnectionsYou start changing connections with Plexxi Switch 2e 3 W3, then Plexxi Switch 2e 4, next Plexxi Switch 2e 5, and finally number 6. The following table lists the recabling required by direction and by QSFP port number.

Switch to Switch Connect

Switch 3 W3 to Switch 6 E3 1. Unplug Switch 1 E3 (Q6)

2. Plug the freed end into Switch 6 E3 (Q6)


2. Plug freed end into Switch 6 E2 (Q2)









Switch 6 W1 to Switch 1 E1 1. Plug Switch 6 W1 (Q1) to Switch 1 E1 (Q2)

Switch 6 W2 to Switch 2 E2 1. Plug Switch 6 W2 (Q3) to Switch 2 E2 (Q4)

Switch 6 W3 to Switch 3 E3 1. Plug Switch 6 W3 (Q5) to Switch 3 W3 (Q6)


NewConnectionTable



W1 (Q1) Switch 2 E1 (Q2) W1 (Q1) Switch 3 E1 (Q2) W1(Q1) Switch 4 E1 (Q2)


W3 (Q5) Switch 4 E3 (Q6) W3 (Q5) Switch 5 E3 (Q6) W3(Q5) Switch 6 E3 (Q6)




W3 (Q5) Switch 1 E3 (Q6) W3 (Q5) Switch 2 E3 W3 (Q5) Switch 3 E3 (Q6)

SixSwitch2eNetworkExample


PortsandLEDs

AccessPortsandLEDsEach Switch 2e access port has at least one LED.

• 48 SFP+ ports each have their own LED

• 6 QSFP ports each have 4 LEDs

When connected, the LED for the corresponding access port will be lit. When there is activity on that port, the LED with flicker as I/O is done to that port.

For example:

I/OPanelLEDsThere are three LEDs and a RESET button on the I/O panel.

LED State

P-1 Lights when the SFP-side power supply is plugged in (power supply labeled PWR1 located on opposite end)

P-2 Lights when the QSFP-side power supply is plugged in (power supply labeled PWR2 located on opposite end.

STAT Solid light when everything is operating properly. If something is wrong, the LED flashes slowly.


STATLEDStatesThe STAT LED can flash fast, slow or display a solid color.

Green Switch Software State

FF Started and is initializing

SF Initialized but has not yet connected to Plexxi Control

S Operational and connected to Plexxi Control

PowerSupplyLEDEach power supply has an LED in the lower left corner. When the LED is:

• steady: the power supply is plugged in

• flashing: there is no power at that power supply but there is power to the other supply

• off: no power to either power supply

FanLEDEach fan has an LED located to its right. When the LED is:

• green: the fan is plugged in and running

• red: the fan is pulled or something is wrong


ManagementPortLEDsThe management port has two LEDs:

• left one lights up when an active network is plugged in and flickers when there is activity

• right one is unused.


SiteRequirementsObserve the following requirements when selecting a site to install the Plexxi Switch.

AltitudeThe Plexxi Switch is designed to operate at an altitude ranging from 0 to 3000 meters (0 to 10,000 feet).

VentilationTo ensure proper ventilation, allow ample airflow to the front and back of the switch. The cooling fans and the power supplies are both oriented to support the airflow configuration ordered.

TemperatureThe operating ambient temperature of a closed or multi-unit rack environment could be greater than room ambient temperature. Ensure you install the equipment in an environment compatible with the maximum ambient temperature (Tma) specified by the manufacturer.

The switch must be used in a non-condensing environment, in a temperature range above 0° C (32° F) and below 40° C (104° F).

CircuitOverloadingThe Plexxi kit contains two power supplies, which should be connected to separate circuits for redundancy protection. Unless specified, the shipping container includes two power cables, each 2.5 meters in length, which comply with appropriate country standards.

When you connect the equipment to the supply circuit, do not overload the circuits. You need to consider the overcurrent protection and supply wiring. Review the equipment nameplate ratings before you start making connections.

Make certain that all input connections are accessible at all times, and disconnect all power plugs before servicing or moving the unit.

ReliableEarthing/GroundingMaintain reliable earthing/grounding of the rack-mounted equipment. Pay particular attention to any supply connections other than direct connections to the branch circuit (for example, the use of power strips). Verify that the AC power cords can easily reach from the AC power outlet to the connection on the power supply panel of the switch.

MechanicalLoadingEnsure there is no uneven mechanical loading for the equipment in the rack to avoid a potentially hazardous condition.

CablingEnsure there is ample clearance at the front and access port panels to allow unrestricted cabling. Also ensure the AC power cords can easily reach from the AC power outlet to the connection on the power supply panel of the switch.

EquipmentProtectionChoose an area where liquids or other foreign objects cannot fall onto the equipment or be drawn into ventilation holes.

plexxi switch 2e install guide · or program components described in this documentation, as...

Documents